-- Logs begin at Sat 2022-09-24 13:45:59 UTC, end at Sat 2022-09-24 14:41:50 UTC. -- Sep 24 14:11:35.046219 dv-cinder-859193-1-smb systemd[1]: Starting Devstack devstack@keystone.service... Sep 24 14:11:35.053949 dv-cinder-859193-1-smb devstack@keystone.service[81445]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Sep 24 14:11:35.055952 dv-cinder-859193-1-smb devstack@keystone.service[81445]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sat Sep 24 14:11:35 2022] *** Sep 24 14:11:35.055952 dv-cinder-859193-1-smb devstack@keystone.service[81445]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 24 14:11:35.055952 dv-cinder-859193-1-smb devstack@keystone.service[81445]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 24 14:11:35.055952 dv-cinder-859193-1-smb devstack@keystone.service[81445]: nodename: dv-cinder-859193-1-smb Sep 24 14:11:35.055952 dv-cinder-859193-1-smb devstack@keystone.service[81445]: machine: x86_64 Sep 24 14:11:35.055952 dv-cinder-859193-1-smb devstack@keystone.service[81445]: clock source: unix Sep 24 14:11:35.055952 dv-cinder-859193-1-smb devstack@keystone.service[81445]: pcre jit disabled Sep 24 14:11:35.056497 dv-cinder-859193-1-smb devstack@keystone.service[81445]: detected number of CPU cores: 4 Sep 24 14:11:35.056497 dv-cinder-859193-1-smb devstack@keystone.service[81445]: current working directory: / Sep 24 14:11:35.056497 dv-cinder-859193-1-smb devstack@keystone.service[81445]: detected binary path: /usr/bin/uwsgi-core Sep 24 14:11:35.056497 dv-cinder-859193-1-smb devstack@keystone.service[81445]: your processes number limit is 47680 Sep 24 14:11:35.056497 dv-cinder-859193-1-smb devstack@keystone.service[81445]: your memory page size is 4096 bytes Sep 24 14:11:35.056497 dv-cinder-859193-1-smb devstack@keystone.service[81445]: detected max file descriptor number: 2048 Sep 24 14:11:35.056497 dv-cinder-859193-1-smb devstack@keystone.service[81445]: lock engine: pthread robust mutexes Sep 24 14:11:35.063536 dv-cinder-859193-1-smb devstack@keystone.service[81445]: thunder lock: enabled Sep 24 14:11:35.063536 dv-cinder-859193-1-smb devstack@keystone.service[81445]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Sep 24 14:11:35.063536 dv-cinder-859193-1-smb devstack@keystone.service[81445]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 24 14:11:35.101718 dv-cinder-859193-1-smb devstack@keystone.service[81445]: Python main interpreter initialized at 0x55d72e8c19c0 Sep 24 14:11:35.101718 dv-cinder-859193-1-smb devstack@keystone.service[81445]: python threads support enabled Sep 24 14:11:35.101718 dv-cinder-859193-1-smb devstack@keystone.service[81445]: your server socket listen backlog is limited to 100 connections Sep 24 14:11:35.101718 dv-cinder-859193-1-smb devstack@keystone.service[81445]: your mercy for graceful operations on workers is 90 seconds Sep 24 14:11:35.102066 dv-cinder-859193-1-smb devstack@keystone.service[81445]: mapped 403077 bytes (393 KB) for 2 cores Sep 24 14:11:35.102148 dv-cinder-859193-1-smb devstack@keystone.service[81445]: *** Operational MODE: preforking *** Sep 24 14:11:35.102399 dv-cinder-859193-1-smb devstack@keystone.service[81445]: *** uWSGI is running in multiple interpreter mode *** Sep 24 14:11:35.102399 dv-cinder-859193-1-smb devstack@keystone.service[81445]: spawned uWSGI master process (pid: 81445) Sep 24 14:11:35.102589 dv-cinder-859193-1-smb systemd[1]: Started Devstack devstack@keystone.service. Sep 24 14:11:35.104188 dv-cinder-859193-1-smb devstack@keystone.service[81445]: spawned uWSGI worker 1 (pid: 81458, cores: 1) Sep 24 14:11:35.104188 dv-cinder-859193-1-smb devstack@keystone.service[81445]: spawned uWSGI worker 2 (pid: 81459, cores: 1) Sep 24 14:11:35.104188 dv-cinder-859193-1-smb devstack@keystone.service[81445]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 24 14:11:39.372056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:11:39.372056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: from cryptography.utils import int_from_bytes Sep 24 14:11:39.372885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:11:39.372885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: from cryptography.utils import int_from_bytes Sep 24 14:11:39.376878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:11:39.376878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: from cryptography.utils import int_from_bytes Sep 24 14:11:39.377333 dv-cinder-859193-1-smb devstack@keystone.service[81459]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 24 14:11:39.377333 dv-cinder-859193-1-smb devstack@keystone.service[81459]: from cryptography.utils import int_from_bytes Sep 24 14:11:39.422450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 14:11:39.422644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 14:11:39.422839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] command line args: [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 14:11:39.423113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 14:11:39.423299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ================================================================================ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 14:11:39.423557 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] admin_token = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.423808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_dir = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.423963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 24 14:11:39.424049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.424174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 24 14:11:39.424266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] config_source = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.424369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] debug = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.424457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] command line args: [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 24 14:11:39.424571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.425452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 24 14:11:39.425452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ================================================================================ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 24 14:11:39.425568 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.425634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] admin_token = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.425693 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.425882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_dir = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.425998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.426101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.426208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.426322 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] config_source = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.426420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] debug = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.426512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.426612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.426732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_config_append = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.426732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.426934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427034 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_dir = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_config_append = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.427957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.428148 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.428262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_dir = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.428369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.428446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.428528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.428611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.428683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.428799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.428879 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.429014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.429108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.429262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.429342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.429438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.429549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.429636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.429787 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.429908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.430041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.430118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.430294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.430372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.430505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.430586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.430739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.430970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.431049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.431216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.431294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] publish_errors = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.431459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.431575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.431694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.431786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.431860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.432114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.432223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.16/identity {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.432379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.432468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] publish_errors = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.432619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] standard_threads = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.432703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.432846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.432931 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.433010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.433088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.433252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.433329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.433435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_journal = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.433560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.433647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_json = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.433726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] standard_threads = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.433803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_stderr = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.433920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.434054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] use_syslog = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.434161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.434239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.434334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.434411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.434509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_journal = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.434648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.434727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_json = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.434841 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_stderr = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.434923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.435015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] use_syslog = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.435144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.435230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 24 14:11:39.435399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.435476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.435641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.435718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.435896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.435984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.436137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.436233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.436411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.436491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.436658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.436743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.436906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.436990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.437142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.437221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.437385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.437472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.437622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.437700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.437865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.437955 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.438099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.438189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.438344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.438422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.438578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.438657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.438825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.438920 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.439072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.439150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.439307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.439384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.439559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.439712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.439813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.439890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.440058 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.440135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.440353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.440435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.440594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.440672 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.440834 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.440919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.441070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.441156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.441392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.441547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.441623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.441782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.441860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.442010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.442088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.442243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.442320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.442490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.442569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.442738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.442816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.442967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.443044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.443195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.443274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.443441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.443519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.443680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.443761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.443914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.444003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.444177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.444258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.444405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.444481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.444639 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.444717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.444870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.444947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.445100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.445178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.445326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.445401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.445546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.445625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.445774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.445851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.446008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.446087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.446254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.446331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.446481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.446558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.446714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.446792 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.446944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.447022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.447176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.447252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.447409 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.447487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.447649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.447726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.447877 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.447952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.448110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.448206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.448369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.448517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.448629 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.448735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.448833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.448928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.449045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.449150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.449272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.449383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.449519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.449610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.449753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.449987 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.450075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.450214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.450307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.450466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.450545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.450698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.450822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.450927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.451015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.451162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.451247 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.451395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.451474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.451659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.451749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.451899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.452043 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.452199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.452290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.452414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.452506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.452646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.452731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.452879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.452959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.453111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.453201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.453354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.453471 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.453587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.453704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.453823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.453911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.454060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.454144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.454292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.454369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.454528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.454615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_password = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.454762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.454839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.454995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.455073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.455228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.455315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.455463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.455541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.455695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_sasl_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.455772 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.456491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.456591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.456735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.456813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.456976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.457055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.memcache_username = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.457213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.457367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.457443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.457515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.457676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.457754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.457910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.457997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.458144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.458223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.458376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.458453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.458607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.458686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.458836 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.458922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.459064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.459144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.459297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.459375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.459526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.459606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.459764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.459844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.459997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.460075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.460266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.460348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.460502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.460593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.external = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.460748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.460858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.461004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.461084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.461244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.461326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.461474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.external = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.461553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.password = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.461703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.461782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] auth.token = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.461964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.462045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.462205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.462285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.462437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.password = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.462515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.462666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] auth.token = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.462753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.462901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.462990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.463134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.463213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.463377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.463458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.463604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.463682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.463848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.463937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.464092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.464229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.464353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.464431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.464565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.464645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.464810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.464892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.465055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.465135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.465300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.465379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.465552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.465633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.465791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.465870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.466023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.466101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.466268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.466349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.466520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.466600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.466755 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.466834 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.467008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.467095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.467287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.467366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.467528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.467607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.467771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.467858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.468014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.468101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.468289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.468360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.468524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.468594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.468759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.468828 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.469006 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.469074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.469251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.469320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.469481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.469549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.469728 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.469805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.469964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.470032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.470215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.470282 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.470448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.470523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.470700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.470767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.470998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.471076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.471180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.471370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.471482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.471734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.472399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.472497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.472606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.472714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.472815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.472911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.473008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.473104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.473200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.473305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.473403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.473500 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.473596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.473692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.473838 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.473962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.474344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.474434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.474578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.474665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.474809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.474898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.475039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.475119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.475281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.475360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.475526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.475615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.475772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.475852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.476026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.476108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.476298 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.476390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.476543 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.476624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.476780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.476859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.477013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.477101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.477244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.477323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.477479 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.477558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.477708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.477796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.477941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.478021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.478178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.478257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.478416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.478515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.478658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.478736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.478885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.478964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.479131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.479219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.479370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.479448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.479601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.479679 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.479832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.479918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.480073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.480171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.480326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.480431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.480564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.480672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.480797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.480908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.481033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.481138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.481268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.481377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.481507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.481645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.481750 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.481888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.482002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.482127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.482233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.482384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.482488 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.482638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.482752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.482883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.482990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.483229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.483368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.483481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.483607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.483718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.483851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.483990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.484098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.484239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.484346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.484453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.484549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.484645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.485965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.486037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.486154 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.486237 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.486389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.486469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.486622 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.486702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.486855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.486936 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.487083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.487162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.487354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.487460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.487600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.487716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.487845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.487957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.488091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.488234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.488359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.488482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.488588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.488725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.488832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.488967 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.489055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.489209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.489289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.489461 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.489540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.489715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.489803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.489958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.490038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.490220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.490304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.490457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.490545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.490707 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.490792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.490948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.491028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.491189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.491278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.491431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.491511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.491683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.491762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.491921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.492009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.492177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.492259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.492420 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.492500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.492653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.492744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.492890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.492970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.493131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.493209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.493377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.493464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.493625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.493704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.493860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.493939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.494109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.494202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.494358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.494445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.494590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.494668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.494839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.495041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.495130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.495206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.495280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.495354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.495518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.495621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.495764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.495854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.495994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.496083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.496273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.496363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.496521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.496610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.496769 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.496858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.497015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.497105 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.497259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.497344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.497503 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.497592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.497738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.497820 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.497983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.498063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.498217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.498296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.498463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.498544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.498710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.498789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.498955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.499119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.499208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.499364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.499587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.499666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.499823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.499901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.500073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.500176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.500348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.500428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.500594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.500672 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.500840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.500921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.501073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.501153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.501325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.501419 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.501560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.501639 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.501799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.501877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.502029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.502116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.502267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.502347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.502498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.502576 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.502747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.502845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.503027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.503106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.503270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.503349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.503503 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.503589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.503738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.503817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.503966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.504083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.504215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.504309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.504448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.504529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.504695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.504774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.504929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.505016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.505184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.505265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.505430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.505516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.505665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.505753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.505907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.505987 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.506147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.506225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.506391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.506477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.506624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.506703 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.506860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.506939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.507093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.507179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.507337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.507417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.507597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.507685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.507827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.507913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.508066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.508148 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.508352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.508460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.508610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.508714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.508850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.508958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.509096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.509203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.509329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.509442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.509566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.509683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.509798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.509923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.510032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.510163 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.510250 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.510410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.510499 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.510650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.510721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.510898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.510987 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.511137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.511225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.511379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.511459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.511617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.511696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.511850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.511937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.512090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.512189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.512347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.512434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.512585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.512678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.512754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81458) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 14:11:39.512827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 24 14:11:39.512972 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81459) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 24 14:11:39.543001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.543159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.543240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.543311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.543456 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.543541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.551786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.551878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.579323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.579548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.579965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.580224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.634110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.634260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.682807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.683037 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.683798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.684040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.838353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.838535 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.838608 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.838704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.838796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.838875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.839003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.839086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.839220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.839302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.839431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.839514 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.862241 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.862471 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.862590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.862690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.862829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.862913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.863060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.863142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.863288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.863372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.863512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.863640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.863727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.863932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.874509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.874937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.887590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.887770 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.887906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.888024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.888144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.888249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.888408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.888492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.888620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.888703 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.888831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81459) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.888912 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.889044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.889261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81458) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Sep 24 14:11:39.905255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.905465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 14:11:39.905707 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.905790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.905923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 14:11:39.906019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 14:11:39.906247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.906328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.906456 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Sep 24 14:11:39.906537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.906736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.906819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.906996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.907076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.907259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.907524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.917032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.917310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.917580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.917727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.917863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.918010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.918290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.918580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.924807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.925664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.927674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.927956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.928261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.928545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.928662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.928831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.928930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.929090 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.929172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.929356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.929445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.929624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.929711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.929890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.929971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.930160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.930249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.930426 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.930507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.930722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.931004 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.931279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.953231 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.954340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.954678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.954959 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.955812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.956182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.959629 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.959912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.960217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.960925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.961216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.961501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.966447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.966732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.967836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.968128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.972751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.973044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.973331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.973616 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.973891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.974427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.974516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.974696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.974778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.974964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.975054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.975332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.975615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.975893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.976190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.976463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.990893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.991178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.992480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.992773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.995011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.996643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:39.998224 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.998522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:39.999888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.000215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.002695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.004443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.005864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.007789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.009086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.009385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.009672 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.009959 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.010237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.010532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.011031 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.011338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.011631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.011922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.012241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.012542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.026326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.026610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.026879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.027143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.028293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.028591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.028864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.029129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.033926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.035986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.036541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH2: ['/token' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.037534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.037809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.038073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.039621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.039903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.040454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.040736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.041022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.041309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.041699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.042577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.042869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.043164 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.043451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.043850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.052841 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.053123 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.053405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.053688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.054067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.054362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.054642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.055152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.055449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.055737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.056025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.056450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.056746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.057031 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.070397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.072990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.073284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.075894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.076141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.077599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.078807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.079075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.079358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.079761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.080290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.082316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.082603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.083003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.086814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.088301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.089396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.090871 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.091162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.091559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.091846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.092121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.093782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.094183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.094474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.094759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.100144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.100460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.100742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.102868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.103174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.103459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.107539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81459) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.107825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.108110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.108410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.108697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.108966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.109236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.109526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.109794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.110060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.110362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81458) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Sep 24 14:11:40.110445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.110652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.110744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.110917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.111002 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.111174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81459) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.111257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.111473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.111750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.112029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.112373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.112660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.112938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.113274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.113553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.113825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.114089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81458) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Sep 24 14:11:40.145822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d72e8c19c0 pid: 81459 (default app) Sep 24 14:11:40.149033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001db232-2743-46cf-9f0a-fad3078256e8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:40.149122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55d72e8c19c0 pid: 81458 (default app) Sep 24 14:11:40.149329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001db232-2743-46cf-9f0a-fad3078256e8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:40.149602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001db232-2743-46cf-9f0a-fad3078256e8 None None] PATH_INFO: `/v3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:40.153732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1/1] 10.222.0.16 () {50 vars in 791 bytes} [Sat Sep 24 14:11:40 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:11:46.879036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aed1c-32ca-443e-b81f-4a5461aec56c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:46.879558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aed1c-32ca-443e-b81f-4a5461aec56c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:46.879558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98aed1c-32ca-443e-b81f-4a5461aec56c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:46.883819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1/2] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:11:46 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:11:46.889079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:46.889509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:46.889646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:46.959193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: INFO dbcounter [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] Registered counter for database keystone Sep 24 14:11:46.977852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG oslo_db.sqlalchemy.engines [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81459) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:11:46.983913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writer thread running {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:11:47.165414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG passlib.handlers.bcrypt [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81459) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 14:11:47.165855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG passlib.handlers.bcrypt [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81459) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 14:11:47.225087 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:11:47.226695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:11:47.353220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 2/3] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:11:46 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 465 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 24 14:11:47.835854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aed1c-32ca-443e-b81f-4a5461aec56c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:47.903897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: INFO dbcounter [None req-f98aed1c-32ca-443e-b81f-4a5461aec56c None None] Registered counter for database keystone Sep 24 14:11:47.925258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG oslo_db.sqlalchemy.engines [None req-f98aed1c-32ca-443e-b81f-4a5461aec56c None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81458) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 24 14:11:47.931373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writer thread running {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 24 14:11:48.049709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98aed1c-32ca-443e-b81f-4a5461aec56c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:48.053881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df35a57-680a-4197-98c8-a4e599465ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:48.054496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35a57-680a-4197-98c8-a4e599465ff3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:48.054775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35a57-680a-4197-98c8-a4e599465ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:48.055045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df35a57-680a-4197-98c8-a4e599465ff3 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:48.063060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df35a57-680a-4197-98c8-a4e599465ff3 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:48.114333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6df35a57-680a-4197-98c8-a4e599465ff3 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 14:11:48.114623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df35a57-680a-4197-98c8-a4e599465ff3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:48.123709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 2/4] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Sep 24 14:11:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:11:48.130162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:48.147209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453d842c-72f1-4a40-8638-0e4118c0b466 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:48.151571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e2ac85-daa1-4bb6-9187-bf04a575a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:48.153098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ac85-daa1-4bb6-9187-bf04a575a0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:48.153444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ac85-daa1-4bb6-9187-bf04a575a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:48.153861 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e2ac85-daa1-4bb6-9187-bf04a575a0c4 admin admin] PATH_INFO: `/v3/projects/2c480881ed7348f895e92a35f216f258` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:48.155800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2ac85-daa1-4bb6-9187-bf04a575a0c4 admin admin] RBAC: Authorizing `identity:get_project(project_id=2c480881ed7348f895e92a35f216f258)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:48.208448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WARNING keystone.common.rbac_enforcer.enforcer [None req-a6e2ac85-daa1-4bb6-9187-bf04a575a0c4 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Sep 24 14:11:48.209116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e2ac85-daa1-4bb6-9187-bf04a575a0c4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:48.213646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 3/5] 10.222.0.16 () {56 vars in 1207 bytes} [Sat Sep 24 14:11:48 2022] GET /identity/v3/projects/2c480881ed7348f895e92a35f216f258 => generated 344 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:11:50.326213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad12d-4635-4d1d-b135-f77b829f8ae5 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:50.326723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad12d-4635-4d1d-b135-f77b829f8ae5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:50.326865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39dad12d-4635-4d1d-b135-f77b829f8ae5 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:50.330944 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 3/6] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:11:50 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:11:50.336555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d0bf1-4144-4799-b5c9-17d389c463c5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:50.336947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d0bf1-4144-4799-b5c9-17d389c463c5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:50.337114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81d0bf1-4144-4799-b5c9-17d389c463c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:50.357694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d81d0bf1-4144-4799-b5c9-17d389c463c5 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:11:50.359210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d81d0bf1-4144-4799-b5c9-17d389c463c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:11:50.369312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 4/7] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:11:50 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Sep 24 14:11:50.635924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad12d-4635-4d1d-b135-f77b829f8ae5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:50.647872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39dad12d-4635-4d1d-b135-f77b829f8ae5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:50.652009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9eb712-900b-4aed-a00e-d20dddbaedcb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:50.652624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb712-900b-4aed-a00e-d20dddbaedcb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:50.652905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb712-900b-4aed-a00e-d20dddbaedcb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:50.653182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9eb712-900b-4aed-a00e-d20dddbaedcb admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:50.661209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9eb712-900b-4aed-a00e-d20dddbaedcb admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:50.662990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9eb712-900b-4aed-a00e-d20dddbaedcb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:50.671513 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 4/8] 10.222.0.16 () {58 vars in 1324 bytes} [Sat Sep 24 14:11:50 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:11:50.677235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d0bf1-4144-4799-b5c9-17d389c463c5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:50.686489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81d0bf1-4144-4799-b5c9-17d389c463c5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:50.690797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135f0cf7-627c-4bc7-8d57-183de08df5c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:50.691412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f0cf7-627c-4bc7-8d57-183de08df5c6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:50.691691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f0cf7-627c-4bc7-8d57-183de08df5c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:50.691965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135f0cf7-627c-4bc7-8d57-183de08df5c6 admin admin] PATH_INFO: `/v3/users/bbb17726a1af479baade55e03809feea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:50.693319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f0cf7-627c-4bc7-8d57-183de08df5c6 admin admin] RBAC: Authorizing `identity:get_user(user_id=bbb17726a1af479baade55e03809feea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:50.695133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135f0cf7-627c-4bc7-8d57-183de08df5c6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:50.696675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 5/9] 10.222.0.16 () {56 vars in 1198 bytes} [Sat Sep 24 14:11:50 2022] GET /identity/v3/users/bbb17726a1af479baade55e03809feea => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:11:52.869904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651adacc-fff3-4dcb-b625-477f4bd360a4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:52.870453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651adacc-fff3-4dcb-b625-477f4bd360a4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:52.870453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-651adacc-fff3-4dcb-b625-477f4bd360a4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:52.871746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 5/10] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:11:52.876986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15421a-2a7a-4190-9850-a70cbd19c826 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:52.877390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15421a-2a7a-4190-9850-a70cbd19c826 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:52.877544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca15421a-2a7a-4190-9850-a70cbd19c826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:52.896275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ca15421a-2a7a-4190-9850-a70cbd19c826 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:11:52.897443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ca15421a-2a7a-4190-9850-a70cbd19c826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:11:52.937215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e61a0-5d0c-4e46-b33d-fc834b1fa4c4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:52.937501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e61a0-5d0c-4e46-b33d-fc834b1fa4c4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:52.937770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1e61a0-5d0c-4e46-b33d-fc834b1fa4c4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:52.939098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 6/11] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:11:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:11:52.944918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b842-ce30-4ae0-acab-a60188f261fc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:52.945206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b842-ce30-4ae0-acab-a60188f261fc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:52.945487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c4b842-ce30-4ae0-acab-a60188f261fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:52.977845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 6/12] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:11:52.989126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG passlib.handlers.bcrypt [None req-98c4b842-ce30-4ae0-acab-a60188f261fc None None] detected 'bcrypt' backend, version '4.0.0' {{(pid=81458) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Sep 24 14:11:52.989528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG passlib.handlers.bcrypt [None req-98c4b842-ce30-4ae0-acab-a60188f261fc None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81458) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Sep 24 14:11:53.038289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-98c4b842-ce30-4ae0-acab-a60188f261fc None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:11:53.039867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-98c4b842-ce30-4ae0-acab-a60188f261fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:11:53.137894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 7/13] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:11:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:11:53.244128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15421a-2a7a-4190-9850-a70cbd19c826 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:53.267750 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:53.346943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca15421a-2a7a-4190-9850-a70cbd19c826 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:53.380702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f9b7-07d7-4eee-827d-d2bb0a0a6fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:53.381334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f9b7-07d7-4eee-827d-d2bb0a0a6fef None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:53.381633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f9b7-07d7-4eee-827d-d2bb0a0a6fef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:53.381892 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0f9b7-07d7-4eee-827d-d2bb0a0a6fef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:53.392832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0f9b7-07d7-4eee-827d-d2bb0a0a6fef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a1c0f9b7-07d7-4eee-827d-d2bb0a0a6fef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:11:53.401565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:11:53.402601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:11:53.403438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 7/14] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:11:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:11:53.407185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4b842-ce30-4ae0-acab-a60188f261fc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:53.408285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f9b7-07d7-4eee-827d-d2bb0a0a6fef None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:53.489154 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:53.507050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0f9b7-07d7-4eee-827d-d2bb0a0a6fef None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:53.508686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c4b842-ce30-4ae0-acab-a60188f261fc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:53.510968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:53.540410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a2d8d-e746-4f64-b853-ee31952c5dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:53.541021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a2d8d-e746-4f64-b853-ee31952c5dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:53.541303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a2d8d-e746-4f64-b853-ee31952c5dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:53.541578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27a2d8d-e746-4f64-b853-ee31952c5dd0 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:53.542244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a2d8d-e746-4f64-b853-ee31952c5dd0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:11:53.542550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a2d8d-e746-4f64-b853-ee31952c5dd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:53.543944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27a2d8d-e746-4f64-b853-ee31952c5dd0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:53.546039 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d133a6-4deb-41d4-a9a3-2000e5efbaae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:53.546898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d133a6-4deb-41d4-a9a3-2000e5efbaae None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:53.547181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d133a6-4deb-41d4-a9a3-2000e5efbaae None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:53.547540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d133a6-4deb-41d4-a9a3-2000e5efbaae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:53.556173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 8/15] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:11:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:11:53.561877 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a2d8d-e746-4f64-b853-ee31952c5dd0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:53.615698 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d133a6-4deb-41d4-a9a3-2000e5efbaae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:53.617244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d133a6-4deb-41d4-a9a3-2000e5efbaae None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:53.657777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27a2d8d-e746-4f64-b853-ee31952c5dd0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:53.690891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b4673-36c3-4150-a607-0b065b007d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:53.691711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b4673-36c3-4150-a607-0b065b007d15 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:53.691996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b4673-36c3-4150-a607-0b065b007d15 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:53.692374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613b4673-36c3-4150-a607-0b065b007d15 None admin] PATH_INFO: `/v3/users/bbb17726a1af479baade55e03809feea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:53.693741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b4673-36c3-4150-a607-0b065b007d15 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb17726a1af479baade55e03809feea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:53.695440 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613b4673-36c3-4150-a607-0b065b007d15 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:53.697110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 9/16] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:11:53 2022] GET /identity/v3/users/bbb17726a1af479baade55e03809feea => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:11:53.702386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b4673-36c3-4150-a607-0b065b007d15 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:53.720208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 8/17] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:11:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:11:53.720389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:53.723550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d133a6-4deb-41d4-a9a3-2000e5efbaae None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:53.726586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:53.802924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613b4673-36c3-4150-a607-0b065b007d15 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:53.821354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d133a6-4deb-41d4-a9a3-2000e5efbaae None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:53.837063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aba897-8612-4634-ab38-a56b36cdfa35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:53.837684 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aba897-8612-4634-ab38-a56b36cdfa35 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:53.837969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aba897-8612-4634-ab38-a56b36cdfa35 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:53.838240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aba897-8612-4634-ab38-a56b36cdfa35 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:53.839355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aba897-8612-4634-ab38-a56b36cdfa35 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:53.840830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aba897-8612-4634-ab38-a56b36cdfa35 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:53.842380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 10/18] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:11:53 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:11:53.848754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aba897-8612-4634-ab38-a56b36cdfa35 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:53.855434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a28c7-dfc4-4576-9005-e79d7bdab3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:53.856324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a28c7-dfc4-4576-9005-e79d7bdab3f4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:53.856610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a28c7-dfc4-4576-9005-e79d7bdab3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:53.856886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-990a28c7-dfc4-4576-9005-e79d7bdab3f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:53.875359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a28c7-dfc4-4576-9005-e79d7bdab3f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:53.876858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-990a28c7-dfc4-4576-9005-e79d7bdab3f4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-990a28c7-dfc4-4576-9005-e79d7bdab3f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:11:53.896061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:11:53.897028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:11:53.898024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:11:53.898024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:11:53.898024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:11:53.898024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 9/19] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:11:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:11:53.902911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a28c7-dfc4-4576-9005-e79d7bdab3f4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:53.927578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:53.946713 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aba897-8612-4634-ab38-a56b36cdfa35 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:53.959690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:53.981764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fdce921-f70b-401a-8a75-51c48b5c3e75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:53.982372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdce921-f70b-401a-8a75-51c48b5c3e75 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:53.982650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdce921-f70b-401a-8a75-51c48b5c3e75 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:53.982929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fdce921-f70b-401a-8a75-51c48b5c3e75 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:53.983648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdce921-f70b-401a-8a75-51c48b5c3e75 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.domain.id=default, user.id=bbb17726a1af479baade55e03809feea) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:11:53.983957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdce921-f70b-401a-8a75-51c48b5c3e75 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:53.985434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fdce921-f70b-401a-8a75-51c48b5c3e75 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:53.991988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 11/20] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Sep 24 14:11:53 2022] GET /identity/v3/role_assignments?user.id=bbb17726a1af479baade55e03809feea&scope.domain.id=default&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 233 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:11:54.003570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-990a28c7-dfc4-4576-9005-e79d7bdab3f4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:54.041818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabe70e4-b6d8-4e9e-8ded-d289b491667f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:54.042451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe70e4-b6d8-4e9e-8ded-d289b491667f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:54.042733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe70e4-b6d8-4e9e-8ded-d289b491667f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:54.043006 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabe70e4-b6d8-4e9e-8ded-d289b491667f None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:54.043672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe70e4-b6d8-4e9e-8ded-d289b491667f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:11:54.043979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe70e4-b6d8-4e9e-8ded-d289b491667f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:54.045455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabe70e4-b6d8-4e9e-8ded-d289b491667f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:54.064810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 10/21] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:11:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:11:56.334271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eea3f4-a92f-4680-8ff8-208e11dfc918 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:56.334782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eea3f4-a92f-4680-8ff8-208e11dfc918 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:56.334874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4eea3f4-a92f-4680-8ff8-208e11dfc918 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:56.336348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 12/22] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:11:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:11:56.341880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fc6c7-4e66-45c5-8379-99452d3fc8bd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:56.342291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fc6c7-4e66-45c5-8379-99452d3fc8bd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:56.342473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905fc6c7-4e66-45c5-8379-99452d3fc8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:56.365720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-905fc6c7-4e66-45c5-8379-99452d3fc8bd None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:11:56.366925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-905fc6c7-4e66-45c5-8379-99452d3fc8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:11:56.457804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 11/23] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:11:56.890402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663a0b0-a55f-4dc2-9c13-ed249ae20e31 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:56.891053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663a0b0-a55f-4dc2-9c13-ed249ae20e31 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:56.891556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f663a0b0-a55f-4dc2-9c13-ed249ae20e31 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:56.893203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 13/24] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:11:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:11:56.906113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb7dd-2b4e-4350-8c33-cf31a12ab999 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:56.906439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb7dd-2b4e-4350-8c33-cf31a12ab999 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:56.906674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fecdb7dd-2b4e-4350-8c33-cf31a12ab999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:56.935531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fecdb7dd-2b4e-4350-8c33-cf31a12ab999 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:11:56.936812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fecdb7dd-2b4e-4350-8c33-cf31a12ab999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:11:56.949968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663a0b0-a55f-4dc2-9c13-ed249ae20e31 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:57.012526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:57.049584 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 12/25] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:11:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:11:57.053181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff362db-be4f-4bd0-930e-6b15e23358e0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:57.053473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff362db-be4f-4bd0-930e-6b15e23358e0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:57.053750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff362db-be4f-4bd0-930e-6b15e23358e0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:57.054986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 13/26] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:11:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:11:57.061228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae3b0-21f1-40f6-812a-96712a5d00df None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:57.062364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae3b0-21f1-40f6-812a-96712a5d00df None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:57.062651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796ae3b0-21f1-40f6-812a-96712a5d00df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:57.101178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-796ae3b0-21f1-40f6-812a-96712a5d00df None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:11:57.102450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-796ae3b0-21f1-40f6-812a-96712a5d00df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:11:57.166186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f663a0b0-a55f-4dc2-9c13-ed249ae20e31 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:57.218844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 14/27] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:11:57.220117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63862d-b67f-40e9-aae2-878295b34d1f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:57.220436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63862d-b67f-40e9-aae2-878295b34d1f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:57.220715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac63862d-b67f-40e9-aae2-878295b34d1f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:57.221972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 15/28] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:11:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:11:57.227914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9da740-8df3-47ef-8c3b-4c0c559044bb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:57.228221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9da740-8df3-47ef-8c3b-4c0c559044bb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:57.228507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9da740-8df3-47ef-8c3b-4c0c559044bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:57.234391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d13279-bafb-4fbd-9d59-59cc4cf96363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:57.235040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d13279-bafb-4fbd-9d59-59cc4cf96363 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:57.235323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d13279-bafb-4fbd-9d59-59cc4cf96363 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:57.235604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d13279-bafb-4fbd-9d59-59cc4cf96363 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:57.258143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d13279-bafb-4fbd-9d59-59cc4cf96363 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-77d13279-bafb-4fbd-9d59-59cc4cf96363 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:11:57.263021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:11:57.263898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:11:57.264732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:11:57.273282 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 14/29] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:11:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:11:57.273511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0f9da740-8df3-47ef-8c3b-4c0c559044bb None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:11:57.274767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0f9da740-8df3-47ef-8c3b-4c0c559044bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:11:57.277585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d13279-bafb-4fbd-9d59-59cc4cf96363 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:57.286631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:57.417511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 16/30] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:11:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:11:57.418206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9da740-8df3-47ef-8c3b-4c0c559044bb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:57.453438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d13279-bafb-4fbd-9d59-59cc4cf96363 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:57.494877 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146483b-8fd8-44c1-977e-ef065deac6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:57.496013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146483b-8fd8-44c1-977e-ef065deac6a9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:57.496337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146483b-8fd8-44c1-977e-ef065deac6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:57.496613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e146483b-8fd8-44c1-977e-ef065deac6a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:57.497286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146483b-8fd8-44c1-977e-ef065deac6a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:11:57.497595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146483b-8fd8-44c1-977e-ef065deac6a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:57.499067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e146483b-8fd8-44c1-977e-ef065deac6a9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:57.509103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 15/31] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:11:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:11:57.514950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146483b-8fd8-44c1-977e-ef065deac6a9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:57.517199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:57.587878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:57.620737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9da740-8df3-47ef-8c3b-4c0c559044bb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:57.627437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e146483b-8fd8-44c1-977e-ef065deac6a9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:57.668122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c9a2b-3398-4a0d-96fd-c052c7cc0fc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:57.668863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c9a2b-3398-4a0d-96fd-c052c7cc0fc4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:57.669238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c9a2b-3398-4a0d-96fd-c052c7cc0fc4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:57.669517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52c9a2b-3398-4a0d-96fd-c052c7cc0fc4 None admin] PATH_INFO: `/v3/users/bbb17726a1af479baade55e03809feea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:57.677026 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647d830-f868-42d1-aa81-b410d211ebaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:57.677179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c9a2b-3398-4a0d-96fd-c052c7cc0fc4 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb17726a1af479baade55e03809feea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:57.677665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647d830-f868-42d1-aa81-b410d211ebaa None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:57.677947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647d830-f868-42d1-aa81-b410d211ebaa None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:57.678224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d647d830-f868-42d1-aa81-b410d211ebaa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:57.678556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52c9a2b-3398-4a0d-96fd-c052c7cc0fc4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:57.680684 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 16/32] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:11:57 2022] GET /identity/v3/users/bbb17726a1af479baade55e03809feea => generated 247 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:11:57.686245 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c9a2b-3398-4a0d-96fd-c052c7cc0fc4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:57.691166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647d830-f868-42d1-aa81-b410d211ebaa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:57.692725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d647d830-f868-42d1-aa81-b410d211ebaa None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d647d830-f868-42d1-aa81-b410d211ebaa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:11:57.708649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:11:57.709537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:11:57.710328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:11:57.710328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:11:57.710328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:11:57.710328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 17/33] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:11:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:11:57.715577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647d830-f868-42d1-aa81-b410d211ebaa None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:57.809763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:57.824391 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d647d830-f868-42d1-aa81-b410d211ebaa None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:57.860656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee13910-9fe8-45db-9e12-43bedf0a354a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:57.861264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee13910-9fe8-45db-9e12-43bedf0a354a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:57.861547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee13910-9fe8-45db-9e12-43bedf0a354a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:57.861830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee13910-9fe8-45db-9e12-43bedf0a354a None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:57.862515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee13910-9fe8-45db-9e12-43bedf0a354a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:11:57.862825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee13910-9fe8-45db-9e12-43bedf0a354a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:57.864245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee13910-9fe8-45db-9e12-43bedf0a354a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:57.885507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 18/34] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:11:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:11:57.886329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee13910-9fe8-45db-9e12-43bedf0a354a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:57.886826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52c9a2b-3398-4a0d-96fd-c052c7cc0fc4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:57.955322 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ad09-db18-45bf-9151-ed3b580c71d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:57.956498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ad09-db18-45bf-9151-ed3b580c71d7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:57.956781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ad09-db18-45bf-9151-ed3b580c71d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:57.957053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8ad09-db18-45bf-9151-ed3b580c71d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:57.958368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8ad09-db18-45bf-9151-ed3b580c71d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:57.959828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8ad09-db18-45bf-9151-ed3b580c71d7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:57.966228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 17/35] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:11:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:11:57.967044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ad09-db18-45bf-9151-ed3b580c71d7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:57.970149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:58.002283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee13910-9fe8-45db-9e12-43bedf0a354a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:58.042093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc9351-346e-423b-9e44-7415c629336f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:58.042767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc9351-346e-423b-9e44-7415c629336f None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:58.043159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc9351-346e-423b-9e44-7415c629336f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:58.043446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6cc9351-346e-423b-9e44-7415c629336f None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:58.044135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc9351-346e-423b-9e44-7415c629336f None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:58.045548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6cc9351-346e-423b-9e44-7415c629336f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:58.079936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8ad09-db18-45bf-9151-ed3b580c71d7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:58.119740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6775f-5d0d-4707-b76f-7046401add6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:58.120407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6775f-5d0d-4707-b76f-7046401add6d None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:58.120689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6775f-5d0d-4707-b76f-7046401add6d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:58.120962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d6775f-5d0d-4707-b76f-7046401add6d None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:58.121626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6775f-5d0d-4707-b76f-7046401add6d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:58.123070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d6775f-5d0d-4707-b76f-7046401add6d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:58.185208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 19/36] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 24 14:11:57 2022] POST /identity/v3/roles => generated 225 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:11:58.186417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc9351-346e-423b-9e44-7415c629336f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:58.200507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:58.269925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 18/37] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:11:57 2022] POST /identity/v3/projects => generated 301 bytes in 303 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:11:58.271197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6775f-5d0d-4707-b76f-7046401add6d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:58.367135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6cc9351-346e-423b-9e44-7415c629336f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:58.383048 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:58.423894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2db5fb-b3e7-441b-aceb-13e254017508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:58.425216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db5fb-b3e7-441b-aceb-13e254017508 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:58.428178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db5fb-b3e7-441b-aceb-13e254017508 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:58.428178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2db5fb-b3e7-441b-aceb-13e254017508 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:58.428178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2db5fb-b3e7-441b-aceb-13e254017508 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:58.428178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc2db5fb-b3e7-441b-aceb-13e254017508 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:58.447328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 20/38] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 24 14:11:58 2022] POST /identity/v3/roles => generated 219 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:11:58.448944 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd3506-c80f-4358-99c2-1d4c58a4fa64 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:58.449365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd3506-c80f-4358-99c2-1d4c58a4fa64 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:58.449653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebbd3506-c80f-4358-99c2-1d4c58a4fa64 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:58.451187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 21/39] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:11:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:11:58.451588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d6775f-5d0d-4707-b76f-7046401add6d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:58.457888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ed57-aa11-4b0f-82da-9981cc3f62e7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:58.458565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ed57-aa11-4b0f-82da-9981cc3f62e7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:58.459048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed2ed57-aa11-4b0f-82da-9981cc3f62e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:58.482071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6ed2ed57-aa11-4b0f-82da-9981cc3f62e7 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:11:58.484357 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6ed2ed57-aa11-4b0f-82da-9981cc3f62e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:11:58.519813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7220a2b-0d83-4328-a314-3ea0ab0aeb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:58.521011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7220a2b-0d83-4328-a314-3ea0ab0aeb51 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:58.521229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7220a2b-0d83-4328-a314-3ea0ab0aeb51 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:58.521513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7220a2b-0d83-4328-a314-3ea0ab0aeb51 None admin] PATH_INFO: `/v3/domains/default/users/bbb17726a1af479baade55e03809feea/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:58.524873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7220a2b-0d83-4328-a314-3ea0ab0aeb51 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bbb17726a1af479baade55e03809feea, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:58.526511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7220a2b-0d83-4328-a314-3ea0ab0aeb51 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:58.548812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 19/40] 10.222.0.16 () {58 vars in 1361 bytes} [Sat Sep 24 14:11:58 2022] PUT /identity/v3/domains/default/users/bbb17726a1af479baade55e03809feea/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:11:58.575851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:58.584185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 22/41] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:11:58.587417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb5a83-b120-4aad-9551-0876514c1b13 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:58.587994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb5a83-b120-4aad-9551-0876514c1b13 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:58.588536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1eb5a83-b120-4aad-9551-0876514c1b13 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:58.590138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 20/42] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:11:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:11:58.596254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6cea-1272-4938-a500-acddf2d83be4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:58.597182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6cea-1272-4938-a500-acddf2d83be4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:58.597547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2d6cea-1272-4938-a500-acddf2d83be4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:58.625483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4e2d6cea-1272-4938-a500-acddf2d83be4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:11:58.627311 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4e2d6cea-1272-4938-a500-acddf2d83be4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:11:58.715735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 23/43] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:11:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:11:58.883104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb5a83-b120-4aad-9551-0876514c1b13 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:58.991776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1eb5a83-b120-4aad-9551-0876514c1b13 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:58.993431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d6cea-1272-4938-a500-acddf2d83be4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:59.008981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:59.033522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b79b-d7f4-43fc-b5a5-07769074bdd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:59.034736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b79b-d7f4-43fc-b5a5-07769074bdd4 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:59.035016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b79b-d7f4-43fc-b5a5-07769074bdd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:59.035298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6b79b-d7f4-43fc-b5a5-07769074bdd4 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:59.036422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6b79b-d7f4-43fc-b5a5-07769074bdd4 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:59.038190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cf6b79b-d7f4-43fc-b5a5-07769074bdd4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:59.054356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 21/44] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 24 14:11:58 2022] POST /identity/v3/roles => generated 223 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:11:59.103823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2d6cea-1272-4938-a500-acddf2d83be4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:59.133643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:11:59.144294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b23e17-4736-4855-b835-d165c4b141d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:59.145015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23e17-4736-4855-b835-d165c4b141d4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:59.145306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23e17-4736-4855-b835-d165c4b141d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:59.145639 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b23e17-4736-4855-b835-d165c4b141d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:59.147204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b23e17-4736-4855-b835-d165c4b141d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:59.148824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b23e17-4736-4855-b835-d165c4b141d4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:59.150771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 24/45] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:11:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:11:59.157062 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b79b-d7f4-43fc-b5a5-07769074bdd4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:11:59.272348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6b79b-d7f4-43fc-b5a5-07769074bdd4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:11:59.306210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b70a1f-7618-4f34-b5d6-49396a149472 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:11:59.306829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b70a1f-7618-4f34-b5d6-49396a149472 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:11:59.307113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b70a1f-7618-4f34-b5d6-49396a149472 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:11:59.307392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b70a1f-7618-4f34-b5d6-49396a149472 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:11:59.308053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b70a1f-7618-4f34-b5d6-49396a149472 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:11:59.309556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b70a1f-7618-4f34-b5d6-49396a149472 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:11:59.447610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 22/46] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:11:59 2022] POST /identity/v3/projects => generated 312 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:00.775116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aba875-7821-4173-956d-8e1db4973bbc None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:00.775651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aba875-7821-4173-956d-8e1db4973bbc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:00.775778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44aba875-7821-4173-956d-8e1db4973bbc None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:00.777160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 25/47] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:00.782445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a633f-fc9d-4872-a84a-f00a2f5b2e95 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:00.782833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a633f-fc9d-4872-a84a-f00a2f5b2e95 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:00.782997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506a633f-fc9d-4872-a84a-f00a2f5b2e95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:00.801152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-506a633f-fc9d-4872-a84a-f00a2f5b2e95 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:00.802650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-506a633f-fc9d-4872-a84a-f00a2f5b2e95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:00.822651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:00.869127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 23/48] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:01.140060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aba875-7821-4173-956d-8e1db4973bbc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:01.240629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44aba875-7821-4173-956d-8e1db4973bbc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:01.274515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8c352-4daa-46c2-919e-ee61dc759be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:01.275139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8c352-4daa-46c2-919e-ee61dc759be4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:01.275417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8c352-4daa-46c2-919e-ee61dc759be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:01.275687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b8c352-4daa-46c2-919e-ee61dc759be4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:01.286481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b8c352-4daa-46c2-919e-ee61dc759be4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-68b8c352-4daa-46c2-919e-ee61dc759be4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:01.394673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:01.395569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:01.396351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 26/49] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:12:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:01.401587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a633f-fc9d-4872-a84a-f00a2f5b2e95 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:01.506148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506a633f-fc9d-4872-a84a-f00a2f5b2e95 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:01.538829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75c03e4-111c-4f7e-b65a-f7d5aa85fa04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:01.539470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c03e4-111c-4f7e-b65a-f7d5aa85fa04 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:01.539753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c03e4-111c-4f7e-b65a-f7d5aa85fa04 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:01.540026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75c03e4-111c-4f7e-b65a-f7d5aa85fa04 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:01.540724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c03e4-111c-4f7e-b65a-f7d5aa85fa04 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:01.541032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c03e4-111c-4f7e-b65a-f7d5aa85fa04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:01.542407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75c03e4-111c-4f7e-b65a-f7d5aa85fa04 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:01.550814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 24/50] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:01.556511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8c352-4daa-46c2-919e-ee61dc759be4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:01.585085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565b64-6ca1-41eb-a46e-1ca6109ef69e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:01.585376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565b64-6ca1-41eb-a46e-1ca6109ef69e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:01.585657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e565b64-6ca1-41eb-a46e-1ca6109ef69e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:01.586972 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 25/51] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:12:01.591729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9cf2-959f-4d87-b3a3-a6a66e6867ec None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:01.592009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9cf2-959f-4d87-b3a3-a6a66e6867ec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:01.592348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5b9cf2-959f-4d87-b3a3-a6a66e6867ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:01.610504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2b5b9cf2-959f-4d87-b3a3-a6a66e6867ec None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:01.611689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2b5b9cf2-959f-4d87-b3a3-a6a66e6867ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:01.617642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:01.625508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:01.661142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b8c352-4daa-46c2-919e-ee61dc759be4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:01.680638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 26/52] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:01.696760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d0aaf-7793-415e-bb60-d74c61c315eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:01.697392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d0aaf-7793-415e-bb60-d74c61c315eb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:01.697676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d0aaf-7793-415e-bb60-d74c61c315eb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:01.697952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273d0aaf-7793-415e-bb60-d74c61c315eb None admin] PATH_INFO: `/v3/users/bbb17726a1af479baade55e03809feea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:01.699307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d0aaf-7793-415e-bb60-d74c61c315eb None admin] RBAC: Authorizing `identity:get_user(user_id=bbb17726a1af479baade55e03809feea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:01.700803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-273d0aaf-7793-415e-bb60-d74c61c315eb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:01.702376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 27/53] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:01 2022] GET /identity/v3/users/bbb17726a1af479baade55e03809feea => generated 247 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:01.707739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9cf2-959f-4d87-b3a3-a6a66e6867ec None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:01.807156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5b9cf2-959f-4d87-b3a3-a6a66e6867ec None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:01.839406 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a6901-25f6-4815-8f83-9596c3b32917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:01.840052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a6901-25f6-4815-8f83-9596c3b32917 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:01.840359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a6901-25f6-4815-8f83-9596c3b32917 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:01.840632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63a6901-25f6-4815-8f83-9596c3b32917 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:01.841747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a6901-25f6-4815-8f83-9596c3b32917 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:01.843188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63a6901-25f6-4815-8f83-9596c3b32917 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:01.844768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 27/54] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:01.851231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d0aaf-7793-415e-bb60-d74c61c315eb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:01.948989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a6901-25f6-4815-8f83-9596c3b32917 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:01.949449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273d0aaf-7793-415e-bb60-d74c61c315eb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:01.968566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:01.975016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:01.986138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd202c-ef73-4dfc-be45-64d4733a671c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:01.986751 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd202c-ef73-4dfc-be45-64d4733a671c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:01.987032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd202c-ef73-4dfc-be45-64d4733a671c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:01.987306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabd202c-ef73-4dfc-be45-64d4733a671c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:01.988037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd202c-ef73-4dfc-be45-64d4733a671c None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.domain.id=default, user.id=bbb17726a1af479baade55e03809feea) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:01.988406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd202c-ef73-4dfc-be45-64d4733a671c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:01.989814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fabd202c-ef73-4dfc-be45-64d4733a671c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:01.998250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 28/55] 10.222.0.16 () {56 vars in 1322 bytes} [Sat Sep 24 14:12:01 2022] GET /identity/v3/role_assignments?user.id=bbb17726a1af479baade55e03809feea&scope.domain.id=default&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 530 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:02.054846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63a6901-25f6-4815-8f83-9596c3b32917 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:02.094630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c9d3f8-b957-43d7-b3e4-a6009d5d0b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:02.095272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d3f8-b957-43d7-b3e4-a6009d5d0b58 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:02.095554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d3f8-b957-43d7-b3e4-a6009d5d0b58 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:02.095831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c9d3f8-b957-43d7-b3e4-a6009d5d0b58 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:02.097033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d3f8-b957-43d7-b3e4-a6009d5d0b58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:02.098526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c9d3f8-b957-43d7-b3e4-a6009d5d0b58 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:02.100438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 28/56] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:02.106117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd202c-ef73-4dfc-be45-64d4733a671c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:02.214979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fabd202c-ef73-4dfc-be45-64d4733a671c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:02.249215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ffbc05-6e54-4c04-bbc9-3fcbf125ccd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:02.249907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffbc05-6e54-4c04-bbc9-3fcbf125ccd8 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:02.250364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffbc05-6e54-4c04-bbc9-3fcbf125ccd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:02.250843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ffbc05-6e54-4c04-bbc9-3fcbf125ccd8 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:02.251896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffbc05-6e54-4c04-bbc9-3fcbf125ccd8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:02.255030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ffbc05-6e54-4c04-bbc9-3fcbf125ccd8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:02.286552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 29/57] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Sep 24 14:12:02 2022] POST /identity/v3/projects => generated 298 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:04.465888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd690716-c8cc-42c7-b503-61b59488e23d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:04.466411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd690716-c8cc-42c7-b503-61b59488e23d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:04.466493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd690716-c8cc-42c7-b503-61b59488e23d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:04.467788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 29/58] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:04.472945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4f425-7ec7-4222-ac0b-581910015816 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:04.473395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4f425-7ec7-4222-ac0b-581910015816 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:04.473483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4f425-7ec7-4222-ac0b-581910015816 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:04.492117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-08d4f425-7ec7-4222-ac0b-581910015816 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:04.493356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-08d4f425-7ec7-4222-ac0b-581910015816 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:04.526872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:04.559370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 30/59] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:04.825113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd690716-c8cc-42c7-b503-61b59488e23d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:04.907819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:04.925164 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd690716-c8cc-42c7-b503-61b59488e23d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:04.958176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167eb45c-5d95-437a-8dad-f9dcc7767508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:04.958793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eb45c-5d95-437a-8dad-f9dcc7767508 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:04.959069 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eb45c-5d95-437a-8dad-f9dcc7767508 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:04.959340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167eb45c-5d95-437a-8dad-f9dcc7767508 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:04.960462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167eb45c-5d95-437a-8dad-f9dcc7767508 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:04.961909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167eb45c-5d95-437a-8dad-f9dcc7767508 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:04.963423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 30/60] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:04.968823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4f425-7ec7-4222-ac0b-581910015816 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:05.063110 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4f425-7ec7-4222-ac0b-581910015816 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:05.095414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d5d99b3-87ad-4151-b7a9-c407965d74c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:05.095950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d99b3-87ad-4151-b7a9-c407965d74c0 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:05.096312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d99b3-87ad-4151-b7a9-c407965d74c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:05.096600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d5d99b3-87ad-4151-b7a9-c407965d74c0 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:05.097253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d99b3-87ad-4151-b7a9-c407965d74c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:05.098680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d5d99b3-87ad-4151-b7a9-c407965d74c0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:05.124585 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 31/61] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:12:04 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:08.494751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ede9-721a-4fe5-8c20-bb214d602b43 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:08.495313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ede9-721a-4fe5-8c20-bb214d602b43 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:08.495313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4114ede9-721a-4fe5-8c20-bb214d602b43 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:08.496854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 31/62] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:08.507287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1785-64e8-4399-8851-d114c5e19e5f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:08.507780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1785-64e8-4399-8851-d114c5e19e5f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:08.508069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18f1785-64e8-4399-8851-d114c5e19e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:08.536292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f0d85-9528-4c1e-820c-c0def0fa440d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:08.536590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f0d85-9528-4c1e-820c-c0def0fa440d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:08.536860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-262f0d85-9528-4c1e-820c-c0def0fa440d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:08.538344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 32/63] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:12:08.540056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a18f1785-64e8-4399-8851-d114c5e19e5f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:08.541302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a18f1785-64e8-4399-8851-d114c5e19e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:08.543033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90bc7a-c010-4e86-9a7c-153c040c6073 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:08.543322 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90bc7a-c010-4e86-9a7c-153c040c6073 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:08.543601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f90bc7a-c010-4e86-9a7c-153c040c6073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:08.581954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6f90bc7a-c010-4e86-9a7c-153c040c6073 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:08.583215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6f90bc7a-c010-4e86-9a7c-153c040c6073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:08.596586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:08.674512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 32/64] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:08.689451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 33/65] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:08.729527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864bae-130f-4cf9-a55f-2971b0f0cdb5 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:08.729812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864bae-130f-4cf9-a55f-2971b0f0cdb5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:08.730092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43864bae-130f-4cf9-a55f-2971b0f0cdb5 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:08.731644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 33/66] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:08.745543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de579b74-4371-4fd1-998e-0041817347e4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:08.745830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de579b74-4371-4fd1-998e-0041817347e4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:08.746106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de579b74-4371-4fd1-998e-0041817347e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:08.773152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-de579b74-4371-4fd1-998e-0041817347e4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:08.774342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-de579b74-4371-4fd1-998e-0041817347e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:08.847695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 34/67] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:08.947252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a1eb-a96f-4b18-9733-52a57a138351 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:08.947910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a1eb-a96f-4b18-9733-52a57a138351 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:08.948436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b273a1eb-a96f-4b18-9733-52a57a138351 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:08.950003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 34/68] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:08.955274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cab19c-82e7-4e3f-b9b6-0105f2ca6d08 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:08.956097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cab19c-82e7-4e3f-b9b6-0105f2ca6d08 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:08.956400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49cab19c-82e7-4e3f-b9b6-0105f2ca6d08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:08.982486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-49cab19c-82e7-4e3f-b9b6-0105f2ca6d08 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:08.983725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a1eb-a96f-4b18-9733-52a57a138351 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:08.985567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-49cab19c-82e7-4e3f-b9b6-0105f2ca6d08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:09.000658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:09.086165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 35/69] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:09.088528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd07b4-a751-4e5c-984a-d0917b90af25 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.088983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd07b4-a751-4e5c-984a-d0917b90af25 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.089645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bd07b4-a751-4e5c-984a-d0917b90af25 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.092107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 36/70] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:09.093270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd07b4-a751-4e5c-984a-d0917b90af25 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.114575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b273a1eb-a96f-4b18-9733-52a57a138351 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:09.150706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10683937-cc36-4299-9514-86c75354713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:09.151544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10683937-cc36-4299-9514-86c75354713b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.151970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10683937-cc36-4299-9514-86c75354713b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.152425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10683937-cc36-4299-9514-86c75354713b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.164440 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10683937-cc36-4299-9514-86c75354713b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-10683937-cc36-4299-9514-86c75354713b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:09.169984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:09.170802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:09.171587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:09.173903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 35/71] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:12:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:09.175476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3148e-56d0-46fe-8e00-bfc5f7227107 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.175760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3148e-56d0-46fe-8e00-bfc5f7227107 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.176035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c3148e-56d0-46fe-8e00-bfc5f7227107 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.195285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b6c3148e-56d0-46fe-8e00-bfc5f7227107 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:09.196509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b6c3148e-56d0-46fe-8e00-bfc5f7227107 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:09.207940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:09.222597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bd07b4-a751-4e5c-984a-d0917b90af25 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:09.257565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc474961-ca69-4f90-a225-27b045cf25a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:09.258124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc474961-ca69-4f90-a225-27b045cf25a8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.258412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc474961-ca69-4f90-a225-27b045cf25a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.258692 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc474961-ca69-4f90-a225-27b045cf25a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.268826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc474961-ca69-4f90-a225-27b045cf25a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:09.276185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 36/72] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:09.276185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3148e-56d0-46fe-8e00-bfc5f7227107 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fc474961-ca69-4f90-a225-27b045cf25a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:09.276374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:09.277167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 37/73] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:09.277926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc474961-ca69-4f90-a225-27b045cf25a8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.281809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:09.394047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c3148e-56d0-46fe-8e00-bfc5f7227107 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:09.406144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc474961-ca69-4f90-a225-27b045cf25a8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:09.430220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15aec-f3cf-460c-9f3a-91324cc2e48f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:09.430851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15aec-f3cf-460c-9f3a-91324cc2e48f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.431136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15aec-f3cf-460c-9f3a-91324cc2e48f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.431412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c15aec-f3cf-460c-9f3a-91324cc2e48f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.441908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c15aec-f3cf-460c-9f3a-91324cc2e48f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:09.442298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc461b-8e52-43c9-b189-cc3f384fe9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:09.442905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc461b-8e52-43c9-b189-cc3f384fe9f2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.443194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc461b-8e52-43c9-b189-cc3f384fe9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.443475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dc461b-8e52-43c9-b189-cc3f384fe9f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.444140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc461b-8e52-43c9-b189-cc3f384fe9f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:09.444476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc461b-8e52-43c9-b189-cc3f384fe9f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:09.445881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dc461b-8e52-43c9-b189-cc3f384fe9f2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f3c15aec-f3cf-460c-9f3a-91324cc2e48f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:09.446727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:09.447567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:09.448375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 37/74] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:09.449599 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15aec-f3cf-460c-9f3a-91324cc2e48f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.458730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 38/75] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:09.458730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc461b-8e52-43c9-b189-cc3f384fe9f2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.460734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:09.528680 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:09.564625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c15aec-f3cf-460c-9f3a-91324cc2e48f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:09.570852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dc461b-8e52-43c9-b189-cc3f384fe9f2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:09.598354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57065242-725c-47f4-9ac6-4ea8e5e43656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:09.598959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57065242-725c-47f4-9ac6-4ea8e5e43656 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.599238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57065242-725c-47f4-9ac6-4ea8e5e43656 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.599516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57065242-725c-47f4-9ac6-4ea8e5e43656 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.600471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57065242-725c-47f4-9ac6-4ea8e5e43656 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:09.600777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57065242-725c-47f4-9ac6-4ea8e5e43656 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:09.602152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57065242-725c-47f4-9ac6-4ea8e5e43656 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:09.603519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee0151-ab69-4c6b-a63b-0beac4e225de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:09.604148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee0151-ab69-4c6b-a63b-0beac4e225de None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.604457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee0151-ab69-4c6b-a63b-0beac4e225de None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.604736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ee0151-ab69-4c6b-a63b-0beac4e225de None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.605856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee0151-ab69-4c6b-a63b-0beac4e225de None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:09.607289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ee0151-ab69-4c6b-a63b-0beac4e225de None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:09.608894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 39/76] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:09.609654 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee0151-ab69-4c6b-a63b-0beac4e225de None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.614511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 38/77] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:09.615310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57065242-725c-47f4-9ac6-4ea8e5e43656 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.680261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:09.710957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ee0151-ab69-4c6b-a63b-0beac4e225de None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:09.713794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57065242-725c-47f4-9ac6-4ea8e5e43656 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:09.739709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:09.745022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6fe10-016f-43a0-9b7d-1dbc38faddd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:09.745625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6fe10-016f-43a0-9b7d-1dbc38faddd2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.745908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6fe10-016f-43a0-9b7d-1dbc38faddd2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.746187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6fe10-016f-43a0-9b7d-1dbc38faddd2 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.746853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6fe10-016f-43a0-9b7d-1dbc38faddd2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:09.747158 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6fe10-016f-43a0-9b7d-1dbc38faddd2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:09.748477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eda4d5-a456-4608-bfdb-3f6531fd0289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:09.748615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6fe10-016f-43a0-9b7d-1dbc38faddd2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:09.749106 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eda4d5-a456-4608-bfdb-3f6531fd0289 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.749417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eda4d5-a456-4608-bfdb-3f6531fd0289 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.749692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7eda4d5-a456-4608-bfdb-3f6531fd0289 None admin] PATH_INFO: `/v3/users/bbb17726a1af479baade55e03809feea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.751293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eda4d5-a456-4608-bfdb-3f6531fd0289 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb17726a1af479baade55e03809feea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:09.752833 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7eda4d5-a456-4608-bfdb-3f6531fd0289 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:09.754838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 39/78] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:09 2022] GET /identity/v3/users/bbb17726a1af479baade55e03809feea => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:09.755591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eda4d5-a456-4608-bfdb-3f6531fd0289 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.760990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 40/79] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:09.760990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6fe10-016f-43a0-9b7d-1dbc38faddd2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.859573 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7eda4d5-a456-4608-bfdb-3f6531fd0289 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:09.862212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6fe10-016f-43a0-9b7d-1dbc38faddd2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:09.893976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5df49-e3a5-45ad-8343-33a464f80abd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:09.894653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5df49-e3a5-45ad-8343-33a464f80abd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.894941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5df49-e3a5-45ad-8343-33a464f80abd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.895217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e5df49-e3a5-45ad-8343-33a464f80abd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.896650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616789c4-f10b-46e9-9b3f-2d5e7b13ac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:09.897268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616789c4-f10b-46e9-9b3f-2d5e7b13ac03 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:09.897549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616789c4-f10b-46e9-9b3f-2d5e7b13ac03 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:09.897834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616789c4-f10b-46e9-9b3f-2d5e7b13ac03 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:09.897956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:09.898873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616789c4-f10b-46e9-9b3f-2d5e7b13ac03 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:09.900368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616789c4-f10b-46e9-9b3f-2d5e7b13ac03 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:09.906562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e5df49-e3a5-45ad-8343-33a464f80abd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f9e5df49-e3a5-45ad-8343-33a464f80abd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:09.911782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:09.912665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:09.913453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 40/80] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:09.914166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5df49-e3a5-45ad-8343-33a464f80abd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.928712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 41/81] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:12:09 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:09.929536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616789c4-f10b-46e9-9b3f-2d5e7b13ac03 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:09.994271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:10.031675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e5df49-e3a5-45ad-8343-33a464f80abd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:10.052845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616789c4-f10b-46e9-9b3f-2d5e7b13ac03 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:10.069336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dff5a-1587-4d0e-bba8-6bf32971da56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:10.069997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dff5a-1587-4d0e-bba8-6bf32971da56 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:10.070283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dff5a-1587-4d0e-bba8-6bf32971da56 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:10.070755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d75dff5a-1587-4d0e-bba8-6bf32971da56 None admin] PATH_INFO: `/v3/users/e2c14d578d004e15b160825c91ab523c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:10.088308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dff5a-1587-4d0e-bba8-6bf32971da56 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c14d578d004e15b160825c91ab523c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:10.089799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d75dff5a-1587-4d0e-bba8-6bf32971da56 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:10.091526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 41/82] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:09 2022] GET /identity/v3/users/e2c14d578d004e15b160825c91ab523c => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:10.092349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dff5a-1587-4d0e-bba8-6bf32971da56 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:10.101094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0422-8bd9-4293-be88-4bb0a0ccb68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:10.101760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0422-8bd9-4293-be88-4bb0a0ccb68a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:10.102046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0422-8bd9-4293-be88-4bb0a0ccb68a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:10.102722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626e0422-8bd9-4293-be88-4bb0a0ccb68a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:10.166225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:10.186761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0422-8bd9-4293-be88-4bb0a0ccb68a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:10.188335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626e0422-8bd9-4293-be88-4bb0a0ccb68a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:10.225843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d75dff5a-1587-4d0e-bba8-6bf32971da56 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:10.253363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:10.272645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3f10c-2578-4c4d-80be-83b1e8314c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:10.273288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3f10c-2578-4c4d-80be-83b1e8314c3e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:10.273579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3f10c-2578-4c4d-80be-83b1e8314c3e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:10.273862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3f10c-2578-4c4d-80be-83b1e8314c3e None admin] PATH_INFO: `/v3/users/e2c14d578d004e15b160825c91ab523c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:10.275042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3f10c-2578-4c4d-80be-83b1e8314c3e None admin] RBAC: Authorizing `identity:get_user(user_id=e2c14d578d004e15b160825c91ab523c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:10.276573 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3f10c-2578-4c4d-80be-83b1e8314c3e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:10.278203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 42/83] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:10 2022] GET /identity/v3/users/e2c14d578d004e15b160825c91ab523c => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:10.278968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3f10c-2578-4c4d-80be-83b1e8314c3e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:10.315148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 42/84] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 386 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:10.316328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0422-8bd9-4293-be88-4bb0a0ccb68a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:10.412274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3f10c-2578-4c4d-80be-83b1e8314c3e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:10.426320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626e0422-8bd9-4293-be88-4bb0a0ccb68a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:10.445958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:10.461988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75237-539c-4844-8d99-79710d34e65c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:10.462989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75237-539c-4844-8d99-79710d34e65c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:10.463290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75237-539c-4844-8d99-79710d34e65c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:10.463572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f75237-539c-4844-8d99-79710d34e65c None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:10.464552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f75237-539c-4844-8d99-79710d34e65c None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:10.464865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f75237-539c-4844-8d99-79710d34e65c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:10.466386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f75237-539c-4844-8d99-79710d34e65c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:10.469033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677a70-5b98-4656-bdd8-8d855990a712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:10.469963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677a70-5b98-4656-bdd8-8d855990a712 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:10.470442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677a70-5b98-4656-bdd8-8d855990a712 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:10.470940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4677a70-5b98-4656-bdd8-8d855990a712 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:10.476953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 43/85] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:10.477803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75237-539c-4844-8d99-79710d34e65c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:10.498154 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:10.556478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4677a70-5b98-4656-bdd8-8d855990a712 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:10.557972 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4677a70-5b98-4656-bdd8-8d855990a712 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:10.607718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f75237-539c-4844-8d99-79710d34e65c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:10.650920 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6f1d1-e3e7-4ee3-b27c-f2c2fa985a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:10.651531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f1d1-e3e7-4ee3-b27c-f2c2fa985a41 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:10.651813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f1d1-e3e7-4ee3-b27c-f2c2fa985a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:10.652085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f6f1d1-e3e7-4ee3-b27c-f2c2fa985a41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:10.673181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 43/86] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:10.673600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677a70-5b98-4656-bdd8-8d855990a712 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:10.722453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:10.733664 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:10.745656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6f1d1-e3e7-4ee3-b27c-f2c2fa985a41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:10.748210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2f6f1d1-e3e7-4ee3-b27c-f2c2fa985a41 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:10.791285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4677a70-5b98-4656-bdd8-8d855990a712 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:10.828785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a413143-6731-4650-b0a3-0c987cccace4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:10.829621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a413143-6731-4650-b0a3-0c987cccace4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:10.830040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a413143-6731-4650-b0a3-0c987cccace4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:10.830362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a413143-6731-4650-b0a3-0c987cccace4 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:10.831658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a413143-6731-4650-b0a3-0c987cccace4 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:10.833642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a413143-6731-4650-b0a3-0c987cccace4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:10.835408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 44/87] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:10 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:10.836301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a413143-6731-4650-b0a3-0c987cccace4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:10.894883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 44/88] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:10.894883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6f1d1-e3e7-4ee3-b27c-f2c2fa985a41 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:10.958774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a413143-6731-4650-b0a3-0c987cccace4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:10.978534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:11.000521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68e084-ee45-4464-9362-7ea39c989cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:11.001249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68e084-ee45-4464-9362-7ea39c989cdc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:11.001491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68e084-ee45-4464-9362-7ea39c989cdc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:11.001769 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a68e084-ee45-4464-9362-7ea39c989cdc None admin] PATH_INFO: `/v3/users/e2c14d578d004e15b160825c91ab523c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:11.003337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68e084-ee45-4464-9362-7ea39c989cdc None admin] RBAC: Authorizing `identity:get_user(user_id=e2c14d578d004e15b160825c91ab523c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:11.004589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a68e084-ee45-4464-9362-7ea39c989cdc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:11.006378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:11.011272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 45/89] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:10 2022] GET /identity/v3/users/e2c14d578d004e15b160825c91ab523c => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:11.012274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68e084-ee45-4464-9362-7ea39c989cdc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:11.027747 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f6f1d1-e3e7-4ee3-b27c-f2c2fa985a41 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:11.065658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778f251-eb7d-4042-8b23-ac0b6c8ae823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:11.066405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f251-eb7d-4042-8b23-ac0b6c8ae823 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:11.066761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f251-eb7d-4042-8b23-ac0b6c8ae823 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:11.067110 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e778f251-eb7d-4042-8b23-ac0b6c8ae823 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:11.068525 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778f251-eb7d-4042-8b23-ac0b6c8ae823 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:11.070079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e778f251-eb7d-4042-8b23-ac0b6c8ae823 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:11.072003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 45/90] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:10 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:11.072873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778f251-eb7d-4042-8b23-ac0b6c8ae823 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:11.141545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a68e084-ee45-4464-9362-7ea39c989cdc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:11.181023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e778f251-eb7d-4042-8b23-ac0b6c8ae823 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:11.187615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcee6af-51dc-4140-a0d3-1b1ed36f2efd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:11.188980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee6af-51dc-4140-a0d3-1b1ed36f2efd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:11.189444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee6af-51dc-4140-a0d3-1b1ed36f2efd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:11.189939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcee6af-51dc-4140-a0d3-1b1ed36f2efd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:11.191319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcee6af-51dc-4140-a0d3-1b1ed36f2efd None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=8940941bf57b4aeeabf404864a2b9d10, user.id=bbb17726a1af479baade55e03809feea) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:11.191848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcee6af-51dc-4140-a0d3-1b1ed36f2efd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:11.194035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bcee6af-51dc-4140-a0d3-1b1ed36f2efd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:11.201017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 46/91] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:11 2022] GET /identity/v3/role_assignments?user.id=bbb17726a1af479baade55e03809feea&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:11.202382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcee6af-51dc-4140-a0d3-1b1ed36f2efd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:11.218710 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada3ecf-e17a-44be-8c30-70acc033c556 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:11.219154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3ecf-e17a-44be-8c30-70acc033c556 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:11.219548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3ecf-e17a-44be-8c30-70acc033c556 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:11.219897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ada3ecf-e17a-44be-8c30-70acc033c556 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:11.221517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada3ecf-e17a-44be-8c30-70acc033c556 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:11.223150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ada3ecf-e17a-44be-8c30-70acc033c556 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:11.225318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 46/92] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:11 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:11.226716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada3ecf-e17a-44be-8c30-70acc033c556 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:11.252635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:11.272219 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:11.398212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcee6af-51dc-4140-a0d3-1b1ed36f2efd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:11.419622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ada3ecf-e17a-44be-8c30-70acc033c556 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:11.444002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc7f60-c6da-414a-a196-2a4a511b8cfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:11.445016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc7f60-c6da-414a-a196-2a4a511b8cfb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:11.445498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc7f60-c6da-414a-a196-2a4a511b8cfb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:11.445973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ddc7f60-c6da-414a-a196-2a4a511b8cfb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:11.462223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bba2b-afcc-4a27-85f1-15a1e66dd8f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:11.462626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bba2b-afcc-4a27-85f1-15a1e66dd8f1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:11.463047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bba2b-afcc-4a27-85f1-15a1e66dd8f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:11.463323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174bba2b-afcc-4a27-85f1-15a1e66dd8f1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:11.464056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bba2b-afcc-4a27-85f1-15a1e66dd8f1 None admin] RBAC: Adding query filter params (role.id=a4c95292940e4d359d48ad72b390ece0, scope.project.id=8940941bf57b4aeeabf404864a2b9d10, user.id=e2c14d578d004e15b160825c91ab523c) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:11.464398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bba2b-afcc-4a27-85f1-15a1e66dd8f1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:11.466303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174bba2b-afcc-4a27-85f1-15a1e66dd8f1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:11.475446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 47/93] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:11 2022] GET /identity/v3/role_assignments?user.id=e2c14d578d004e15b160825c91ab523c&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 259 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:11.475446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bba2b-afcc-4a27-85f1-15a1e66dd8f1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:11.551228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc7f60-c6da-414a-a196-2a4a511b8cfb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:11.553157 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ddc7f60-c6da-414a-a196-2a4a511b8cfb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:11.582718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:11.607360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174bba2b-afcc-4a27-85f1-15a1e66dd8f1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:11.637955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:11.654041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9b100-40cf-4d77-a184-152a412d906f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:11.655414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9b100-40cf-4d77-a184-152a412d906f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:11.655897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9b100-40cf-4d77-a184-152a412d906f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:11.656392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad9b100-40cf-4d77-a184-152a412d906f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:11.657503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9b100-40cf-4d77-a184-152a412d906f None admin] RBAC: Adding query filter params (role.id=4f8d839474214ed89390c34864229684, scope.project.id=8940941bf57b4aeeabf404864a2b9d10, user.id=e2c14d578d004e15b160825c91ab523c) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:11.658019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9b100-40cf-4d77-a184-152a412d906f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:11.660328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad9b100-40cf-4d77-a184-152a412d906f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:11.674890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 48/94] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:11 2022] GET /identity/v3/role_assignments?user.id=e2c14d578d004e15b160825c91ab523c&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=4f8d839474214ed89390c34864229684 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:11.733924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 47/95] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:11.740340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9b100-40cf-4d77-a184-152a412d906f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:11.880070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad9b100-40cf-4d77-a184-152a412d906f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:11.917280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38163a64-375f-4ac0-85ac-c65d69bd9507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:11.918271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38163a64-375f-4ac0-85ac-c65d69bd9507 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:11.918757 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38163a64-375f-4ac0-85ac-c65d69bd9507 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:11.919231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38163a64-375f-4ac0-85ac-c65d69bd9507 None admin] PATH_INFO: `/v3/projects/d85b7bc02b834f1998e39bf40140568c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:11.920600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38163a64-375f-4ac0-85ac-c65d69bd9507 None admin] RBAC: Authorizing `identity:get_project(project_id=d85b7bc02b834f1998e39bf40140568c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:11.922299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38163a64-375f-4ac0-85ac-c65d69bd9507 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:11.924428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 49/96] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:11 2022] GET /identity/v3/projects/d85b7bc02b834f1998e39bf40140568c => generated 312 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:11.930722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc7f60-c6da-414a-a196-2a4a511b8cfb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:12.076984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ddc7f60-c6da-414a-a196-2a4a511b8cfb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:12.128993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc193a51-c2f9-4f6b-a35c-d81f6ae6b359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:12.129621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc193a51-c2f9-4f6b-a35c-d81f6ae6b359 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:12.129905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc193a51-c2f9-4f6b-a35c-d81f6ae6b359 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:12.130236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc193a51-c2f9-4f6b-a35c-d81f6ae6b359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:12.131050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc193a51-c2f9-4f6b-a35c-d81f6ae6b359 None admin] RBAC: Adding query filter params (role.id=a4c95292940e4d359d48ad72b390ece0, scope.project.id=d85b7bc02b834f1998e39bf40140568c, user.id=e2c14d578d004e15b160825c91ab523c) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:12.131364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc193a51-c2f9-4f6b-a35c-d81f6ae6b359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:12.133496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc193a51-c2f9-4f6b-a35c-d81f6ae6b359 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:12.147488 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 48/97] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:11 2022] GET /identity/v3/role_assignments?user.id=e2c14d578d004e15b160825c91ab523c&scope.project.id=d85b7bc02b834f1998e39bf40140568c&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 259 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:12.535053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b45a6-4b4b-40af-87c0-6f084e2f7c94 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:12.535715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b45a6-4b4b-40af-87c0-6f084e2f7c94 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:12.536253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093b45a6-4b4b-40af-87c0-6f084e2f7c94 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:12.537795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 50/98] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:12.543441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcead6-d7c3-4121-8e95-048b18767b99 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:12.544033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcead6-d7c3-4121-8e95-048b18767b99 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:12.544543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efcead6-d7c3-4121-8e95-048b18767b99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:12.564480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8efcead6-d7c3-4121-8e95-048b18767b99 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:12.566606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8efcead6-d7c3-4121-8e95-048b18767b99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:12.577244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:12.640545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 49/99] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:12.725229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103847c-d13e-4191-9c18-278ff7a88eec None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:12.726179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103847c-d13e-4191-9c18-278ff7a88eec None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:12.726681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b103847c-d13e-4191-9c18-278ff7a88eec None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:12.728288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 51/100] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:12.733793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168e67a-ba08-4851-908c-6525825e0a9c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:12.734304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168e67a-ba08-4851-908c-6525825e0a9c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:12.734779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6168e67a-ba08-4851-908c-6525825e0a9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:12.758821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6168e67a-ba08-4851-908c-6525825e0a9c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:12.760364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6168e67a-ba08-4851-908c-6525825e0a9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:12.843267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 50/101] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:13.061743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103847c-d13e-4191-9c18-278ff7a88eec None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:13.087350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:13.212838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b103847c-d13e-4191-9c18-278ff7a88eec None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:13.258090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635b960-b3d7-4f45-b651-7ed987d40645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:13.258735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635b960-b3d7-4f45-b651-7ed987d40645 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:13.259016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635b960-b3d7-4f45-b651-7ed987d40645 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:13.259288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2635b960-b3d7-4f45-b651-7ed987d40645 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:13.265109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635b960-b3d7-4f45-b651-7ed987d40645 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:13.266611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2635b960-b3d7-4f45-b651-7ed987d40645 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:13.268910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 52/102] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:13.274607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168e67a-ba08-4851-908c-6525825e0a9c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:13.394999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635b960-b3d7-4f45-b651-7ed987d40645 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:13.399874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:13.438745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6168e67a-ba08-4851-908c-6525825e0a9c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:13.506465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89593d59-95be-4ce6-bdbc-1742f500d6ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:13.508022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89593d59-95be-4ce6-bdbc-1742f500d6ab None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:13.508347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89593d59-95be-4ce6-bdbc-1742f500d6ab None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:13.508635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89593d59-95be-4ce6-bdbc-1742f500d6ab None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:13.509313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89593d59-95be-4ce6-bdbc-1742f500d6ab None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:13.510786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89593d59-95be-4ce6-bdbc-1742f500d6ab None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:13.567824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 51/103] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:12:13 2022] POST /identity/v3/projects => generated 302 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:13.589412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:13.614368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2635b960-b3d7-4f45-b651-7ed987d40645 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:13.659531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb6de2-e028-45a7-ac62-07fe55f45bff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:13.660083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb6de2-e028-45a7-ac62-07fe55f45bff None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:13.660398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb6de2-e028-45a7-ac62-07fe55f45bff None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:13.660669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcb6de2-e028-45a7-ac62-07fe55f45bff None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:13.678284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcb6de2-e028-45a7-ac62-07fe55f45bff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-cdcb6de2-e028-45a7-ac62-07fe55f45bff None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:13.683570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:13.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:13.685229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 53/104] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:13.691432 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89593d59-95be-4ce6-bdbc-1742f500d6ab None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:13.831505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89593d59-95be-4ce6-bdbc-1742f500d6ab None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:13.861350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:13.874908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603771e-f4d6-44d7-a43b-f1024f46bf05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:13.875535 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603771e-f4d6-44d7-a43b-f1024f46bf05 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:13.875883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603771e-f4d6-44d7-a43b-f1024f46bf05 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:13.876596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7603771e-f4d6-44d7-a43b-f1024f46bf05 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:13.878054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603771e-f4d6-44d7-a43b-f1024f46bf05 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:13.878716 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603771e-f4d6-44d7-a43b-f1024f46bf05 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:13.880528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7603771e-f4d6-44d7-a43b-f1024f46bf05 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:13.889794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 52/105] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:13.895525 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb6de2-e028-45a7-ac62-07fe55f45bff None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:14.006856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcb6de2-e028-45a7-ac62-07fe55f45bff None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:14.040544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615716e1-bd91-4d07-8656-808b776176a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:14.041187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615716e1-bd91-4d07-8656-808b776176a8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:14.041454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615716e1-bd91-4d07-8656-808b776176a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:14.041730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615716e1-bd91-4d07-8656-808b776176a8 None admin] PATH_INFO: `/v3/users/afc4ac4a9b9e4cd9b877206a353431b0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:14.055658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615716e1-bd91-4d07-8656-808b776176a8 None admin] RBAC: Authorizing `identity:get_user(user_id=afc4ac4a9b9e4cd9b877206a353431b0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:14.057154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-615716e1-bd91-4d07-8656-808b776176a8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:14.059103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 54/106] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:13 2022] GET /identity/v3/users/afc4ac4a9b9e4cd9b877206a353431b0 => generated 289 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:14.064416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603771e-f4d6-44d7-a43b-f1024f46bf05 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:14.206582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7603771e-f4d6-44d7-a43b-f1024f46bf05 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:14.251676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df5838-fe22-4db6-9e9d-006500fee5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:14.252719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df5838-fe22-4db6-9e9d-006500fee5cd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:14.253207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df5838-fe22-4db6-9e9d-006500fee5cd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:14.253746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86df5838-fe22-4db6-9e9d-006500fee5cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:14.336084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:14.349467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df5838-fe22-4db6-9e9d-006500fee5cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:14.351219 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86df5838-fe22-4db6-9e9d-006500fee5cd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:14.464780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 53/107] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 14:12:14.472937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615716e1-bd91-4d07-8656-808b776176a8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:14.476166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:14.578559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615716e1-bd91-4d07-8656-808b776176a8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:14.613773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070c1552-dd4a-452e-8cf1-2dd512e4ea8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:14.614328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1552-dd4a-452e-8cf1-2dd512e4ea8d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:14.614610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1552-dd4a-452e-8cf1-2dd512e4ea8d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:14.614888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070c1552-dd4a-452e-8cf1-2dd512e4ea8d None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:14.616051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c1552-dd4a-452e-8cf1-2dd512e4ea8d None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:14.617521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070c1552-dd4a-452e-8cf1-2dd512e4ea8d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:14.619198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 55/108] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:14 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:14.625121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df5838-fe22-4db6-9e9d-006500fee5cd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:14.636509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2e7e-ec2f-489e-ba68-df5a9a8856f2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:14.636793 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2e7e-ec2f-489e-ba68-df5a9a8856f2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:14.637072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5c2e7e-ec2f-489e-ba68-df5a9a8856f2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:14.638517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 56/109] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:14.643424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337099d-3eea-4190-bb93-b3b2e4cf9d94 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:14.643728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337099d-3eea-4190-bb93-b3b2e4cf9d94 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:14.643974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337099d-3eea-4190-bb93-b3b2e4cf9d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:14.662788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1337099d-3eea-4190-bb93-b3b2e4cf9d94 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:14.663979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1337099d-3eea-4190-bb93-b3b2e4cf9d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:14.728036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:14.737315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 57/110] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:14.786026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:14.807240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86df5838-fe22-4db6-9e9d-006500fee5cd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:14.859053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1be72c-05e0-489a-a80b-3ae385cc1619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:14.859667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be72c-05e0-489a-a80b-3ae385cc1619 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:14.859944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be72c-05e0-489a-a80b-3ae385cc1619 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:14.860238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1be72c-05e0-489a-a80b-3ae385cc1619 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:14.861078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1be72c-05e0-489a-a80b-3ae385cc1619 None admin] RBAC: Adding query filter params (role.id=80d4b3d42e60434b9994c77552e21e75, scope.project.id=8940941bf57b4aeeabf404864a2b9d10, user.id=afc4ac4a9b9e4cd9b877206a353431b0) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:14.861506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1be72c-05e0-489a-a80b-3ae385cc1619 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:14.863732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab1be72c-05e0-489a-a80b-3ae385cc1619 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:14.877704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 54/111] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:14 2022] GET /identity/v3/role_assignments?user.id=afc4ac4a9b9e4cd9b877206a353431b0&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=80d4b3d42e60434b9994c77552e21e75 => generated 259 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:14.892445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a17086-7e00-431d-bdaf-b54b2cc720fe None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:14.892745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a17086-7e00-431d-bdaf-b54b2cc720fe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:14.893545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a17086-7e00-431d-bdaf-b54b2cc720fe None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:14.895034 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 58/112] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:14.900452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f859-80ed-4498-b568-d9b45b517d1c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:14.900785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f859-80ed-4498-b568-d9b45b517d1c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:14.901018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7802f859-80ed-4498-b568-d9b45b517d1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:14.920063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7802f859-80ed-4498-b568-d9b45b517d1c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:14.921393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7802f859-80ed-4498-b568-d9b45b517d1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:15.027367 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 55/113] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:15.117157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfdafa-14bf-4bdb-8c15-78d0ee57862e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:15.117658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfdafa-14bf-4bdb-8c15-78d0ee57862e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:15.117729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5cfdafa-14bf-4bdb-8c15-78d0ee57862e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:15.119046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 59/114] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:15.126146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34933a-dd5b-423d-a588-07dbd3b8dd0c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:15.126458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34933a-dd5b-423d-a588-07dbd3b8dd0c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:15.126718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e34933a-dd5b-423d-a588-07dbd3b8dd0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:15.153448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2e34933a-dd5b-423d-a588-07dbd3b8dd0c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:15.155183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2e34933a-dd5b-423d-a588-07dbd3b8dd0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:15.245102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 56/115] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:15.246010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfdafa-14bf-4bdb-8c15-78d0ee57862e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:15.365340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5cfdafa-14bf-4bdb-8c15-78d0ee57862e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:15.401562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f8680-401c-4883-8ddc-fa6950f15ebb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:15.402194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f8680-401c-4883-8ddc-fa6950f15ebb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:15.402532 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f8680-401c-4883-8ddc-fa6950f15ebb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:15.402808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af2f8680-401c-4883-8ddc-fa6950f15ebb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:15.414176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af2f8680-401c-4883-8ddc-fa6950f15ebb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-af2f8680-401c-4883-8ddc-fa6950f15ebb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:15.419048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:15.419890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:15.420699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 60/116] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:12:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:12:15.426256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34933a-dd5b-423d-a588-07dbd3b8dd0c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:15.442576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:15.449576 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f8680-401c-4883-8ddc-fa6950f15ebb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:15.579263 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:15.634534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e34933a-dd5b-423d-a588-07dbd3b8dd0c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:15.667992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af2f8680-401c-4883-8ddc-fa6950f15ebb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:15.704292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b5f56-dec9-4a90-9ccc-b453dd11fad9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:15.704912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b5f56-dec9-4a90-9ccc-b453dd11fad9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:15.705194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b5f56-dec9-4a90-9ccc-b453dd11fad9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:15.706017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136b5f56-dec9-4a90-9ccc-b453dd11fad9 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:15.708638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b5f56-dec9-4a90-9ccc-b453dd11fad9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:15.708949 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b5f56-dec9-4a90-9ccc-b453dd11fad9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:15.710361 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-136b5f56-dec9-4a90-9ccc-b453dd11fad9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:15.727752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 57/117] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:15.731553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948625ee-33a4-46cc-a241-5a44fafcdb93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:15.736262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948625ee-33a4-46cc-a241-5a44fafcdb93 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:15.737118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948625ee-33a4-46cc-a241-5a44fafcdb93 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:15.737432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948625ee-33a4-46cc-a241-5a44fafcdb93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:15.740772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b5f56-dec9-4a90-9ccc-b453dd11fad9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:15.767275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948625ee-33a4-46cc-a241-5a44fafcdb93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-948625ee-33a4-46cc-a241-5a44fafcdb93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:15.776516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:15.777390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:15.778160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 61/118] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:12:15.779151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732adc30-b91c-44c2-8e48-72081a44c5b1 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:15.779253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732adc30-b91c-44c2-8e48-72081a44c5b1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:15.779522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732adc30-b91c-44c2-8e48-72081a44c5b1 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:15.781265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 62/119] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:15.786653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c04cf-48e6-4142-9894-0b5d0d1d6d71 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:15.786951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c04cf-48e6-4142-9894-0b5d0d1d6d71 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:15.787248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0c04cf-48e6-4142-9894-0b5d0d1d6d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:15.823384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5c0c04cf-48e6-4142-9894-0b5d0d1d6d71 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:15.824632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5c0c04cf-48e6-4142-9894-0b5d0d1d6d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:15.835731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:15.857850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136b5f56-dec9-4a90-9ccc-b453dd11fad9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:15.903353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878226e-7868-4a45-b72d-2f4fb0c448d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:15.904097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 63/120] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:15.904437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878226e-7868-4a45-b72d-2f4fb0c448d6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:15.904727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878226e-7868-4a45-b72d-2f4fb0c448d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:15.904974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c04cf-48e6-4142-9894-0b5d0d1d6d71 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:15.905074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0878226e-7868-4a45-b72d-2f4fb0c448d6 None admin] PATH_INFO: `/v3/users/bbb17726a1af479baade55e03809feea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:15.913612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878226e-7868-4a45-b72d-2f4fb0c448d6 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb17726a1af479baade55e03809feea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:15.915093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0878226e-7868-4a45-b72d-2f4fb0c448d6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:15.920880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 58/121] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:15 2022] GET /identity/v3/users/bbb17726a1af479baade55e03809feea => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:15.923481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878226e-7868-4a45-b72d-2f4fb0c448d6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:15.998418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:16.085280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0c04cf-48e6-4142-9894-0b5d0d1d6d71 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:16.104633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0878226e-7868-4a45-b72d-2f4fb0c448d6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:16.149022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17887e23-264b-4063-8c0c-7b744fabeb54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:16.149679 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17887e23-264b-4063-8c0c-7b744fabeb54 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:16.149912 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17887e23-264b-4063-8c0c-7b744fabeb54 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:16.150186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17887e23-264b-4063-8c0c-7b744fabeb54 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:16.150855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17887e23-264b-4063-8c0c-7b744fabeb54 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:16.151158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17887e23-264b-4063-8c0c-7b744fabeb54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:16.152553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17887e23-264b-4063-8c0c-7b744fabeb54 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:16.168627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 64/122] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:16.169435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17887e23-264b-4063-8c0c-7b744fabeb54 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:16.171745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f5de3-ece1-4df8-a287-af8f5efafc0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:16.172352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f5de3-ece1-4df8-a287-af8f5efafc0e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:16.172637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f5de3-ece1-4df8-a287-af8f5efafc0e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:16.172919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f5de3-ece1-4df8-a287-af8f5efafc0e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:16.193724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f5de3-ece1-4df8-a287-af8f5efafc0e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9d8f5de3-ece1-4df8-a287-af8f5efafc0e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:16.198980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:16.199805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:16.200687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 59/123] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:16.201319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f5de3-ece1-4df8-a287-af8f5efafc0e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:16.207176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:16.327225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f5de3-ece1-4df8-a287-af8f5efafc0e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:16.327571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17887e23-264b-4063-8c0c-7b744fabeb54 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:16.341403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:16.369959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833c49c-07be-4661-b470-4fb61f1e233f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:16.371088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c49c-07be-4661-b470-4fb61f1e233f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:16.371594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c49c-07be-4661-b470-4fb61f1e233f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:16.372098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7833c49c-07be-4661-b470-4fb61f1e233f None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:16.373033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085af33-2310-4174-8f4d-943bc165fc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:16.373643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833c49c-07be-4661-b470-4fb61f1e233f None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:16.373859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085af33-2310-4174-8f4d-943bc165fc04 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:16.374241 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085af33-2310-4174-8f4d-943bc165fc04 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:16.374618 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085af33-2310-4174-8f4d-943bc165fc04 None admin] PATH_INFO: `/v3/users/e2c14d578d004e15b160825c91ab523c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:16.375802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7833c49c-07be-4661-b470-4fb61f1e233f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:16.375915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085af33-2310-4174-8f4d-943bc165fc04 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c14d578d004e15b160825c91ab523c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:16.377766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085af33-2310-4174-8f4d-943bc165fc04 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:16.378524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 65/124] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:16 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:16.379515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833c49c-07be-4661-b470-4fb61f1e233f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:16.379627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 60/125] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:16 2022] GET /identity/v3/users/e2c14d578d004e15b160825c91ab523c => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:16.380519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085af33-2310-4174-8f4d-943bc165fc04 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:16.464641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:16.505570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7833c49c-07be-4661-b470-4fb61f1e233f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:16.512330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085af33-2310-4174-8f4d-943bc165fc04 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:16.545175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf42061-fd33-423a-ad83-95b57e043a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:16.545786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf42061-fd33-423a-ad83-95b57e043a3e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:16.546067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf42061-fd33-423a-ad83-95b57e043a3e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:16.546339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf42061-fd33-423a-ad83-95b57e043a3e None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:16.547010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf42061-fd33-423a-ad83-95b57e043a3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:16.547317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf42061-fd33-423a-ad83-95b57e043a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:16.549074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf42061-fd33-423a-ad83-95b57e043a3e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:16.558685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 66/126] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:16.559464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf42061-fd33-423a-ad83-95b57e043a3e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:16.559946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df369-30fa-4509-8cd4-76462e23f8cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:16.560894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df369-30fa-4509-8cd4-76462e23f8cb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:16.561373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df369-30fa-4509-8cd4-76462e23f8cb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:16.561913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7df369-30fa-4509-8cd4-76462e23f8cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:16.577210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7df369-30fa-4509-8cd4-76462e23f8cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-cf7df369-30fa-4509-8cd4-76462e23f8cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:16.584711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:16.585611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:16.586380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 61/127] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:16.587014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df369-30fa-4509-8cd4-76462e23f8cb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:16.617206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:16.690912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7df369-30fa-4509-8cd4-76462e23f8cb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:16.694695 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf42061-fd33-423a-ad83-95b57e043a3e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:16.719689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:16.727386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ceeae-1118-4366-990b-884137ea1b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:16.728013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ceeae-1118-4366-990b-884137ea1b42 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:16.728325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ceeae-1118-4366-990b-884137ea1b42 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:16.728604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9ceeae-1118-4366-990b-884137ea1b42 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:16.729786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ceeae-1118-4366-990b-884137ea1b42 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:16.731246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9ceeae-1118-4366-990b-884137ea1b42 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:16.733203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 62/128] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:16 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:16.733632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ceeae-1118-4366-990b-884137ea1b42 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:16.741829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e625162-3e31-41ba-bcd8-8978b24af1f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:16.742494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e625162-3e31-41ba-bcd8-8978b24af1f8 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:16.742826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e625162-3e31-41ba-bcd8-8978b24af1f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:16.743104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e625162-3e31-41ba-bcd8-8978b24af1f8 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10/users/bbb17726a1af479baade55e03809feea/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:16.745191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e625162-3e31-41ba-bcd8-8978b24af1f8 None admin] RBAC: Authorizing `identity:create_grant(project_id=8940941bf57b4aeeabf404864a2b9d10, user_id=bbb17726a1af479baade55e03809feea, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:16.746902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e625162-3e31-41ba-bcd8-8978b24af1f8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:16.764542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 67/129] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:12:16 2022] PUT /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10/users/bbb17726a1af479baade55e03809feea/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:16.765543 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e625162-3e31-41ba-bcd8-8978b24af1f8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:16.872919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9ceeae-1118-4366-990b-884137ea1b42 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:16.896794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e625162-3e31-41ba-bcd8-8978b24af1f8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:16.898625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:16.921141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b7f6f-c0cb-4c1f-89d0-263af9e9f2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:16.922226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b7f6f-c0cb-4c1f-89d0-263af9e9f2b3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:16.922715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b7f6f-c0cb-4c1f-89d0-263af9e9f2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:16.923194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b7f6f-c0cb-4c1f-89d0-263af9e9f2b3 None admin] PATH_INFO: `/v3/users/e2c14d578d004e15b160825c91ab523c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:16.925985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b7f6f-c0cb-4c1f-89d0-263af9e9f2b3 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c14d578d004e15b160825c91ab523c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:16.928267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b7f6f-c0cb-4c1f-89d0-263af9e9f2b3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:16.930837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 63/130] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:16 2022] GET /identity/v3/users/e2c14d578d004e15b160825c91ab523c => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:16.932104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b7f6f-c0cb-4c1f-89d0-263af9e9f2b3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:16.942745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941af7-c432-46e5-9854-8d8485a9b5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:16.943422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941af7-c432-46e5-9854-8d8485a9b5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:16.943758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941af7-c432-46e5-9854-8d8485a9b5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:16.944042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa941af7-c432-46e5-9854-8d8485a9b5e0 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:16.944767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa941af7-c432-46e5-9854-8d8485a9b5e0 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:16.945077 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa941af7-c432-46e5-9854-8d8485a9b5e0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:16.947212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa941af7-c432-46e5-9854-8d8485a9b5e0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:16.958396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 68/131] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:16.959586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941af7-c432-46e5-9854-8d8485a9b5e0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:17.060341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:17.100041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b7f6f-c0cb-4c1f-89d0-263af9e9f2b3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:17.112682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa941af7-c432-46e5-9854-8d8485a9b5e0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:17.139426 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a0622-e14a-4617-b468-628b337760ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:17.140374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a0622-e14a-4617-b468-628b337760ff None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:17.140795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a0622-e14a-4617-b468-628b337760ff None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:17.141211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525a0622-e14a-4617-b468-628b337760ff None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10/users/e2c14d578d004e15b160825c91ab523c/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:17.143280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a0622-e14a-4617-b468-628b337760ff None admin] RBAC: Authorizing `identity:create_grant(project_id=8940941bf57b4aeeabf404864a2b9d10, user_id=e2c14d578d004e15b160825c91ab523c, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:17.144963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525a0622-e14a-4617-b468-628b337760ff None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:17.160243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 64/132] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:12:16 2022] PUT /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10/users/e2c14d578d004e15b160825c91ab523c/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:17.161556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a0622-e14a-4617-b468-628b337760ff None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:17.192934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586b52d2-d5ea-4c47-947e-e11e82e175dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:17.193621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b52d2-d5ea-4c47-947e-e11e82e175dd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:17.193907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b52d2-d5ea-4c47-947e-e11e82e175dd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:17.194187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586b52d2-d5ea-4c47-947e-e11e82e175dd None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:17.195387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b52d2-d5ea-4c47-947e-e11e82e175dd None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:17.196879 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586b52d2-d5ea-4c47-947e-e11e82e175dd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:17.198539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 69/133] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:16 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:17.199639 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807834b-b1f2-4772-a57c-39eefac19ae0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:17.199927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807834b-b1f2-4772-a57c-39eefac19ae0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:17.200222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807834b-b1f2-4772-a57c-39eefac19ae0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:17.201418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 70/134] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:17 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:17.209209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807834b-b1f2-4772-a57c-39eefac19ae0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:17.277986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525a0622-e14a-4617-b468-628b337760ff None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:17.315506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55074234-d233-4e56-b07c-d6183653f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:17.316186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55074234-d233-4e56-b07c-d6183653f581 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:17.316540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55074234-d233-4e56-b07c-d6183653f581 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:17.316883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55074234-d233-4e56-b07c-d6183653f581 None admin] PATH_INFO: `/v3/users/e2c14d578d004e15b160825c91ab523c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:17.317948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:17.318303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55074234-d233-4e56-b07c-d6183653f581 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c14d578d004e15b160825c91ab523c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:17.319307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:17.322492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55074234-d233-4e56-b07c-d6183653f581 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:17.325280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 65/135] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:17 2022] GET /identity/v3/users/e2c14d578d004e15b160825c91ab523c => generated 275 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:17.326531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b1721-ee1a-4223-89d0-3117968b3c21 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:17.326825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b1721-ee1a-4223-89d0-3117968b3c21 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:17.327110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b1721-ee1a-4223-89d0-3117968b3c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:17.359086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-225b1721-ee1a-4223-89d0-3117968b3c21 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:17.360346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-225b1721-ee1a-4223-89d0-3117968b3c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:17.434602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 66/136] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:17.435582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b1721-ee1a-4223-89d0-3117968b3c21 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:17.461949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807834b-b1f2-4772-a57c-39eefac19ae0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:17.500405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a359f7bd-6498-4a2d-8366-b3a1a29d5bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:17.501166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359f7bd-6498-4a2d-8366-b3a1a29d5bd1 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:17.501508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359f7bd-6498-4a2d-8366-b3a1a29d5bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:17.501788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a359f7bd-6498-4a2d-8366-b3a1a29d5bd1 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10/users/e2c14d578d004e15b160825c91ab523c/roles/4f8d839474214ed89390c34864229684` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:17.504586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359f7bd-6498-4a2d-8366-b3a1a29d5bd1 None admin] RBAC: Authorizing `identity:create_grant(project_id=8940941bf57b4aeeabf404864a2b9d10, user_id=e2c14d578d004e15b160825c91ab523c, role_id=4f8d839474214ed89390c34864229684)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:17.506264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a359f7bd-6498-4a2d-8366-b3a1a29d5bd1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:17.524589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 71/137] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:12:17 2022] PUT /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10/users/e2c14d578d004e15b160825c91ab523c/roles/4f8d839474214ed89390c34864229684 => generated 0 bytes in 316 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:17.526028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742109-1ffe-45ce-902c-4c1274746350 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:17.526317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742109-1ffe-45ce-902c-4c1274746350 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:17.526591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a742109-1ffe-45ce-902c-4c1274746350 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:17.528394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 72/138] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:17.533883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d854e-644b-45a3-ad09-e65117fda689 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:17.534222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d854e-644b-45a3-ad09-e65117fda689 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:17.534560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183d854e-644b-45a3-ad09-e65117fda689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:17.562248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b1721-ee1a-4223-89d0-3117968b3c21 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:17.567490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-183d854e-644b-45a3-ad09-e65117fda689 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:17.568770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-183d854e-644b-45a3-ad09-e65117fda689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:17.590329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:17.602566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c7763-af62-4b5a-aa35-79c8ba3fa001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:17.603229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c7763-af62-4b5a-aa35-79c8ba3fa001 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:17.603516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c7763-af62-4b5a-aa35-79c8ba3fa001 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:17.603791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f17c7763-af62-4b5a-aa35-79c8ba3fa001 None admin] PATH_INFO: `/v3/projects/d85b7bc02b834f1998e39bf40140568c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:17.605060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c7763-af62-4b5a-aa35-79c8ba3fa001 None admin] RBAC: Authorizing `identity:get_project(project_id=d85b7bc02b834f1998e39bf40140568c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:17.606709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f17c7763-af62-4b5a-aa35-79c8ba3fa001 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:17.608733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 67/139] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:17 2022] GET /identity/v3/projects/d85b7bc02b834f1998e39bf40140568c => generated 312 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:17.614240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c7763-af62-4b5a-aa35-79c8ba3fa001 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:17.694774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 73/140] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Sep 24 14:12:17.753493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f17c7763-af62-4b5a-aa35-79c8ba3fa001 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:17.797579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812e453-65d9-4143-b25b-918c678441fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:17.798256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812e453-65d9-4143-b25b-918c678441fd None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:17.798538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812e453-65d9-4143-b25b-918c678441fd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:17.798817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e812e453-65d9-4143-b25b-918c678441fd None admin] PATH_INFO: `/v3/projects/d85b7bc02b834f1998e39bf40140568c/users/e2c14d578d004e15b160825c91ab523c/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:17.801312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812e453-65d9-4143-b25b-918c678441fd None admin] RBAC: Authorizing `identity:create_grant(project_id=d85b7bc02b834f1998e39bf40140568c, user_id=e2c14d578d004e15b160825c91ab523c, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:17.802766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e812e453-65d9-4143-b25b-918c678441fd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:17.829923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 68/141] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:12:17 2022] PUT /identity/v3/projects/d85b7bc02b834f1998e39bf40140568c/users/e2c14d578d004e15b160825c91ab523c/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:12:17.872685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d854e-644b-45a3-ad09-e65117fda689 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:17.901625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:17.994073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183d854e-644b-45a3-ad09-e65117fda689 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:18.034161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17d1dd-f760-404c-8a7b-f4e8f708af75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:18.034817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17d1dd-f760-404c-8a7b-f4e8f708af75 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:18.035100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17d1dd-f760-404c-8a7b-f4e8f708af75 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:18.035376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c17d1dd-f760-404c-8a7b-f4e8f708af75 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:18.036602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17d1dd-f760-404c-8a7b-f4e8f708af75 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:18.038062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c17d1dd-f760-404c-8a7b-f4e8f708af75 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:18.039668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 74/142] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:18.049855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812e453-65d9-4143-b25b-918c678441fd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:18.096874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17d1dd-f760-404c-8a7b-f4e8f708af75 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:18.125610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:18.185087 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e812e453-65d9-4143-b25b-918c678441fd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:18.212079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:18.223919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c17d1dd-f760-404c-8a7b-f4e8f708af75 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:18.229503 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7a981-ad80-4b2b-a6fa-bf109f454747 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:18.230130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7a981-ad80-4b2b-a6fa-bf109f454747 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:18.230416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7a981-ad80-4b2b-a6fa-bf109f454747 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:18.230706 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa7a981-ad80-4b2b-a6fa-bf109f454747 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:18.231365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7a981-ad80-4b2b-a6fa-bf109f454747 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:18.232861 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa7a981-ad80-4b2b-a6fa-bf109f454747 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:18.263695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 69/143] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:12:18 2022] POST /identity/v3/users => generated 283 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:18.282953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339f061-b215-4f23-ae29-728465341d0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:18.283634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339f061-b215-4f23-ae29-728465341d0b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:18.283930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339f061-b215-4f23-ae29-728465341d0b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:18.284221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339f061-b215-4f23-ae29-728465341d0b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:18.304777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339f061-b215-4f23-ae29-728465341d0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4339f061-b215-4f23-ae29-728465341d0b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:18.310109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:18.311113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:18.312108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 75/144] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:18.317901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7a981-ad80-4b2b-a6fa-bf109f454747 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:18.456833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa7a981-ad80-4b2b-a6fa-bf109f454747 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:18.469438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:18.511468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaf6ac-1deb-46f7-95f2-479715efa256 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:18.512098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaf6ac-1deb-46f7-95f2-479715efa256 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:18.512402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaf6ac-1deb-46f7-95f2-479715efa256 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:18.512668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acaaf6ac-1deb-46f7-95f2-479715efa256 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:18.513346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaf6ac-1deb-46f7-95f2-479715efa256 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:18.513650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaf6ac-1deb-46f7-95f2-479715efa256 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:18.515097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acaaf6ac-1deb-46f7-95f2-479715efa256 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:18.525054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 70/145] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:18.530177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339f061-b215-4f23-ae29-728465341d0b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:18.670098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339f061-b215-4f23-ae29-728465341d0b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:18.714980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4b29c-b0a4-481b-8a45-87fc7ba50c00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:18.715545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4b29c-b0a4-481b-8a45-87fc7ba50c00 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:18.715827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4b29c-b0a4-481b-8a45-87fc7ba50c00 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:18.716099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa4b29c-b0a4-481b-8a45-87fc7ba50c00 None admin] PATH_INFO: `/v3/users/afc4ac4a9b9e4cd9b877206a353431b0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:18.717275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4b29c-b0a4-481b-8a45-87fc7ba50c00 None admin] RBAC: Authorizing `identity:get_user(user_id=afc4ac4a9b9e4cd9b877206a353431b0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:18.718731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa4b29c-b0a4-481b-8a45-87fc7ba50c00 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:18.720627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 76/146] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:18 2022] GET /identity/v3/users/afc4ac4a9b9e4cd9b877206a353431b0 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:18.726620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaf6ac-1deb-46f7-95f2-479715efa256 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:18.846355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acaaf6ac-1deb-46f7-95f2-479715efa256 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:18.889949 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b093-25a7-49d5-8620-0350b064e795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:18.890577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b093-25a7-49d5-8620-0350b064e795 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:18.890862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b093-25a7-49d5-8620-0350b064e795 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:18.891135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b093-25a7-49d5-8620-0350b064e795 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:18.892292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16b093-25a7-49d5-8620-0350b064e795 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:18.893787 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16b093-25a7-49d5-8620-0350b064e795 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:18.895401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 71/147] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:18 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:18.902813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4b29c-b0a4-481b-8a45-87fc7ba50c00 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:18.936592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:19.045820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa4b29c-b0a4-481b-8a45-87fc7ba50c00 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:19.092350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cac8015c-fa13-4b5b-97ee-6d35cb5e3ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:19.093338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8015c-fa13-4b5b-97ee-6d35cb5e3ca9 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:19.093788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8015c-fa13-4b5b-97ee-6d35cb5e3ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:19.094228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac8015c-fa13-4b5b-97ee-6d35cb5e3ca9 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10/users/afc4ac4a9b9e4cd9b877206a353431b0/roles/80d4b3d42e60434b9994c77552e21e75` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:19.101485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8015c-fa13-4b5b-97ee-6d35cb5e3ca9 None admin] RBAC: Authorizing `identity:create_grant(project_id=8940941bf57b4aeeabf404864a2b9d10, user_id=afc4ac4a9b9e4cd9b877206a353431b0, role_id=80d4b3d42e60434b9994c77552e21e75)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:19.103174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cac8015c-fa13-4b5b-97ee-6d35cb5e3ca9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:19.125998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 77/148] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:12:18 2022] PUT /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10/users/afc4ac4a9b9e4cd9b877206a353431b0/roles/80d4b3d42e60434b9994c77552e21e75 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:19.747187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43149928-c794-4df9-b6e3-d10dc52f6c5d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:19.748172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43149928-c794-4df9-b6e3-d10dc52f6c5d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:19.748694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43149928-c794-4df9-b6e3-d10dc52f6c5d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:19.750238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 72/149] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:19.756373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bf3a0-8f4c-4c46-99aa-2276bb28d7b3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:19.757228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bf3a0-8f4c-4c46-99aa-2276bb28d7b3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:19.757701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11bf3a0-8f4c-4c46-99aa-2276bb28d7b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:19.781437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a11bf3a0-8f4c-4c46-99aa-2276bb28d7b3 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:19.783021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a11bf3a0-8f4c-4c46-99aa-2276bb28d7b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:19.867607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 78/150] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:20.227176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43149928-c794-4df9-b6e3-d10dc52f6c5d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:20.271795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:20.351299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43149928-c794-4df9-b6e3-d10dc52f6c5d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:20.391028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d932ffa-d813-472e-86ec-f83bff914d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:20.391666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d932ffa-d813-472e-86ec-f83bff914d68 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:20.391947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d932ffa-d813-472e-86ec-f83bff914d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:20.392248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d932ffa-d813-472e-86ec-f83bff914d68 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:20.410616 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d932ffa-d813-472e-86ec-f83bff914d68 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5d932ffa-d813-472e-86ec-f83bff914d68 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:20.415494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:20.416375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:20.417571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 73/151] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:12:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:20.422742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bf3a0-8f4c-4c46-99aa-2276bb28d7b3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:20.440488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:20.563121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11bf3a0-8f4c-4c46-99aa-2276bb28d7b3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:20.607776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791772e0-abac-4257-bed1-ebc3c5fc226e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:20.608751 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791772e0-abac-4257-bed1-ebc3c5fc226e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:20.609229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791772e0-abac-4257-bed1-ebc3c5fc226e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:20.609700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791772e0-abac-4257-bed1-ebc3c5fc226e None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:20.610580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791772e0-abac-4257-bed1-ebc3c5fc226e None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:20.611079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791772e0-abac-4257-bed1-ebc3c5fc226e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:20.612717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-791772e0-abac-4257-bed1-ebc3c5fc226e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:20.621680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 79/152] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:20.628128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d932ffa-d813-472e-86ec-f83bff914d68 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:20.740732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:20.745452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d932ffa-d813-472e-86ec-f83bff914d68 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:20.781653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee75a8-6ea1-4c05-ba3b-1954ab16c2b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:20.782388 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee75a8-6ea1-4c05-ba3b-1954ab16c2b1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:20.782569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee75a8-6ea1-4c05-ba3b-1954ab16c2b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:20.782845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aee75a8-6ea1-4c05-ba3b-1954ab16c2b1 None admin] PATH_INFO: `/v3/users/bbb17726a1af479baade55e03809feea` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:20.784024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee75a8-6ea1-4c05-ba3b-1954ab16c2b1 None admin] RBAC: Authorizing `identity:get_user(user_id=bbb17726a1af479baade55e03809feea)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:20.785527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aee75a8-6ea1-4c05-ba3b-1954ab16c2b1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:20.787109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 74/153] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:20 2022] GET /identity/v3/users/bbb17726a1af479baade55e03809feea => generated 247 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:20.792616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791772e0-abac-4257-bed1-ebc3c5fc226e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:20.867690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:20.901048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791772e0-abac-4257-bed1-ebc3c5fc226e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:20.946758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1822724-2299-4a14-b164-5a321a4b54ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:20.947398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1822724-2299-4a14-b164-5a321a4b54ab None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:20.947677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1822724-2299-4a14-b164-5a321a4b54ab None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:20.947948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1822724-2299-4a14-b164-5a321a4b54ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:21.041658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1822724-2299-4a14-b164-5a321a4b54ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:21.043149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1822724-2299-4a14-b164-5a321a4b54ab None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:21.113957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:21.147088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 80/154] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:21.152684 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee75a8-6ea1-4c05-ba3b-1954ab16c2b1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:21.167467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884218f-701c-4737-ab22-400189316176 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:21.167755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884218f-701c-4737-ab22-400189316176 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:21.168021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3884218f-701c-4737-ab22-400189316176 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:21.169511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 81/155] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:21.181818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34a834-1b5e-4c6e-98c9-b0fe05099ef1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:21.182118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34a834-1b5e-4c6e-98c9-b0fe05099ef1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:21.182367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b34a834-1b5e-4c6e-98c9-b0fe05099ef1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:21.211799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6b34a834-1b5e-4c6e-98c9-b0fe05099ef1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:21.213019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6b34a834-1b5e-4c6e-98c9-b0fe05099ef1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:21.335622 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aee75a8-6ea1-4c05-ba3b-1954ab16c2b1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:21.376626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 82/156] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:21.378028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51307e-d46a-4fdf-828f-36bf733742bd None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:21.378449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51307e-d46a-4fdf-828f-36bf733742bd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:21.378727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e51307e-d46a-4fdf-828f-36bf733742bd None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:21.380041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 83/157] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:21.385555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52469fb0-b7eb-4f12-8c52-f73f1f331733 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:21.385835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52469fb0-b7eb-4f12-8c52-f73f1f331733 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:21.386112 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52469fb0-b7eb-4f12-8c52-f73f1f331733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:21.409504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766039b-c2ad-4dfb-a8b8-e359c298991c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:21.410320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766039b-c2ad-4dfb-a8b8-e359c298991c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:21.410609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766039b-c2ad-4dfb-a8b8-e359c298991c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:21.411020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7766039b-c2ad-4dfb-a8b8-e359c298991c None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:21.415541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-52469fb0-b7eb-4f12-8c52-f73f1f331733 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:21.416870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766039b-c2ad-4dfb-a8b8-e359c298991c None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:21.418356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7766039b-c2ad-4dfb-a8b8-e359c298991c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:21.418919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-52469fb0-b7eb-4f12-8c52-f73f1f331733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:21.420330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 75/158] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:21 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:21.427235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766039b-c2ad-4dfb-a8b8-e359c298991c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:21.491427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:21.568370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7766039b-c2ad-4dfb-a8b8-e359c298991c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:21.586059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 84/159] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:21.605007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70581ef4-df99-460b-be25-6a1f9e5e4f11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:21.605614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70581ef4-df99-460b-be25-6a1f9e5e4f11 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:21.605892 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70581ef4-df99-460b-be25-6a1f9e5e4f11 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:21.606165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70581ef4-df99-460b-be25-6a1f9e5e4f11 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:21.606901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70581ef4-df99-460b-be25-6a1f9e5e4f11 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=8940941bf57b4aeeabf404864a2b9d10, user.id=bbb17726a1af479baade55e03809feea) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:21.607210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70581ef4-df99-460b-be25-6a1f9e5e4f11 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:21.608686 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70581ef4-df99-460b-be25-6a1f9e5e4f11 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:21.615679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 76/160] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:21 2022] GET /identity/v3/role_assignments?user.id=bbb17726a1af479baade55e03809feea&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 608 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:21.924070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52469fb0-b7eb-4f12-8c52-f73f1f331733 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:21.962039 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:22.040432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52469fb0-b7eb-4f12-8c52-f73f1f331733 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:22.079016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d54b6f6-cd5e-47aa-91b3-2da6158b28fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:22.079716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54b6f6-cd5e-47aa-91b3-2da6158b28fe None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:22.080059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54b6f6-cd5e-47aa-91b3-2da6158b28fe None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:22.080426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d54b6f6-cd5e-47aa-91b3-2da6158b28fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:22.091396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d54b6f6-cd5e-47aa-91b3-2da6158b28fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4d54b6f6-cd5e-47aa-91b3-2da6158b28fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:22.096885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:22.097854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:22.098668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 85/161] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:21 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:22.105723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70581ef4-df99-460b-be25-6a1f9e5e4f11 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:22.183692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857ed5-3973-457f-88d4-5716ad76fa20 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:22.183995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857ed5-3973-457f-88d4-5716ad76fa20 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:22.184202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db857ed5-3973-457f-88d4-5716ad76fa20 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:22.186414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 86/162] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:22 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:22.191734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e5770-e88f-4d77-ba39-08450fae0ab3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:22.192026 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e5770-e88f-4d77-ba39-08450fae0ab3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:22.192349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-923e5770-e88f-4d77-ba39-08450fae0ab3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:22.233537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-923e5770-e88f-4d77-ba39-08450fae0ab3 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:22.234433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-923e5770-e88f-4d77-ba39-08450fae0ab3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:22.252737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:22.263253 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70581ef4-df99-460b-be25-6a1f9e5e4f11 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:22.319324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5c80-8568-4d01-b3f5-a22a99fc60cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:22.320314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5c80-8568-4d01-b3f5-a22a99fc60cc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:22.320811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5c80-8568-4d01-b3f5-a22a99fc60cc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:22.321332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8b5c80-8568-4d01-b3f5-a22a99fc60cc None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:22.322205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b5c80-8568-4d01-b3f5-a22a99fc60cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:22.322714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b5c80-8568-4d01-b3f5-a22a99fc60cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:22.324597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8b5c80-8568-4d01-b3f5-a22a99fc60cc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:22.337159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 77/163] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:22.344624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5c80-8568-4d01-b3f5-a22a99fc60cc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:22.468139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 87/164] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:22.471471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e5770-e88f-4d77-ba39-08450fae0ab3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:22.512545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:22.533492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8b5c80-8568-4d01-b3f5-a22a99fc60cc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:22.620871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011db1b-7f76-4a48-8132-66915bf88ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:22.621527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011db1b-7f76-4a48-8132-66915bf88ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:22.621811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011db1b-7f76-4a48-8132-66915bf88ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:22.622090 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4011db1b-7f76-4a48-8132-66915bf88ff7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:22.645004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4011db1b-7f76-4a48-8132-66915bf88ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4011db1b-7f76-4a48-8132-66915bf88ff7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:22.659428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:22.660425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:22.661217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:22.664591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 78/165] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:22.669529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011db1b-7f76-4a48-8132-66915bf88ff7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:22.712134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:22.718244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-923e5770-e88f-4d77-ba39-08450fae0ab3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:22.783986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cedf656-65d1-40bd-8b46-193f943c5843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:22.784699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedf656-65d1-40bd-8b46-193f943c5843 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:22.784988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedf656-65d1-40bd-8b46-193f943c5843 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:22.785269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cedf656-65d1-40bd-8b46-193f943c5843 None admin] PATH_INFO: `/v3/users/e2c14d578d004e15b160825c91ab523c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:22.786418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedf656-65d1-40bd-8b46-193f943c5843 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c14d578d004e15b160825c91ab523c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:22.787864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cedf656-65d1-40bd-8b46-193f943c5843 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:22.789478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 88/166] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:22 2022] GET /identity/v3/users/e2c14d578d004e15b160825c91ab523c => generated 275 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:22.795120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c42e7-708e-4678-b525-db97d2932e53 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:22.795410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c42e7-708e-4678-b525-db97d2932e53 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:22.795691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2c42e7-708e-4678-b525-db97d2932e53 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:22.797222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 89/167] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:22 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:22.799540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c42e7-708e-4678-b525-db97d2932e53 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:22.860825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4011db1b-7f76-4a48-8132-66915bf88ff7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:22.932008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c785c9c-6e11-43d6-a835-416e6fb0d475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:22.934178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c785c9c-6e11-43d6-a835-416e6fb0d475 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:22.934178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c785c9c-6e11-43d6-a835-416e6fb0d475 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:22.934178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c785c9c-6e11-43d6-a835-416e6fb0d475 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:22.934178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c785c9c-6e11-43d6-a835-416e6fb0d475 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:22.934632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c785c9c-6e11-43d6-a835-416e6fb0d475 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:22.940185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c785c9c-6e11-43d6-a835-416e6fb0d475 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:22.946108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 79/168] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:22.947693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898e8a-a929-4f19-8461-8d8e487fc62d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:22.947981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898e8a-a929-4f19-8461-8d8e487fc62d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:22.952559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5898e8a-a929-4f19-8461-8d8e487fc62d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:22.964557 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:22.977277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c5898e8a-a929-4f19-8461-8d8e487fc62d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:22.980550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c5898e8a-a929-4f19-8461-8d8e487fc62d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:22.990526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2c42e7-708e-4678-b525-db97d2932e53 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:23.030593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17692063-43e6-4ec3-b2f9-6e53b275c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:23.031672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17692063-43e6-4ec3-b2f9-6e53b275c5ca None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:23.032078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17692063-43e6-4ec3-b2f9-6e53b275c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:23.032523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17692063-43e6-4ec3-b2f9-6e53b275c5ca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:23.052890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 80/169] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:23.053835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5898e8a-a929-4f19-8461-8d8e487fc62d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:23.068508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:23.109791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17692063-43e6-4ec3-b2f9-6e53b275c5ca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:23.112204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17692063-43e6-4ec3-b2f9-6e53b275c5ca None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:23.187915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5898e8a-a929-4f19-8461-8d8e487fc62d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:23.227027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:23.241541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 90/170] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:23.242556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17692063-43e6-4ec3-b2f9-6e53b275c5ca None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:23.247655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05da46-99c5-4872-9847-862ea7e98d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:23.248542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05da46-99c5-4872-9847-862ea7e98d80 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:23.248984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05da46-99c5-4872-9847-862ea7e98d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:23.249457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05da46-99c5-4872-9847-862ea7e98d80 None admin] PATH_INFO: `/v3/users/e2c14d578d004e15b160825c91ab523c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:23.250753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05da46-99c5-4872-9847-862ea7e98d80 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c14d578d004e15b160825c91ab523c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:23.260576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05da46-99c5-4872-9847-862ea7e98d80 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:23.262504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 81/171] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:23 2022] GET /identity/v3/users/e2c14d578d004e15b160825c91ab523c => generated 275 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:23.263410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05da46-99c5-4872-9847-862ea7e98d80 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:23.357876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17692063-43e6-4ec3-b2f9-6e53b275c5ca None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:23.400277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0af3d-f865-4d33-8189-b9c95f923760 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:23.400914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0af3d-f865-4d33-8189-b9c95f923760 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:23.401195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0af3d-f865-4d33-8189-b9c95f923760 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:23.401470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba0af3d-f865-4d33-8189-b9c95f923760 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:23.410740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:23.424452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba0af3d-f865-4d33-8189-b9c95f923760 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4ba0af3d-f865-4d33-8189-b9c95f923760 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:23.430348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:23.431231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:23.432083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 91/172] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:23 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:23.440263 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0af3d-f865-4d33-8189-b9c95f923760 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:23.449021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05da46-99c5-4872-9847-862ea7e98d80 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:23.519693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b885830-2ac9-41ad-abaf-fb20af4c8565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:23.521002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885830-2ac9-41ad-abaf-fb20af4c8565 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:23.521452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885830-2ac9-41ad-abaf-fb20af4c8565 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:23.522015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b885830-2ac9-41ad-abaf-fb20af4c8565 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:23.523486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b885830-2ac9-41ad-abaf-fb20af4c8565 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:23.525434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b885830-2ac9-41ad-abaf-fb20af4c8565 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:23.527784 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 82/173] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:23 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:23.528895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b885830-2ac9-41ad-abaf-fb20af4c8565 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:23.579019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:23.639522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba0af3d-f865-4d33-8189-b9c95f923760 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:23.652629 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b885830-2ac9-41ad-abaf-fb20af4c8565 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:23.677782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c5e8b1-db43-4d00-8f81-0bfac90941fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:23.678683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5e8b1-db43-4d00-8f81-0bfac90941fc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:23.678964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5e8b1-db43-4d00-8f81-0bfac90941fc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:23.679235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c5e8b1-db43-4d00-8f81-0bfac90941fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:23.691512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e44f5-83f5-4e1c-b3d2-4f71a1374aff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:23.692282 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e44f5-83f5-4e1c-b3d2-4f71a1374aff None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:23.692626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e44f5-83f5-4e1c-b3d2-4f71a1374aff None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:23.692967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8e44f5-83f5-4e1c-b3d2-4f71a1374aff None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:23.693718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e44f5-83f5-4e1c-b3d2-4f71a1374aff None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:23.694089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e44f5-83f5-4e1c-b3d2-4f71a1374aff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:23.695850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e8e44f5-83f5-4e1c-b3d2-4f71a1374aff None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:23.714392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 83/174] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:23 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:23.715174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e44f5-83f5-4e1c-b3d2-4f71a1374aff None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:23.733825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:23.778865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5e8b1-db43-4d00-8f81-0bfac90941fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:23.781599 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c5e8b1-db43-4d00-8f81-0bfac90941fc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:23.838653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:23.846714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e8e44f5-83f5-4e1c-b3d2-4f71a1374aff None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:23.882670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fceac4-f188-49b3-a566-83fd645b7626 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:23.883551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fceac4-f188-49b3-a566-83fd645b7626 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:23.883833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fceac4-f188-49b3-a566-83fd645b7626 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:23.884109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fceac4-f188-49b3-a566-83fd645b7626 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:23.885029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fceac4-f188-49b3-a566-83fd645b7626 None admin] RBAC: Adding query filter params (role.id=a4c95292940e4d359d48ad72b390ece0, scope.project.id=8940941bf57b4aeeabf404864a2b9d10, user.id=e2c14d578d004e15b160825c91ab523c) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:23.885652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fceac4-f188-49b3-a566-83fd645b7626 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:23.887565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fceac4-f188-49b3-a566-83fd645b7626 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:23.900190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 84/175] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:23 2022] GET /identity/v3/role_assignments?user.id=e2c14d578d004e15b160825c91ab523c&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:23.900369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 92/176] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:23.900474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fceac4-f188-49b3-a566-83fd645b7626 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:23.904229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196d8cb-4602-4293-bc72-3f44ce183683 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:23.904229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196d8cb-4602-4293-bc72-3f44ce183683 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:23.904229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4196d8cb-4602-4293-bc72-3f44ce183683 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:23.904229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 93/177] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:23 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:23.904229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196d8cb-4602-4293-bc72-3f44ce183683 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:24.003348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:24.040395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fceac4-f188-49b3-a566-83fd645b7626 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:24.040888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4196d8cb-4602-4293-bc72-3f44ce183683 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:24.084315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b29db6-4141-415f-a78a-7aa6a06b9cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:24.084951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29db6-4141-415f-a78a-7aa6a06b9cdb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.085221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29db6-4141-415f-a78a-7aa6a06b9cdb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.085494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b29db6-4141-415f-a78a-7aa6a06b9cdb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.087718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b2e60c-cd3c-47a6-9bba-e2f9fb9abd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:24.088859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2e60c-cd3c-47a6-9bba-e2f9fb9abd33 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.089702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2e60c-cd3c-47a6-9bba-e2f9fb9abd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.090169 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b2e60c-cd3c-47a6-9bba-e2f9fb9abd33 None admin] PATH_INFO: `/v3/users/e2c14d578d004e15b160825c91ab523c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.092944 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2e60c-cd3c-47a6-9bba-e2f9fb9abd33 None admin] RBAC: Authorizing `identity:get_user(user_id=e2c14d578d004e15b160825c91ab523c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:24.094400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b2e60c-cd3c-47a6-9bba-e2f9fb9abd33 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:24.096577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 94/178] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:23 2022] GET /identity/v3/users/e2c14d578d004e15b160825c91ab523c => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:24.097791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a592e29-40c3-4456-8601-d1b85780076b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.098141 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a592e29-40c3-4456-8601-d1b85780076b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.098414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a592e29-40c3-4456-8601-d1b85780076b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.100325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 95/179] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:24.101344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a592e29-40c3-4456-8601-d1b85780076b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:24.108923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b29db6-4141-415f-a78a-7aa6a06b9cdb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-71b29db6-4141-415f-a78a-7aa6a06b9cdb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:24.115161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:24.116108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:24.116968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 85/180] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:12:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:24.118448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e65c7-f602-4d5b-a64d-0b079646deed None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.118448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e65c7-f602-4d5b-a64d-0b079646deed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.118448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169e65c7-f602-4d5b-a64d-0b079646deed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.136618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:24.147400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-169e65c7-f602-4d5b-a64d-0b079646deed None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:24.148555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-169e65c7-f602-4d5b-a64d-0b079646deed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:24.231395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 86/181] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:24.233493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae75e8-b3e2-422b-8822-76e80d703dcd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.233775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae75e8-b3e2-422b-8822-76e80d703dcd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.234044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fae75e8-b3e2-422b-8822-76e80d703dcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.251923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2fae75e8-b3e2-422b-8822-76e80d703dcd None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:24.253700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2fae75e8-b3e2-422b-8822-76e80d703dcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:24.254319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a592e29-40c3-4456-8601-d1b85780076b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:24.291475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaab53f-8f41-460f-92a3-7b16645c5324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:24.292028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaab53f-8f41-460f-92a3-7b16645c5324 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.292332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaab53f-8f41-460f-92a3-7b16645c5324 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.292606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaab53f-8f41-460f-92a3-7b16645c5324 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.293715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaab53f-8f41-460f-92a3-7b16645c5324 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:24.295151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbaab53f-8f41-460f-92a3-7b16645c5324 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:24.296803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 96/182] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:24 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:24.297565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaab53f-8f41-460f-92a3-7b16645c5324 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:24.319645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:24.329444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 87/183] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:24.330281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae75e8-b3e2-422b-8822-76e80d703dcd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:24.403947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:24.423540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaab53f-8f41-460f-92a3-7b16645c5324 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:24.428533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fae75e8-b3e2-422b-8822-76e80d703dcd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:24.462389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac38ad3-1246-45e0-bc39-a87270ba570b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:24.463035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a83e2-c2dc-4285-aa36-48151037d61c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:24.463232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38ad3-1246-45e0-bc39-a87270ba570b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.463611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38ad3-1246-45e0-bc39-a87270ba570b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.463982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac38ad3-1246-45e0-bc39-a87270ba570b None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.464277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a83e2-c2dc-4285-aa36-48151037d61c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.464700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a83e2-c2dc-4285-aa36-48151037d61c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.464987 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac38ad3-1246-45e0-bc39-a87270ba570b None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:24.465272 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6a83e2-c2dc-4285-aa36-48151037d61c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.465470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac38ad3-1246-45e0-bc39-a87270ba570b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:24.466942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac38ad3-1246-45e0-bc39-a87270ba570b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:24.485796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 88/184] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:24 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:24.488063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aace1b-afe7-4b43-ae11-0495628bf7e5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.488633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aace1b-afe7-4b43-ae11-0495628bf7e5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.489207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61aace1b-afe7-4b43-ae11-0495628bf7e5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.491341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 89/185] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:24.495512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aace1b-afe7-4b43-ae11-0495628bf7e5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:24.549681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a83e2-c2dc-4285-aa36-48151037d61c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:24.551090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6a83e2-c2dc-4285-aa36-48151037d61c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:24.553005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:24.601905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61aace1b-afe7-4b43-ae11-0495628bf7e5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:24.634624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bedda-3087-487e-b08c-794051b6f204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:24.635220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bedda-3087-487e-b08c-794051b6f204 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.635498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bedda-3087-487e-b08c-794051b6f204 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.635767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33bedda-3087-487e-b08c-794051b6f204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.636510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bedda-3087-487e-b08c-794051b6f204 None admin] RBAC: Adding query filter params (role.id=4f8d839474214ed89390c34864229684, scope.project.id=8940941bf57b4aeeabf404864a2b9d10, user.id=e2c14d578d004e15b160825c91ab523c) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:24.636816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bedda-3087-487e-b08c-794051b6f204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:24.638243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33bedda-3087-487e-b08c-794051b6f204 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:24.641114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:24.644901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 90/186] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:24 2022] GET /identity/v3/role_assignments?user.id=e2c14d578d004e15b160825c91ab523c&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=4f8d839474214ed89390c34864229684 => generated 608 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:24.644901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bedda-3087-487e-b08c-794051b6f204 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:24.664789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 97/187] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:24.665590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a83e2-c2dc-4285-aa36-48151037d61c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:24.761618 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33bedda-3087-487e-b08c-794051b6f204 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:24.780304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6a83e2-c2dc-4285-aa36-48151037d61c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:24.783900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:24.802203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1323cb13-4ee6-43f9-a84c-4fe927401448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:24.803692 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323cb13-4ee6-43f9-a84c-4fe927401448 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.804349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323cb13-4ee6-43f9-a84c-4fe927401448 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.804931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1323cb13-4ee6-43f9-a84c-4fe927401448 None admin] PATH_INFO: `/v3/users/c55c4f82db86429faf3b3807a6cbe819` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.818059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2bec3-86cd-43a6-9a9b-6f7f86956447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:24.818694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2bec3-86cd-43a6-9a9b-6f7f86956447 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.818970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2bec3-86cd-43a6-9a9b-6f7f86956447 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.819246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a2bec3-86cd-43a6-9a9b-6f7f86956447 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.822019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323cb13-4ee6-43f9-a84c-4fe927401448 None admin] RBAC: Authorizing `identity:get_user(user_id=c55c4f82db86429faf3b3807a6cbe819)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:24.823496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1323cb13-4ee6-43f9-a84c-4fe927401448 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:24.825195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 91/188] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:24 2022] GET /identity/v3/users/c55c4f82db86429faf3b3807a6cbe819 => generated 283 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:24.826416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d6e3-f214-4628-800e-b2e40e07aaac None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.826700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d6e3-f214-4628-800e-b2e40e07aaac None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.826994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c2d6e3-f214-4628-800e-b2e40e07aaac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:24.831197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a2bec3-86cd-43a6-9a9b-6f7f86956447 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-55a2bec3-86cd-43a6-9a9b-6f7f86956447 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:24.836089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:24.837028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:24.837824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:24.838430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 98/189] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:24.838873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2bec3-86cd-43a6-9a9b-6f7f86956447 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:24.849219 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-09c2d6e3-f214-4628-800e-b2e40e07aaac None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:24.850677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-09c2d6e3-f214-4628-800e-b2e40e07aaac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:24.892396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:24.926916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 92/190] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:24.936354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2d6e3-f214-4628-800e-b2e40e07aaac None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:24.960616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a2bec3-86cd-43a6-9a9b-6f7f86956447 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:24.995308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980bc27-2d68-4ae5-9a2f-94cb7d967a21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:24.995940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bc27-2d68-4ae5-9a2f-94cb7d967a21 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:24.996253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bc27-2d68-4ae5-9a2f-94cb7d967a21 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:24.996533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c980bc27-2d68-4ae5-9a2f-94cb7d967a21 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.007565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c980bc27-2d68-4ae5-9a2f-94cb7d967a21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c980bc27-2d68-4ae5-9a2f-94cb7d967a21 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:25.012409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:25.013471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 99/191] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:25.014276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980bc27-2d68-4ae5-9a2f-94cb7d967a21 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.041976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c2d6e3-f214-4628-800e-b2e40e07aaac None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.053486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:25.081379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37bc68-f569-4940-8c4d-eee99b01b5cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.082010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37bc68-f569-4940-8c4d-eee99b01b5cf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.082286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37bc68-f569-4940-8c4d-eee99b01b5cf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.082558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd37bc68-f569-4940-8c4d-eee99b01b5cf None admin] PATH_INFO: `/v3/projects/d85b7bc02b834f1998e39bf40140568c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.083665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37bc68-f569-4940-8c4d-eee99b01b5cf None admin] RBAC: Authorizing `identity:get_project(project_id=d85b7bc02b834f1998e39bf40140568c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:25.085131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd37bc68-f569-4940-8c4d-eee99b01b5cf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:25.086730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 93/192] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:24 2022] GET /identity/v3/projects/d85b7bc02b834f1998e39bf40140568c => generated 312 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:25.087478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37bc68-f569-4940-8c4d-eee99b01b5cf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.127366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c980bc27-2d68-4ae5-9a2f-94cb7d967a21 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.131251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:25.165409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d743d6-1dac-4303-804f-7fb2b1916db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.166032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d743d6-1dac-4303-804f-7fb2b1916db6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.166302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d743d6-1dac-4303-804f-7fb2b1916db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.166579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d743d6-1dac-4303-804f-7fb2b1916db6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.199791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd37bc68-f569-4940-8c4d-eee99b01b5cf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.234244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a0250-9d16-431a-ba81-e9542836520f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.234852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a0250-9d16-431a-ba81-e9542836520f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.235098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a0250-9d16-431a-ba81-e9542836520f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.235364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8a0250-9d16-431a-ba81-e9542836520f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.236010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a0250-9d16-431a-ba81-e9542836520f None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:25.236336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a0250-9d16-431a-ba81-e9542836520f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:25.237736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8a0250-9d16-431a-ba81-e9542836520f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:25.239360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d743d6-1dac-4303-804f-7fb2b1916db6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:25.240854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d743d6-1dac-4303-804f-7fb2b1916db6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:25.245769 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 94/193] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:25 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:25.246534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a0250-9d16-431a-ba81-e9542836520f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.284647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:25.339512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 100/194] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:25.340294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d743d6-1dac-4303-804f-7fb2b1916db6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.343262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:25.348505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8a0250-9d16-431a-ba81-e9542836520f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.381956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91ff4d-f81f-4428-9360-98e1a7c16132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.382561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91ff4d-f81f-4428-9360-98e1a7c16132 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.382843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91ff4d-f81f-4428-9360-98e1a7c16132 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.383117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d91ff4d-f81f-4428-9360-98e1a7c16132 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.383776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91ff4d-f81f-4428-9360-98e1a7c16132 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:25.384083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91ff4d-f81f-4428-9360-98e1a7c16132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:25.385495 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d91ff4d-f81f-4428-9360-98e1a7c16132 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:25.394168 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 95/195] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:25.398887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91ff4d-f81f-4428-9360-98e1a7c16132 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.445705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d743d6-1dac-4303-804f-7fb2b1916db6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.479957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3f44c-25e3-4cde-b8c7-5b84e744f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.480521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3f44c-25e3-4cde-b8c7-5b84e744f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.480798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3f44c-25e3-4cde-b8c7-5b84e744f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.481067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab3f44c-25e3-4cde-b8c7-5b84e744f6f3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.481794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3f44c-25e3-4cde-b8c7-5b84e744f6f3 None admin] RBAC: Adding query filter params (role.id=a4c95292940e4d359d48ad72b390ece0, scope.project.id=d85b7bc02b834f1998e39bf40140568c, user.id=e2c14d578d004e15b160825c91ab523c) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:25.482101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3f44c-25e3-4cde-b8c7-5b84e744f6f3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:25.483552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab3f44c-25e3-4cde-b8c7-5b84e744f6f3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:25.489830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 101/196] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:25 2022] GET /identity/v3/role_assignments?user.id=e2c14d578d004e15b160825c91ab523c&scope.project.id=d85b7bc02b834f1998e39bf40140568c&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:25.490604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3f44c-25e3-4cde-b8c7-5b84e744f6f3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.511010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:25.513666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d91ff4d-f81f-4428-9360-98e1a7c16132 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.553436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e42289-ddc3-4dc6-929f-656451a10203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.554092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e42289-ddc3-4dc6-929f-656451a10203 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.554372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e42289-ddc3-4dc6-929f-656451a10203 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.554652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e42289-ddc3-4dc6-929f-656451a10203 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.555840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e42289-ddc3-4dc6-929f-656451a10203 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:25.557381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e42289-ddc3-4dc6-929f-656451a10203 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:25.559020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 96/197] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:25 2022] GET /identity/v3/domains/default => generated 199 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:25.559884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e42289-ddc3-4dc6-929f-656451a10203 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.571104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:25.611212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab3f44c-25e3-4cde-b8c7-5b84e744f6f3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.653983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de0fd7-8eff-45d8-85ea-5a6562f75fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.654654 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de0fd7-8eff-45d8-85ea-5a6562f75fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.654938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de0fd7-8eff-45d8-85ea-5a6562f75fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.655211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1de0fd7-8eff-45d8-85ea-5a6562f75fe5 None admin] PATH_INFO: `/v3/users/afc4ac4a9b9e4cd9b877206a353431b0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.657394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de0fd7-8eff-45d8-85ea-5a6562f75fe5 None admin] RBAC: Authorizing `identity:get_user(user_id=afc4ac4a9b9e4cd9b877206a353431b0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:25.657851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1de0fd7-8eff-45d8-85ea-5a6562f75fe5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:25.660634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 102/198] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:25 2022] GET /identity/v3/users/afc4ac4a9b9e4cd9b877206a353431b0 => generated 289 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:25.661319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de0fd7-8eff-45d8-85ea-5a6562f75fe5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.678485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e42289-ddc3-4dc6-929f-656451a10203 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.716682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4769634-5a0e-4eee-9048-40b56378c914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.717329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4769634-5a0e-4eee-9048-40b56378c914 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.717612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4769634-5a0e-4eee-9048-40b56378c914 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.717888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4769634-5a0e-4eee-9048-40b56378c914 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.719455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4769634-5a0e-4eee-9048-40b56378c914 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:25.721538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4769634-5a0e-4eee-9048-40b56378c914 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:25.723179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 97/199] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:25 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:25.723925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4769634-5a0e-4eee-9048-40b56378c914 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.765541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:25.781222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1de0fd7-8eff-45d8-85ea-5a6562f75fe5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.814572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ab5c8-eabe-459e-8b88-90bd9ff02ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.815201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ab5c8-eabe-459e-8b88-90bd9ff02ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.815478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ab5c8-eabe-459e-8b88-90bd9ff02ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.815755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b95ab5c8-eabe-459e-8b88-90bd9ff02ef1 None admin] PATH_INFO: `/v3/users/c55c4f82db86429faf3b3807a6cbe819` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.816905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ab5c8-eabe-459e-8b88-90bd9ff02ef1 None admin] RBAC: Authorizing `identity:get_user(user_id=c55c4f82db86429faf3b3807a6cbe819)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:25.818344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b95ab5c8-eabe-459e-8b88-90bd9ff02ef1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:25.819927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 103/200] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:25 2022] GET /identity/v3/users/c55c4f82db86429faf3b3807a6cbe819 => generated 283 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:25.820713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ab5c8-eabe-459e-8b88-90bd9ff02ef1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.828030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:25.829431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4769634-5a0e-4eee-9048-40b56378c914 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.862937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72337952-97b0-4e51-94ac-9337d1f40176 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.863467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337952-97b0-4e51-94ac-9337d1f40176 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.863748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337952-97b0-4e51-94ac-9337d1f40176 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.864023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72337952-97b0-4e51-94ac-9337d1f40176 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.864719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72337952-97b0-4e51-94ac-9337d1f40176 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:25.866154 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72337952-97b0-4e51-94ac-9337d1f40176 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:25.886460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 98/201] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:12:25 2022] POST /identity/v3/users => generated 297 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:25.887252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72337952-97b0-4e51-94ac-9337d1f40176 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:25.939488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b95ab5c8-eabe-459e-8b88-90bd9ff02ef1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:25.985514 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a563e-c29b-4279-ae16-8034f4f4861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:25.986139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a563e-c29b-4279-ae16-8034f4f4861b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:25.986431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a563e-c29b-4279-ae16-8034f4f4861b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:25.986709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3a563e-c29b-4279-ae16-8034f4f4861b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:25.991437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:26.001928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72337952-97b0-4e51-94ac-9337d1f40176 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:26.042849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe0041-4ec0-44f8-ba3e-eabb4b92b0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:26.043501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe0041-4ec0-44f8-ba3e-eabb4b92b0f6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:26.043783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe0041-4ec0-44f8-ba3e-eabb4b92b0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:26.044060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34fe0041-4ec0-44f8-ba3e-eabb4b92b0f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:26.044839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe0041-4ec0-44f8-ba3e-eabb4b92b0f6 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e, user.id=c55c4f82db86429faf3b3807a6cbe819) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:26.045154 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe0041-4ec0-44f8-ba3e-eabb4b92b0f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:26.046646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34fe0041-4ec0-44f8-ba3e-eabb4b92b0f6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:26.052591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 99/202] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:25 2022] GET /identity/v3/role_assignments?user.id=c55c4f82db86429faf3b3807a6cbe819&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:26.053413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe0041-4ec0-44f8-ba3e-eabb4b92b0f6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:26.077423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a563e-c29b-4279-ae16-8034f4f4861b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:26.079168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3a563e-c29b-4279-ae16-8034f4f4861b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:26.083997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:26.195666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34fe0041-4ec0-44f8-ba3e-eabb4b92b0f6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:26.218746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 104/203] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:26.225282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a563e-c29b-4279-ae16-8034f4f4861b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:26.240007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc68a6-1d3f-4558-81e2-8b383f81d64b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:26.241357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc68a6-1d3f-4558-81e2-8b383f81d64b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:26.241640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc68a6-1d3f-4558-81e2-8b383f81d64b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:26.241916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc68a6-1d3f-4558-81e2-8b383f81d64b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:26.275074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:26.326439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc68a6-1d3f-4558-81e2-8b383f81d64b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:26.327920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc68a6-1d3f-4558-81e2-8b383f81d64b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:26.376132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3a563e-c29b-4279-ae16-8034f4f4861b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:26.380908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:26.435120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cadf55-bf48-4f65-a0be-b4f11908d8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:26.441215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cadf55-bf48-4f65-a0be-b4f11908d8bf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:26.441759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cadf55-bf48-4f65-a0be-b4f11908d8bf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:26.442279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cadf55-bf48-4f65-a0be-b4f11908d8bf None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:26.443761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cadf55-bf48-4f65-a0be-b4f11908d8bf None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:26.445441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cadf55-bf48-4f65-a0be-b4f11908d8bf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:26.447399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 105/204] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:26 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:26.453905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cadf55-bf48-4f65-a0be-b4f11908d8bf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:26.547042 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 100/205] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 494 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:26.565543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc68a6-1d3f-4558-81e2-8b383f81d64b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:26.582699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cadf55-bf48-4f65-a0be-b4f11908d8bf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:26.648689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38159e79-6d51-4212-bd9a-761c3aaa6b1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:26.649293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38159e79-6d51-4212-bd9a-761c3aaa6b1c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:26.649567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38159e79-6d51-4212-bd9a-761c3aaa6b1c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:26.649835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38159e79-6d51-4212-bd9a-761c3aaa6b1c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:26.650560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38159e79-6d51-4212-bd9a-761c3aaa6b1c None admin] RBAC: Adding query filter params (role.id=80d4b3d42e60434b9994c77552e21e75, scope.project.id=8940941bf57b4aeeabf404864a2b9d10, user.id=afc4ac4a9b9e4cd9b877206a353431b0) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:26.652810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38159e79-6d51-4212-bd9a-761c3aaa6b1c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:26.654262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38159e79-6d51-4212-bd9a-761c3aaa6b1c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:26.671588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 106/206] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:26 2022] GET /identity/v3/role_assignments?user.id=afc4ac4a9b9e4cd9b877206a353431b0&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=80d4b3d42e60434b9994c77552e21e75 => generated 608 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:26.686309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:26.747079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc68a6-1d3f-4558-81e2-8b383f81d64b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:26.808597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37523723-d1c8-4e1c-bf2e-3b8e145f03e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:26.809626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37523723-d1c8-4e1c-bf2e-3b8e145f03e0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:26.810129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37523723-d1c8-4e1c-bf2e-3b8e145f03e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:26.810600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37523723-d1c8-4e1c-bf2e-3b8e145f03e0 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:26.812026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37523723-d1c8-4e1c-bf2e-3b8e145f03e0 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:26.813785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37523723-d1c8-4e1c-bf2e-3b8e145f03e0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:26.816112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 101/207] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:26 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:26.821948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38159e79-6d51-4212-bd9a-761c3aaa6b1c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:26.879531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:26.951674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38159e79-6d51-4212-bd9a-761c3aaa6b1c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:26.989177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee466ddc-034b-4247-8d84-7330518b863b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:26.989778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466ddc-034b-4247-8d84-7330518b863b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:26.990056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466ddc-034b-4247-8d84-7330518b863b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:26.990327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee466ddc-034b-4247-8d84-7330518b863b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:26.991047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee466ddc-034b-4247-8d84-7330518b863b None admin] RBAC: Adding query filter params (role.id=4f8d839474214ed89390c34864229684, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e, user.id=c55c4f82db86429faf3b3807a6cbe819) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:26.991353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee466ddc-034b-4247-8d84-7330518b863b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:26.992801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee466ddc-034b-4247-8d84-7330518b863b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:26.998784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 107/208] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:26 2022] GET /identity/v3/role_assignments?user.id=c55c4f82db86429faf3b3807a6cbe819&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=4f8d839474214ed89390c34864229684 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:28.371797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb86011-fadd-4ea0-b208-e78a0140c1ac None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:28.372378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb86011-fadd-4ea0-b208-e78a0140c1ac None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:28.372378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb86011-fadd-4ea0-b208-e78a0140c1ac None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:28.373845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 102/209] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:28.378680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481a4e-0adf-4bb9-b18a-cafe120f4b03 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:28.379075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481a4e-0adf-4bb9-b18a-cafe120f4b03 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:28.379163 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02481a4e-0adf-4bb9-b18a-cafe120f4b03 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:28.380521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 108/210] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:28.381047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28102c2-54cf-47e2-aeb9-27e0d393b09f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:28.381432 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28102c2-54cf-47e2-aeb9-27e0d393b09f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:28.381826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28102c2-54cf-47e2-aeb9-27e0d393b09f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:28.386037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b154e-56a4-4dd8-bfdc-44d52b8be49a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:28.386579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b154e-56a4-4dd8-bfdc-44d52b8be49a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:28.387055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474b154e-56a4-4dd8-bfdc-44d52b8be49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:28.402358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b28102c2-54cf-47e2-aeb9-27e0d393b09f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:28.403899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b28102c2-54cf-47e2-aeb9-27e0d393b09f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:28.407580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-474b154e-56a4-4dd8-bfdc-44d52b8be49a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:28.409073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-474b154e-56a4-4dd8-bfdc-44d52b8be49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:28.492543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 103/211] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:28.512249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 109/212] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:28.563006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147eab5-8fce-4ccc-8583-4ddc0e83186e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:28.563289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147eab5-8fce-4ccc-8583-4ddc0e83186e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:28.563567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1147eab5-8fce-4ccc-8583-4ddc0e83186e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:28.565754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 104/213] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:28.570836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68469-235d-4df5-94fc-cd9851df49db None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:28.571127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68469-235d-4df5-94fc-cd9851df49db None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:28.571408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d68469-235d-4df5-94fc-cd9851df49db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:28.593219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-12d68469-235d-4df5-94fc-cd9851df49db None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:28.594422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-12d68469-235d-4df5-94fc-cd9851df49db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:28.623404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:28.668628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 110/214] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:28.781909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147eab5-8fce-4ccc-8583-4ddc0e83186e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:28.797391 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d68469-235d-4df5-94fc-cd9851df49db None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:28.849425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:28.912318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d68469-235d-4df5-94fc-cd9851df49db None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:28.917458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1147eab5-8fce-4ccc-8583-4ddc0e83186e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:28.951047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9c62-c82f-4210-a054-8d5e94c73f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:28.951785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9c62-c82f-4210-a054-8d5e94c73f4e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:28.952117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9c62-c82f-4210-a054-8d5e94c73f4e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:28.952503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8e9c62-c82f-4210-a054-8d5e94c73f4e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:28.960521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306944d7-9316-4774-9655-d31a93fd5f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:28.961360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306944d7-9316-4774-9655-d31a93fd5f7b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:28.961823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306944d7-9316-4774-9655-d31a93fd5f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:28.962097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-306944d7-9316-4774-9655-d31a93fd5f7b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:28.964177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8e9c62-c82f-4210-a054-8d5e94c73f4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9a8e9c62-c82f-4210-a054-8d5e94c73f4e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:28.969130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:28.970011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:28.971474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 111/215] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:12:28.973070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-306944d7-9316-4774-9655-d31a93fd5f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:28.975894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9c62-c82f-4210-a054-8d5e94c73f4e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-306944d7-9316-4774-9655-d31a93fd5f7b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:28.978215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:28.979107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:28.980732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 105/216] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:12:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:28.982232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306944d7-9316-4774-9655-d31a93fd5f7b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:29.002635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:29.083926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-306944d7-9316-4774-9655-d31a93fd5f7b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:29.087942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8e9c62-c82f-4210-a054-8d5e94c73f4e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:29.100033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:29.123682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c1546-82e5-4985-b72f-05559a465da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:29.124432 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c1546-82e5-4985-b72f-05559a465da1 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.124791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c1546-82e5-4985-b72f-05559a465da1 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.125073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743c1546-82e5-4985-b72f-05559a465da1 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.125763 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c1546-82e5-4985-b72f-05559a465da1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:29.126172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c1546-82e5-4985-b72f-05559a465da1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:29.128202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-743c1546-82e5-4985-b72f-05559a465da1 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:29.130005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee011ea-9736-4162-8b01-7ca14c321df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:29.130651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee011ea-9736-4162-8b01-7ca14c321df5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.130936 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee011ea-9736-4162-8b01-7ca14c321df5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.131198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee011ea-9736-4162-8b01-7ca14c321df5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.132421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee011ea-9736-4162-8b01-7ca14c321df5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:29.133900 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee011ea-9736-4162-8b01-7ca14c321df5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:29.135717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 112/217] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:29.136368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee011ea-9736-4162-8b01-7ca14c321df5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:29.147966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 106/218] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:29.147966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c1546-82e5-4985-b72f-05559a465da1 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:29.236905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:29.251080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee011ea-9736-4162-8b01-7ca14c321df5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:29.257230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743c1546-82e5-4985-b72f-05559a465da1 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:29.284481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb488e0-1ce0-4460-8f2b-d9fe7a7536b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:29.285087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb488e0-1ce0-4460-8f2b-d9fe7a7536b9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.285367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb488e0-1ce0-4460-8f2b-d9fe7a7536b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.285648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb488e0-1ce0-4460-8f2b-d9fe7a7536b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.286304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb488e0-1ce0-4460-8f2b-d9fe7a7536b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:29.286612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb488e0-1ce0-4460-8f2b-d9fe7a7536b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:29.288032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb488e0-1ce0-4460-8f2b-d9fe7a7536b9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:29.290854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94b748e-f753-4e66-8ba6-588932965611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:29.291480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b748e-f753-4e66-8ba6-588932965611 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.291757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b748e-f753-4e66-8ba6-588932965611 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.292027 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94b748e-f753-4e66-8ba6-588932965611 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.292707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b748e-f753-4e66-8ba6-588932965611 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:29.294557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e94b748e-f753-4e66-8ba6-588932965611 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:29.296053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 113/219] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:29.297962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb488e0-1ce0-4460-8f2b-d9fe7a7536b9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:29.316750 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 107/220] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:12:29 2022] POST /identity/v3/users => generated 297 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:29.318206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080cbc-ba64-4871-9eb4-888996da535c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.318495 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080cbc-ba64-4871-9eb4-888996da535c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.318776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63080cbc-ba64-4871-9eb4-888996da535c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.319994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 108/221] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:29 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:29.320731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63080cbc-ba64-4871-9eb4-888996da535c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:29.358479 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:29.431597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb488e0-1ce0-4460-8f2b-d9fe7a7536b9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:29.439104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63080cbc-ba64-4871-9eb4-888996da535c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:29.474263 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412718e0-72ba-413e-a8c9-8b818bb90d4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:29.475446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412718e0-72ba-413e-a8c9-8b818bb90d4e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.475724 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412718e0-72ba-413e-a8c9-8b818bb90d4e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.476414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412718e0-72ba-413e-a8c9-8b818bb90d4e None admin] PATH_INFO: `/v3/users/fd5e2d83d6d946249ecac34f74aa17a1` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.485469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011fa242-36d0-43ec-8def-0ea47f9db7df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:29.486188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fa242-36d0-43ec-8def-0ea47f9db7df None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.486687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fa242-36d0-43ec-8def-0ea47f9db7df None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.487022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011fa242-36d0-43ec-8def-0ea47f9db7df None admin] PATH_INFO: `/v3/users/c55c4f82db86429faf3b3807a6cbe819` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.489051 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fa242-36d0-43ec-8def-0ea47f9db7df None admin] RBAC: Authorizing `identity:get_user(user_id=c55c4f82db86429faf3b3807a6cbe819)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:29.491134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011fa242-36d0-43ec-8def-0ea47f9db7df None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:29.492764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 109/222] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:29 2022] GET /identity/v3/users/c55c4f82db86429faf3b3807a6cbe819 => generated 283 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:29.492961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412718e0-72ba-413e-a8c9-8b818bb90d4e None admin] RBAC: Authorizing `identity:get_user(user_id=fd5e2d83d6d946249ecac34f74aa17a1)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:29.493954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bfaca-d0a0-4b2c-93eb-1e6559b1c4cd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.494242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bfaca-d0a0-4b2c-93eb-1e6559b1c4cd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.494403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412718e0-72ba-413e-a8c9-8b818bb90d4e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:29.494554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210bfaca-d0a0-4b2c-93eb-1e6559b1c4cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.496396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 114/223] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:29 2022] GET /identity/v3/users/fd5e2d83d6d946249ecac34f74aa17a1 => generated 297 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:29.498219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412718e0-72ba-413e-a8c9-8b818bb90d4e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:29.509880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:29.520101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-210bfaca-d0a0-4b2c-93eb-1e6559b1c4cd None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:29.521427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-210bfaca-d0a0-4b2c-93eb-1e6559b1c4cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:29.602804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 110/224] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:29.603201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bfaca-d0a0-4b2c-93eb-1e6559b1c4cd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:29.623964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412718e0-72ba-413e-a8c9-8b818bb90d4e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:29.636460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:29.676411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4bc92-52ee-442c-b5b6-cc1dd73ce5fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:29.677048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4bc92-52ee-442c-b5b6-cc1dd73ce5fd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.677321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4bc92-52ee-442c-b5b6-cc1dd73ce5fd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.677591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4bc92-52ee-442c-b5b6-cc1dd73ce5fd None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.678729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4bc92-52ee-442c-b5b6-cc1dd73ce5fd None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:29.680184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4bc92-52ee-442c-b5b6-cc1dd73ce5fd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:29.682122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 115/225] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:29 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:29.687770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4bc92-52ee-442c-b5b6-cc1dd73ce5fd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:29.730341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-210bfaca-d0a0-4b2c-93eb-1e6559b1c4cd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:29.776321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:29.778348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686e177-f692-4248-9bb3-a24b3df2a311 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:29.779243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686e177-f692-4248-9bb3-a24b3df2a311 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.779532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686e177-f692-4248-9bb3-a24b3df2a311 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.779809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1686e177-f692-4248-9bb3-a24b3df2a311 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.803319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4bc92-52ee-442c-b5b6-cc1dd73ce5fd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:29.841580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9f2fc-8e38-42b9-bf98-35bce4a778a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:29.842236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f2fc-8e38-42b9-bf98-35bce4a778a5 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:29.842512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f2fc-8e38-42b9-bf98-35bce4a778a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:29.842784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df9f2fc-8e38-42b9-bf98-35bce4a778a5 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/users/c55c4f82db86429faf3b3807a6cbe819/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:29.846211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9f2fc-8e38-42b9-bf98-35bce4a778a5 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d2a6809aef84ed58cd8ac0e168a051e, user_id=c55c4f82db86429faf3b3807a6cbe819, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:29.848941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df9f2fc-8e38-42b9-bf98-35bce4a778a5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:29.865974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 116/226] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:12:29 2022] PUT /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/users/c55c4f82db86429faf3b3807a6cbe819/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:12:29.872287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686e177-f692-4248-9bb3-a24b3df2a311 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:29.873932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1686e177-f692-4248-9bb3-a24b3df2a311 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:29.911668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:29.958603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9f2fc-8e38-42b9-bf98-35bce4a778a5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:29.995926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 111/227] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:30.002060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686e177-f692-4248-9bb3-a24b3df2a311 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:30.102758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df9f2fc-8e38-42b9-bf98-35bce4a778a5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:30.138975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed397b-f2d8-4735-bb0e-98240ed87b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:30.139614 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed397b-f2d8-4735-bb0e-98240ed87b2e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:30.139890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed397b-f2d8-4735-bb0e-98240ed87b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:30.140175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ed397b-f2d8-4735-bb0e-98240ed87b2e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:30.142513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1686e177-f692-4248-9bb3-a24b3df2a311 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:30.143221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:30.154228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ed397b-f2d8-4735-bb0e-98240ed87b2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b7ed397b-f2d8-4735-bb0e-98240ed87b2e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:30.161213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:30.163302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:30.165346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 117/228] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:30.174101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed397b-f2d8-4735-bb0e-98240ed87b2e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:30.186602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:30.195194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db8ba7-3fd9-444c-b7f4-0290413a4144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:30.195960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db8ba7-3fd9-444c-b7f4-0290413a4144 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:30.196363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db8ba7-3fd9-444c-b7f4-0290413a4144 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:30.196723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92db8ba7-3fd9-444c-b7f4-0290413a4144 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:30.198258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db8ba7-3fd9-444c-b7f4-0290413a4144 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:30.200085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92db8ba7-3fd9-444c-b7f4-0290413a4144 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:30.203730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 112/229] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:30 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:30.209947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db8ba7-3fd9-444c-b7f4-0290413a4144 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:30.311294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ed397b-f2d8-4735-bb0e-98240ed87b2e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:30.391372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92db8ba7-3fd9-444c-b7f4-0290413a4144 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:30.395087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317d2c2-0da8-4cd3-bb2d-56e777fb5a73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:30.395928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317d2c2-0da8-4cd3-bb2d-56e777fb5a73 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:30.396453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317d2c2-0da8-4cd3-bb2d-56e777fb5a73 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:30.396930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9317d2c2-0da8-4cd3-bb2d-56e777fb5a73 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:30.397798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317d2c2-0da8-4cd3-bb2d-56e777fb5a73 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:30.398305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317d2c2-0da8-4cd3-bb2d-56e777fb5a73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:30.399870 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9317d2c2-0da8-4cd3-bb2d-56e777fb5a73 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:30.417719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 118/230] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:30.425543 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317d2c2-0da8-4cd3-bb2d-56e777fb5a73 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:30.469363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece4126-34df-4238-8bd6-ef212eddf6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:30.470001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece4126-34df-4238-8bd6-ef212eddf6d6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:30.470254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece4126-34df-4238-8bd6-ef212eddf6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:30.470526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ece4126-34df-4238-8bd6-ef212eddf6d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:30.471326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece4126-34df-4238-8bd6-ef212eddf6d6 None admin] RBAC: Adding query filter params (role.id=a4c95292940e4d359d48ad72b390ece0, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e, user.id=fd5e2d83d6d946249ecac34f74aa17a1) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:30.471637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece4126-34df-4238-8bd6-ef212eddf6d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:30.473126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ece4126-34df-4238-8bd6-ef212eddf6d6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:30.492332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 113/231] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:30 2022] GET /identity/v3/role_assignments?user.id=fd5e2d83d6d946249ecac34f74aa17a1&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:30.532544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:30.578383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9317d2c2-0da8-4cd3-bb2d-56e777fb5a73 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:30.628974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce093cc8-4eb6-47c8-9b70-4cc4447f8c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:30.629644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce093cc8-4eb6-47c8-9b70-4cc4447f8c40 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:30.629926 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce093cc8-4eb6-47c8-9b70-4cc4447f8c40 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:30.630198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce093cc8-4eb6-47c8-9b70-4cc4447f8c40 None admin] PATH_INFO: `/v3/users/c55c4f82db86429faf3b3807a6cbe819` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:30.631474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce093cc8-4eb6-47c8-9b70-4cc4447f8c40 None admin] RBAC: Authorizing `identity:get_user(user_id=c55c4f82db86429faf3b3807a6cbe819)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:30.632972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce093cc8-4eb6-47c8-9b70-4cc4447f8c40 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:30.634959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 119/232] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:30 2022] GET /identity/v3/users/c55c4f82db86429faf3b3807a6cbe819 => generated 283 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:30.644227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece4126-34df-4238-8bd6-ef212eddf6d6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:30.747670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:30.802112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ece4126-34df-4238-8bd6-ef212eddf6d6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:30.838021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17f32f42-b5c7-41c0-bf73-b2ef5632944c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:30.838666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f32f42-b5c7-41c0-bf73-b2ef5632944c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:30.838946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f32f42-b5c7-41c0-bf73-b2ef5632944c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:30.839224 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17f32f42-b5c7-41c0-bf73-b2ef5632944c None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:30.840442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f32f42-b5c7-41c0-bf73-b2ef5632944c None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:30.841899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17f32f42-b5c7-41c0-bf73-b2ef5632944c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:30.843986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 114/233] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:30 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:30.850211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce093cc8-4eb6-47c8-9b70-4cc4447f8c40 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:30.999401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce093cc8-4eb6-47c8-9b70-4cc4447f8c40 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:31.038248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:31.048445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccc39c2-975c-4828-9cb4-e68105b0c2ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:31.049157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc39c2-975c-4828-9cb4-e68105b0c2ec None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:31.049435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc39c2-975c-4828-9cb4-e68105b0c2ec None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:31.049705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccc39c2-975c-4828-9cb4-e68105b0c2ec None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/users/c55c4f82db86429faf3b3807a6cbe819/roles/4f8d839474214ed89390c34864229684` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:31.053582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc39c2-975c-4828-9cb4-e68105b0c2ec None admin] RBAC: Authorizing `identity:create_grant(project_id=6d2a6809aef84ed58cd8ac0e168a051e, user_id=c55c4f82db86429faf3b3807a6cbe819, role_id=4f8d839474214ed89390c34864229684)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:31.055019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccc39c2-975c-4828-9cb4-e68105b0c2ec None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:31.081927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 120/234] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:12:30 2022] PUT /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/users/c55c4f82db86429faf3b3807a6cbe819/roles/4f8d839474214ed89390c34864229684 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:32.272192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1d63-314f-469f-8b4b-12e00e975c96 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:32.272740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1d63-314f-469f-8b4b-12e00e975c96 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:32.272740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590b1d63-314f-469f-8b4b-12e00e975c96 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:32.274351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 115/235] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:32.279622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ca0e-5795-4744-a901-a9211517b78e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:32.280041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ca0e-5795-4744-a901-a9211517b78e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:32.280252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba29ca0e-5795-4744-a901-a9211517b78e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:32.306005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ba29ca0e-5795-4744-a901-a9211517b78e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:32.307209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ba29ca0e-5795-4744-a901-a9211517b78e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:32.386502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 121/236] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:32.392061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ab91-6201-40b8-9549-49b0d3d28b69 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:32.392375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ab91-6201-40b8-9549-49b0d3d28b69 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:32.392685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c7ab91-6201-40b8-9549-49b0d3d28b69 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:32.394131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 116/237] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:32.409904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26378f-7594-48c5-898a-4aad22be6718 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:32.410190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26378f-7594-48c5-898a-4aad22be6718 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:32.410470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d26378f-7594-48c5-898a-4aad22be6718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:32.432610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5d26378f-7594-48c5-898a-4aad22be6718 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:32.433803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5d26378f-7594-48c5-898a-4aad22be6718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:32.529947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 122/238] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:32.689314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e6ee-f172-4c47-b80f-ff75747c3881 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:32.689663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e6ee-f172-4c47-b80f-ff75747c3881 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:32.689932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa9e6ee-f172-4c47-b80f-ff75747c3881 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:32.691276 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 117/239] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:32.696606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92b37-c079-4e18-91d1-9fdce072a0da None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:32.696896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92b37-c079-4e18-91d1-9fdce072a0da None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:32.697176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a92b37-c079-4e18-91d1-9fdce072a0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:32.715954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f7a92b37-c079-4e18-91d1-9fdce072a0da None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:32.717161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f7a92b37-c079-4e18-91d1-9fdce072a0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:32.719724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9e6ee-f172-4c47-b80f-ff75747c3881 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:32.804610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:32.850589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 123/240] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:32.875385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92b37-c079-4e18-91d1-9fdce072a0da None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:32.885878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa9e6ee-f172-4c47-b80f-ff75747c3881 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:32.945489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:32.955670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5165510-4ebd-4f4e-b314-da5076adc39b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:32.956335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5165510-4ebd-4f4e-b314-da5076adc39b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:32.956612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5165510-4ebd-4f4e-b314-da5076adc39b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:32.956877 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5165510-4ebd-4f4e-b314-da5076adc39b None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:32.958859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5165510-4ebd-4f4e-b314-da5076adc39b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:32.960362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5165510-4ebd-4f4e-b314-da5076adc39b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:32.962083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 118/241] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:32.968887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5165510-4ebd-4f4e-b314-da5076adc39b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:33.027297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a92b37-c079-4e18-91d1-9fdce072a0da None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:33.092996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba9e77-1439-4626-8fc1-b8d1bed17082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:33.093555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba9e77-1439-4626-8fc1-b8d1bed17082 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.093842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba9e77-1439-4626-8fc1-b8d1bed17082 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.094115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ba9e77-1439-4626-8fc1-b8d1bed17082 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.117138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51ba9e77-1439-4626-8fc1-b8d1bed17082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-51ba9e77-1439-4626-8fc1-b8d1bed17082 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:33.121990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:33.122863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:33.123637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:33.125307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 124/242] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:12:33.131188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba9e77-1439-4626-8fc1-b8d1bed17082 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:33.173336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:33.174846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5165510-4ebd-4f4e-b314-da5076adc39b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:33.213051 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a822fc7-394c-427d-8414-e18cee0f4869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:33.214188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a822fc7-394c-427d-8414-e18cee0f4869 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.214708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a822fc7-394c-427d-8414-e18cee0f4869 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.215177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a822fc7-394c-427d-8414-e18cee0f4869 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.216018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a822fc7-394c-427d-8414-e18cee0f4869 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:33.217852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a822fc7-394c-427d-8414-e18cee0f4869 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:33.244863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 119/243] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:12:32 2022] POST /identity/v3/users => generated 293 bytes in 276 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:33.250749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a822fc7-394c-427d-8414-e18cee0f4869 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:33.266950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ba9e77-1439-4626-8fc1-b8d1bed17082 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:33.346163 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69696d-8279-4062-9136-2de3fc28d80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:33.347593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69696d-8279-4062-9136-2de3fc28d80b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.348090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69696d-8279-4062-9136-2de3fc28d80b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.348659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe69696d-8279-4062-9136-2de3fc28d80b None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.349644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69696d-8279-4062-9136-2de3fc28d80b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:33.350413 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69696d-8279-4062-9136-2de3fc28d80b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:33.352096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe69696d-8279-4062-9136-2de3fc28d80b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:33.359218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:33.379307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 125/244] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:33.385671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69696d-8279-4062-9136-2de3fc28d80b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:33.411377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a822fc7-394c-427d-8414-e18cee0f4869 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:33.446568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a1b9-40a8-444d-9773-24ec5ec2dbc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:33.447211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a1b9-40a8-444d-9773-24ec5ec2dbc2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.447489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a1b9-40a8-444d-9773-24ec5ec2dbc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.447760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47a1b9-40a8-444d-9773-24ec5ec2dbc2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.460140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c47a1b9-40a8-444d-9773-24ec5ec2dbc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4c47a1b9-40a8-444d-9773-24ec5ec2dbc2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:33.465447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:33.466413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:33.467200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 120/245] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:12:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:33.472576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a1b9-40a8-444d-9773-24ec5ec2dbc2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:33.532844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:33.537740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe69696d-8279-4062-9136-2de3fc28d80b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:33.583603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f17994e-f238-4293-a6f3-0c3c49a2ee54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:33.584368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17994e-f238-4293-a6f3-0c3c49a2ee54 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.584717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17994e-f238-4293-a6f3-0c3c49a2ee54 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.585057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f17994e-f238-4293-a6f3-0c3c49a2ee54 None admin] PATH_INFO: `/v3/users/b13294e1ba384e3cb1684344c8e0e91b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.600074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47a1b9-40a8-444d-9773-24ec5ec2dbc2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:33.603533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17994e-f238-4293-a6f3-0c3c49a2ee54 None admin] RBAC: Authorizing `identity:get_user(user_id=b13294e1ba384e3cb1684344c8e0e91b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:33.605037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f17994e-f238-4293-a6f3-0c3c49a2ee54 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:33.606851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 126/246] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:33 2022] GET /identity/v3/users/b13294e1ba384e3cb1684344c8e0e91b => generated 297 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:33.607851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677dbd5-d59a-4601-b473-42d249da27d3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.608258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677dbd5-d59a-4601-b473-42d249da27d3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.608484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e677dbd5-d59a-4601-b473-42d249da27d3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.610182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 127/247] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:33.615077 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677dbd5-d59a-4601-b473-42d249da27d3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:33.618029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:33.640895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3e63b0-ed60-42ff-8c88-240118437b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:33.641802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e63b0-ed60-42ff-8c88-240118437b17 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.641802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e63b0-ed60-42ff-8c88-240118437b17 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.642078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3e63b0-ed60-42ff-8c88-240118437b17 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.643273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e63b0-ed60-42ff-8c88-240118437b17 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:33.643624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e63b0-ed60-42ff-8c88-240118437b17 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:33.645048 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d3e63b0-ed60-42ff-8c88-240118437b17 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:33.655500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 121/248] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:33.656853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e812-b969-4941-b1b4-70533160cd89 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.657185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e812-b969-4941-b1b4-70533160cd89 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.657461 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c96e812-b969-4941-b1b4-70533160cd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.678810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5c96e812-b969-4941-b1b4-70533160cd89 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:33.681025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5c96e812-b969-4941-b1b4-70533160cd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:33.747796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e677dbd5-d59a-4601-b473-42d249da27d3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:33.774465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 122/249] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:33.774465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96e812-b969-4941-b1b4-70533160cd89 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:33.789947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153ac58e-cfba-4505-a076-547048ab3d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:33.790573 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac58e-cfba-4505-a076-547048ab3d68 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.790856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac58e-cfba-4505-a076-547048ab3d68 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.791131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153ac58e-cfba-4505-a076-547048ab3d68 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.824888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:33.872870 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ac58e-cfba-4505-a076-547048ab3d68 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:33.874540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-153ac58e-cfba-4505-a076-547048ab3d68 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:33.922554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c96e812-b969-4941-b1b4-70533160cd89 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:33.931283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:33.961499 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79b1e2-c186-488e-90db-31ad3a71d9d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:33.962244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b1e2-c186-488e-90db-31ad3a71d9d2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.962531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b1e2-c186-488e-90db-31ad3a71d9d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.962808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79b1e2-c186-488e-90db-31ad3a71d9d2 None admin] PATH_INFO: `/v3/users/c55c4f82db86429faf3b3807a6cbe819` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.964066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79b1e2-c186-488e-90db-31ad3a71d9d2 None admin] RBAC: Authorizing `identity:get_user(user_id=c55c4f82db86429faf3b3807a6cbe819)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:33.965582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79b1e2-c186-488e-90db-31ad3a71d9d2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:33.967476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 123/250] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:33 2022] GET /identity/v3/users/c55c4f82db86429faf3b3807a6cbe819 => generated 283 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:33.969556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dcd64-be91-4fe8-bbb8-afda7ca25697 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.969844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dcd64-be91-4fe8-bbb8-afda7ca25697 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.970123 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1dcd64-be91-4fe8-bbb8-afda7ca25697 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:33.976471 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 124/251] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:33 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:33.977416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dcd64-be91-4fe8-bbb8-afda7ca25697 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:33.980773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 128/252] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:33.982092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982fad1-0a1c-4432-9df9-01c260d78f15 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:33.982373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982fad1-0a1c-4432-9df9-01c260d78f15 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:33.982646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3982fad1-0a1c-4432-9df9-01c260d78f15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:34.007236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3982fad1-0a1c-4432-9df9-01c260d78f15 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:34.008604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3982fad1-0a1c-4432-9df9-01c260d78f15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:34.066384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:34.087273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 129/253] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:34.087273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982fad1-0a1c-4432-9df9-01c260d78f15 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:34.177266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1dcd64-be91-4fe8-bbb8-afda7ca25697 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:34.241045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3982fad1-0a1c-4432-9df9-01c260d78f15 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:34.258478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372e08-d0a4-4df4-9435-ed3ccc307dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:34.259093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372e08-d0a4-4df4-9435-ed3ccc307dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:34.259366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372e08-d0a4-4df4-9435-ed3ccc307dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:34.259635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b372e08-d0a4-4df4-9435-ed3ccc307dc6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:34.309427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ee430-1d6a-41c7-99b8-e8c34ef93684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:34.310064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee430-1d6a-41c7-99b8-e8c34ef93684 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:34.310342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee430-1d6a-41c7-99b8-e8c34ef93684 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:34.310610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8ee430-1d6a-41c7-99b8-e8c34ef93684 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:34.314992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ee430-1d6a-41c7-99b8-e8c34ef93684 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:34.316459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8ee430-1d6a-41c7-99b8-e8c34ef93684 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:34.318087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 130/254] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:34 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:34.318842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ee430-1d6a-41c7-99b8-e8c34ef93684 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:34.344542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:34.393214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b372e08-d0a4-4df4-9435-ed3ccc307dc6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:34.394699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b372e08-d0a4-4df4-9435-ed3ccc307dc6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:34.413300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:34.462996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8ee430-1d6a-41c7-99b8-e8c34ef93684 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:34.499873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eec9de-3b41-4977-b683-920446c32674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:34.500700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec9de-3b41-4977-b683-920446c32674 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:34.501105 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec9de-3b41-4977-b683-920446c32674 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:34.501472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5eec9de-3b41-4977-b683-920446c32674 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:34.512939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5eec9de-3b41-4977-b683-920446c32674 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:34.514112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 125/255] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:34.515147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372e08-d0a4-4df4-9435-ed3ccc307dc6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f5eec9de-3b41-4977-b683-920446c32674 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:34.519903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:34.520881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:34.521660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:34.526119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 131/256] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:34.527598 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eec9de-3b41-4977-b683-920446c32674 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:34.598298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:34.628399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b372e08-d0a4-4df4-9435-ed3ccc307dc6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:34.639589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5eec9de-3b41-4977-b683-920446c32674 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:34.655592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:34.668382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9b60c-dd36-40ef-9866-10eefacd0359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:34.669271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b60c-dd36-40ef-9866-10eefacd0359 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:34.669756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b60c-dd36-40ef-9866-10eefacd0359 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:34.670202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add9b60c-dd36-40ef-9866-10eefacd0359 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:34.671132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9b60c-dd36-40ef-9866-10eefacd0359 None admin] RBAC: Adding query filter params (role.id=80d4b3d42e60434b9994c77552e21e75, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e, user.id=b13294e1ba384e3cb1684344c8e0e91b) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:34.671722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9b60c-dd36-40ef-9866-10eefacd0359 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:34.673448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add9b60c-dd36-40ef-9866-10eefacd0359 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:34.677506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1f79e-8734-4a8d-b59e-b39e9fe7edcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:34.678278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1f79e-8734-4a8d-b59e-b39e9fe7edcf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:34.678634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1f79e-8734-4a8d-b59e-b39e9fe7edcf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:34.678976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e1f79e-8734-4a8d-b59e-b39e9fe7edcf None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:34.688267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 126/257] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:34 2022] GET /identity/v3/role_assignments?user.id=b13294e1ba384e3cb1684344c8e0e91b&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=80d4b3d42e60434b9994c77552e21e75 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:34.689953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9b60c-dd36-40ef-9866-10eefacd0359 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:34.702151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e1f79e-8734-4a8d-b59e-b39e9fe7edcf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-62e1f79e-8734-4a8d-b59e-b39e9fe7edcf None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:34.712566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:34.713592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:34.714400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:34.718555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 132/258] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:34 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:34.719646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1f79e-8734-4a8d-b59e-b39e9fe7edcf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:34.834790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e1f79e-8734-4a8d-b59e-b39e9fe7edcf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:34.872437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0de02-53e4-47c4-a287-c80d6eff5238 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:34.873054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0de02-53e4-47c4-a287-c80d6eff5238 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:34.873335 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0de02-53e4-47c4-a287-c80d6eff5238 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:34.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e0de02-53e4-47c4-a287-c80d6eff5238 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:34.874279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0de02-53e4-47c4-a287-c80d6eff5238 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:34.874589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0de02-53e4-47c4-a287-c80d6eff5238 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:34.875996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e0de02-53e4-47c4-a287-c80d6eff5238 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:34.887041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 133/259] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:34 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:34.888075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0de02-53e4-47c4-a287-c80d6eff5238 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:34.926768 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:34.943704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add9b60c-dd36-40ef-9866-10eefacd0359 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:34.987598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edd552-6502-4055-a0f5-a2781baf272d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:34.988571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edd552-6502-4055-a0f5-a2781baf272d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:34.989068 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edd552-6502-4055-a0f5-a2781baf272d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:34.989623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12edd552-6502-4055-a0f5-a2781baf272d None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:34.991017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edd552-6502-4055-a0f5-a2781baf272d None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:34.992790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12edd552-6502-4055-a0f5-a2781baf272d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:34.999131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e0de02-53e4-47c4-a287-c80d6eff5238 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:35.000120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 127/260] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:34 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:35.001231 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edd552-6502-4055-a0f5-a2781baf272d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:35.016807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:35.038342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12214341-30db-4636-bfc2-87544a4cd897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:35.039308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12214341-30db-4636-bfc2-87544a4cd897 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:35.039786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12214341-30db-4636-bfc2-87544a4cd897 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:35.040289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12214341-30db-4636-bfc2-87544a4cd897 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:35.041154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12214341-30db-4636-bfc2-87544a4cd897 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:35.041699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12214341-30db-4636-bfc2-87544a4cd897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:35.043363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12214341-30db-4636-bfc2-87544a4cd897 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:35.052609 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 134/261] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:35.058306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12214341-30db-4636-bfc2-87544a4cd897 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:35.165078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12214341-30db-4636-bfc2-87544a4cd897 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:35.168487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:35.201732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30bf4d-1ab6-41b6-9c67-516af65d764c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:35.202541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30bf4d-1ab6-41b6-9c67-516af65d764c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:35.202928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30bf4d-1ab6-41b6-9c67-516af65d764c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:35.203307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e30bf4d-1ab6-41b6-9c67-516af65d764c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:35.204352 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30bf4d-1ab6-41b6-9c67-516af65d764c None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e, user.id=c55c4f82db86429faf3b3807a6cbe819) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:35.204773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30bf4d-1ab6-41b6-9c67-516af65d764c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:35.206959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e30bf4d-1ab6-41b6-9c67-516af65d764c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:35.213776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12edd552-6502-4055-a0f5-a2781baf272d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:35.218175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 135/262] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:35 2022] GET /identity/v3/role_assignments?user.id=c55c4f82db86429faf3b3807a6cbe819&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 608 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:35.219071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30bf4d-1ab6-41b6-9c67-516af65d764c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:35.258144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88862-eed4-4d23-8429-73dbbbc3cf16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:35.258793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88862-eed4-4d23-8429-73dbbbc3cf16 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:35.259074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88862-eed4-4d23-8429-73dbbbc3cf16 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:35.259350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe88862-eed4-4d23-8429-73dbbbc3cf16 None admin] PATH_INFO: `/v3/users/fd5e2d83d6d946249ecac34f74aa17a1` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:35.260606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe88862-eed4-4d23-8429-73dbbbc3cf16 None admin] RBAC: Authorizing `identity:get_user(user_id=fd5e2d83d6d946249ecac34f74aa17a1)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:35.262124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe88862-eed4-4d23-8429-73dbbbc3cf16 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:35.263896 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 128/263] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:35 2022] GET /identity/v3/users/fd5e2d83d6d946249ecac34f74aa17a1 => generated 297 bytes in 263 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:35.269999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88862-eed4-4d23-8429-73dbbbc3cf16 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:35.353695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:35.395690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e30bf4d-1ab6-41b6-9c67-516af65d764c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:35.417183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe88862-eed4-4d23-8429-73dbbbc3cf16 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:35.439128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089561d-b02e-4104-8ea6-988fa4b33d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:35.440464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089561d-b02e-4104-8ea6-988fa4b33d0f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:35.440640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089561d-b02e-4104-8ea6-988fa4b33d0f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:35.440916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e089561d-b02e-4104-8ea6-988fa4b33d0f None admin] PATH_INFO: `/v3/users/c55c4f82db86429faf3b3807a6cbe819` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:35.442296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089561d-b02e-4104-8ea6-988fa4b33d0f None admin] RBAC: Authorizing `identity:get_user(user_id=c55c4f82db86429faf3b3807a6cbe819)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:35.443760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e089561d-b02e-4104-8ea6-988fa4b33d0f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:35.445677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 136/264] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:35 2022] GET /identity/v3/users/c55c4f82db86429faf3b3807a6cbe819 => generated 283 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:35.451079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089561d-b02e-4104-8ea6-988fa4b33d0f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:35.500361 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a53f8-4058-44f8-890c-7d1ce9d3d914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:35.501005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a53f8-4058-44f8-890c-7d1ce9d3d914 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:35.501286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a53f8-4058-44f8-890c-7d1ce9d3d914 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:35.501556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305a53f8-4058-44f8-890c-7d1ce9d3d914 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:35.502961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a53f8-4058-44f8-890c-7d1ce9d3d914 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:35.504429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305a53f8-4058-44f8-890c-7d1ce9d3d914 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:35.508559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:35.509213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 129/265] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:35 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:35.514714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a53f8-4058-44f8-890c-7d1ce9d3d914 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:35.601060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e089561d-b02e-4104-8ea6-988fa4b33d0f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:35.647825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391af7-3123-40a5-9cc5-b0c18114bd84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:35.648564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391af7-3123-40a5-9cc5-b0c18114bd84 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:35.648845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391af7-3123-40a5-9cc5-b0c18114bd84 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:35.649119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37391af7-3123-40a5-9cc5-b0c18114bd84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:35.701329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305a53f8-4058-44f8-890c-7d1ce9d3d914 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:35.733601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37391af7-3123-40a5-9cc5-b0c18114bd84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:35.735465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37391af7-3123-40a5-9cc5-b0c18114bd84 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:35.776274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:35.779567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f82ff-1f1a-4de7-a6b8-c521cab5a894 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:35.780497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f82ff-1f1a-4de7-a6b8-c521cab5a894 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:35.780992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f82ff-1f1a-4de7-a6b8-c521cab5a894 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:35.781455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6f82ff-1f1a-4de7-a6b8-c521cab5a894 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/users/fd5e2d83d6d946249ecac34f74aa17a1/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:35.783653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f82ff-1f1a-4de7-a6b8-c521cab5a894 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d2a6809aef84ed58cd8ac0e168a051e, user_id=fd5e2d83d6d946249ecac34f74aa17a1, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:35.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6f82ff-1f1a-4de7-a6b8-c521cab5a894 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:35.814886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 130/266] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:12:35 2022] PUT /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/users/fd5e2d83d6d946249ecac34f74aa17a1/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:35.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 137/267] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 396 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 14:12:35.852732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f82ff-1f1a-4de7-a6b8-c521cab5a894 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:35.855677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:35.967172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6f82ff-1f1a-4de7-a6b8-c521cab5a894 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:36.007163 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17634f1b-32b5-49fa-9dea-3ed1426c473d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:36.007900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17634f1b-32b5-49fa-9dea-3ed1426c473d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:36.008208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17634f1b-32b5-49fa-9dea-3ed1426c473d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:36.008492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17634f1b-32b5-49fa-9dea-3ed1426c473d None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:36.009894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17634f1b-32b5-49fa-9dea-3ed1426c473d None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:36.011434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17634f1b-32b5-49fa-9dea-3ed1426c473d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:36.013722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 131/268] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:35 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:36.019428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391af7-3123-40a5-9cc5-b0c18114bd84 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:36.143627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37391af7-3123-40a5-9cc5-b0c18114bd84 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:36.167679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791260be-5669-4991-a273-b4694b94d709 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:36.167986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791260be-5669-4991-a273-b4694b94d709 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:36.168244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791260be-5669-4991-a273-b4694b94d709 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:36.171210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 132/269] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:36.175708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:36.177609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb1e6d-adef-4776-9453-25914859f009 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:36.178094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb1e6d-adef-4776-9453-25914859f009 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:36.178879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbbb1e6d-adef-4776-9453-25914859f009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:36.185748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea7fd5-691b-4919-b59c-677cb9922f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:36.186358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea7fd5-691b-4919-b59c-677cb9922f7d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:36.186642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea7fd5-691b-4919-b59c-677cb9922f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:36.187071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ea7fd5-691b-4919-b59c-677cb9922f7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:36.187762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea7fd5-691b-4919-b59c-677cb9922f7d None admin] RBAC: Adding query filter params (role.id=4f8d839474214ed89390c34864229684, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e, user.id=c55c4f82db86429faf3b3807a6cbe819) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:36.188075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea7fd5-691b-4919-b59c-677cb9922f7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:36.190190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ea7fd5-691b-4919-b59c-677cb9922f7d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:36.196800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 138/270] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:36 2022] GET /identity/v3/role_assignments?user.id=c55c4f82db86429faf3b3807a6cbe819&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=4f8d839474214ed89390c34864229684 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:36.201677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bbbb1e6d-adef-4776-9453-25914859f009 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:36.203184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bbbb1e6d-adef-4776-9453-25914859f009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:36.287601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:36.292395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 133/271] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:36.589964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea7fd5-691b-4919-b59c-677cb9922f7d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:36.669973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a024-d7fa-443b-83a2-6abd8c70eb18 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:36.670512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a024-d7fa-443b-83a2-6abd8c70eb18 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:36.670747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9371a024-d7fa-443b-83a2-6abd8c70eb18 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:36.672482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 134/272] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:36.678855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed572-0969-4302-979c-4b512da39b2a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:36.679258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed572-0969-4302-979c-4b512da39b2a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:36.679628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed572-0969-4302-979c-4b512da39b2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:36.699511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-031ed572-0969-4302-979c-4b512da39b2a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:36.702064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-031ed572-0969-4302-979c-4b512da39b2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:36.705641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ea7fd5-691b-4919-b59c-677cb9922f7d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:36.746122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d1199-e1b8-4831-a9a8-4772c3279b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:36.747101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d1199-e1b8-4831-a9a8-4772c3279b90 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:36.747516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d1199-e1b8-4831-a9a8-4772c3279b90 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:36.747946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d1199-e1b8-4831-a9a8-4772c3279b90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:36.759643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d1199-e1b8-4831-a9a8-4772c3279b90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e49d1199-e1b8-4831-a9a8-4772c3279b90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:36.766149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:36.767157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:36.768759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:36.771063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 139/273] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:36.778603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d1199-e1b8-4831-a9a8-4772c3279b90 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:36.791264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 135/274] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:36.838652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:36.886985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d1199-e1b8-4831-a9a8-4772c3279b90 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:36.921962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1c5a5-0fda-4e11-85da-4cda6a5e4210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:36.922887 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1c5a5-0fda-4e11-85da-4cda6a5e4210 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:36.923350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1c5a5-0fda-4e11-85da-4cda6a5e4210 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:36.923862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1c5a5-0fda-4e11-85da-4cda6a5e4210 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:36.924775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1c5a5-0fda-4e11-85da-4cda6a5e4210 None admin] RBAC: Adding query filter params (name=member) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:36.925383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1c5a5-0fda-4e11-85da-4cda6a5e4210 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:36.926992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1c5a5-0fda-4e11-85da-4cda6a5e4210 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:36.937299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 140/275] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:36.944178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ed572-0969-4302-979c-4b512da39b2a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:37.048920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ed572-0969-4302-979c-4b512da39b2a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:37.078557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:37.084932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70594f9e-a594-4719-a517-3132171b793a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:37.085569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70594f9e-a594-4719-a517-3132171b793a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:37.085850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70594f9e-a594-4719-a517-3132171b793a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:37.086121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70594f9e-a594-4719-a517-3132171b793a None admin] PATH_INFO: `/v3/users/790690cd5e834816b90653101b49d59a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:37.086545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1c5a5-0fda-4e11-85da-4cda6a5e4210 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:37.101341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70594f9e-a594-4719-a517-3132171b793a None admin] RBAC: Authorizing `identity:get_user(user_id=790690cd5e834816b90653101b49d59a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:37.102802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70594f9e-a594-4719-a517-3132171b793a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:37.104900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 136/276] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:36 2022] GET /identity/v3/users/790690cd5e834816b90653101b49d59a => generated 293 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:37.110346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70594f9e-a594-4719-a517-3132171b793a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:37.194579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1c5a5-0fda-4e11-85da-4cda6a5e4210 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:37.211450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:37.217535 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70594f9e-a594-4719-a517-3132171b793a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:37.230550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d59010-218b-4272-8c05-bda9d2961d45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:37.231192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d59010-218b-4272-8c05-bda9d2961d45 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:37.231477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d59010-218b-4272-8c05-bda9d2961d45 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:37.231756 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d59010-218b-4272-8c05-bda9d2961d45 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:37.232898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d59010-218b-4272-8c05-bda9d2961d45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:37.234354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d59010-218b-4272-8c05-bda9d2961d45 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:37.236288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 141/277] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:37 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:37.241659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d59010-218b-4272-8c05-bda9d2961d45 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:37.254240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e205be8-9ba7-4f47-b9e8-eee36ea87ceb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:37.254951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205be8-9ba7-4f47-b9e8-eee36ea87ceb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:37.255233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205be8-9ba7-4f47-b9e8-eee36ea87ceb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:37.255503 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e205be8-9ba7-4f47-b9e8-eee36ea87ceb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:37.256352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e205be8-9ba7-4f47-b9e8-eee36ea87ceb None admin] RBAC: Adding query filter params (role.id=a4c95292940e4d359d48ad72b390ece0, user.id=790690cd5e834816b90653101b49d59a, scope.system=all) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:37.256663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e205be8-9ba7-4f47-b9e8-eee36ea87ceb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:37.258107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e205be8-9ba7-4f47-b9e8-eee36ea87ceb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:37.263902 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 137/278] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 24 14:12:37 2022] GET /identity/v3/role_assignments?user.id=790690cd5e834816b90653101b49d59a&scope.system=all&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:37.361627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d59010-218b-4272-8c05-bda9d2961d45 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:37.399221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d582c2-4e0a-4a3e-923c-15186c49b71d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:37.399848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d582c2-4e0a-4a3e-923c-15186c49b71d None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:37.400131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d582c2-4e0a-4a3e-923c-15186c49b71d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:37.400485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d582c2-4e0a-4a3e-923c-15186c49b71d None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:37.401162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d582c2-4e0a-4a3e-923c-15186c49b71d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:37.402717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d582c2-4e0a-4a3e-923c-15186c49b71d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:37.426942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 142/279] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:12:37 2022] POST /identity/v3/users => generated 293 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:37.601176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c6f2b-57e8-4f3c-9484-1bf2d09a8e59 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:37.603093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c6f2b-57e8-4f3c-9484-1bf2d09a8e59 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:37.603093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580c6f2b-57e8-4f3c-9484-1bf2d09a8e59 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:37.603537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 138/280] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:37.609053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7321f-2e6e-4254-aa00-118c9225d713 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:37.609935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7321f-2e6e-4254-aa00-118c9225d713 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:37.610412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf7321f-2e6e-4254-aa00-118c9225d713 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:37.630085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ccf7321f-2e6e-4254-aa00-118c9225d713 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:37.631587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ccf7321f-2e6e-4254-aa00-118c9225d713 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:37.667780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:37.702984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 143/281] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:37.985261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c6f2b-57e8-4f3c-9484-1bf2d09a8e59 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:38.058490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:38.130384 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580c6f2b-57e8-4f3c-9484-1bf2d09a8e59 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:38.180213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcb08e-de8a-49c2-9603-76eee225a9dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:38.180857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcb08e-de8a-49c2-9603-76eee225a9dc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:38.181134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcb08e-de8a-49c2-9603-76eee225a9dc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:38.181405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4fcb08e-de8a-49c2-9603-76eee225a9dc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:38.197439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4fcb08e-de8a-49c2-9603-76eee225a9dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c4fcb08e-de8a-49c2-9603-76eee225a9dc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:38.202260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:38.203176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:38.204001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:38.206895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 139/282] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:38.213252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7321f-2e6e-4254-aa00-118c9225d713 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:38.382935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf7321f-2e6e-4254-aa00-118c9225d713 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:38.429339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08036539-6cda-4687-843a-dd759be2e370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:38.429950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08036539-6cda-4687-843a-dd759be2e370 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:38.430225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08036539-6cda-4687-843a-dd759be2e370 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:38.430498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08036539-6cda-4687-843a-dd759be2e370 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:38.431162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08036539-6cda-4687-843a-dd759be2e370 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:38.431467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08036539-6cda-4687-843a-dd759be2e370 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:38.432870 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08036539-6cda-4687-843a-dd759be2e370 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:38.441743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 144/283] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:38.447093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcb08e-de8a-49c2-9603-76eee225a9dc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:38.463765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a11f6-cb33-4388-8393-5815ef1547e6 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:38.464093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a11f6-cb33-4388-8393-5815ef1547e6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:38.464345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff1a11f6-cb33-4388-8393-5815ef1547e6 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:38.465948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 145/284] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:38.477882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707c4f-7703-466d-878d-0a42b074ed89 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:38.478190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707c4f-7703-466d-878d-0a42b074ed89 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:38.478439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a707c4f-7703-466d-878d-0a42b074ed89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:38.509980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9a707c4f-7703-466d-878d-0a42b074ed89 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:38.511197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9a707c4f-7703-466d-878d-0a42b074ed89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:38.561591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:38.613162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4fcb08e-de8a-49c2-9603-76eee225a9dc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:38.636386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:38.661352 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 146/285] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:38.676472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dcb41-b44f-4014-ad1f-ec6d662b3491 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:38.677224 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dcb41-b44f-4014-ad1f-ec6d662b3491 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:38.677648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dcb41-b44f-4014-ad1f-ec6d662b3491 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:38.678039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1dcb41-b44f-4014-ad1f-ec6d662b3491 None admin] PATH_INFO: `/v3/users/b13294e1ba384e3cb1684344c8e0e91b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:38.679622 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dcb41-b44f-4014-ad1f-ec6d662b3491 None admin] RBAC: Authorizing `identity:get_user(user_id=b13294e1ba384e3cb1684344c8e0e91b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:38.681773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1dcb41-b44f-4014-ad1f-ec6d662b3491 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:38.684256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 140/286] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:38 2022] GET /identity/v3/users/b13294e1ba384e3cb1684344c8e0e91b => generated 297 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:38.693590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a707c4f-7703-466d-878d-0a42b074ed89 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:38.891590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a707c4f-7703-466d-878d-0a42b074ed89 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:38.946003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dcb41-b44f-4014-ad1f-ec6d662b3491 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:38.949791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ffce7-8aed-4ddb-9b54-80337a3739d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:38.950654 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ffce7-8aed-4ddb-9b54-80337a3739d0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:38.951041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ffce7-8aed-4ddb-9b54-80337a3739d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:38.951423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7ffce7-8aed-4ddb-9b54-80337a3739d0 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:38.953080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ffce7-8aed-4ddb-9b54-80337a3739d0 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:38.955329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7ffce7-8aed-4ddb-9b54-80337a3739d0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:38.957879 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 147/287] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:38 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:38.972183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ffce7-8aed-4ddb-9b54-80337a3739d0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:39.022535 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:39.147147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7ffce7-8aed-4ddb-9b54-80337a3739d0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:39.158261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1dcb41-b44f-4014-ad1f-ec6d662b3491 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:39.218664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433fac0-7071-4afd-91aa-b5a85fb86ad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:39.219327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433fac0-7071-4afd-91aa-b5a85fb86ad0 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:39.219609 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433fac0-7071-4afd-91aa-b5a85fb86ad0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:39.219885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8433fac0-7071-4afd-91aa-b5a85fb86ad0 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/users/b13294e1ba384e3cb1684344c8e0e91b/roles/80d4b3d42e60434b9994c77552e21e75` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:39.222043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433fac0-7071-4afd-91aa-b5a85fb86ad0 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d2a6809aef84ed58cd8ac0e168a051e, user_id=b13294e1ba384e3cb1684344c8e0e91b, role_id=80d4b3d42e60434b9994c77552e21e75)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:39.223612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8433fac0-7071-4afd-91aa-b5a85fb86ad0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:39.228382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bc843-e5ce-4453-879d-206e2d0eae90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:39.229361 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bc843-e5ce-4453-879d-206e2d0eae90 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:39.229838 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bc843-e5ce-4453-879d-206e2d0eae90 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:39.230275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5bc843-e5ce-4453-879d-206e2d0eae90 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:39.245783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5bc843-e5ce-4453-879d-206e2d0eae90 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fd5bc843-e5ce-4453-879d-206e2d0eae90 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:39.251573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:39.253034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:39.253839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:39.260367 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 141/288] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:39.262817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bc843-e5ce-4453-879d-206e2d0eae90 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:39.264185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 148/289] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:12:38 2022] PUT /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/users/b13294e1ba384e3cb1684344c8e0e91b/roles/80d4b3d42e60434b9994c77552e21e75 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:39.312908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:39.397146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5bc843-e5ce-4453-879d-206e2d0eae90 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:39.448394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59c1d-3427-4dcf-87db-762a2a606c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:39.449341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59c1d-3427-4dcf-87db-762a2a606c04 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:39.449821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59c1d-3427-4dcf-87db-762a2a606c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:39.450368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be59c1d-3427-4dcf-87db-762a2a606c04 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:39.451262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be59c1d-3427-4dcf-87db-762a2a606c04 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:39.451764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be59c1d-3427-4dcf-87db-762a2a606c04 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:39.453441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0be59c1d-3427-4dcf-87db-762a2a606c04 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:39.463271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 142/290] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:39.475387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433fac0-7071-4afd-91aa-b5a85fb86ad0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:39.591230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8433fac0-7071-4afd-91aa-b5a85fb86ad0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:39.593052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:39.631277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51a5a43-a217-4ec4-a86c-0c831d2e3b5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:39.631960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a5a43-a217-4ec4-a86c-0c831d2e3b5a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:39.632273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a5a43-a217-4ec4-a86c-0c831d2e3b5a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:39.632554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51a5a43-a217-4ec4-a86c-0c831d2e3b5a None admin] PATH_INFO: `/v3/users/fd5e2d83d6d946249ecac34f74aa17a1` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:39.633696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a5a43-a217-4ec4-a86c-0c831d2e3b5a None admin] RBAC: Authorizing `identity:get_user(user_id=fd5e2d83d6d946249ecac34f74aa17a1)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:39.635213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51a5a43-a217-4ec4-a86c-0c831d2e3b5a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:39.636891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 149/291] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:39 2022] GET /identity/v3/users/fd5e2d83d6d946249ecac34f74aa17a1 => generated 297 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:39.643117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59c1d-3427-4dcf-87db-762a2a606c04 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:39.662594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45558f8b-631c-4691-bee6-5d6a6aef0610 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:39.663082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45558f8b-631c-4691-bee6-5d6a6aef0610 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:39.663304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45558f8b-631c-4691-bee6-5d6a6aef0610 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:39.664621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 150/292] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:12:39.669830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0b806-6f0b-41ca-a22a-a16b52299c19 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:39.670113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0b806-6f0b-41ca-a22a-a16b52299c19 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:39.670390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c0b806-6f0b-41ca-a22a-a16b52299c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:39.704090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-03c0b806-6f0b-41ca-a22a-a16b52299c19 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:39.705274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-03c0b806-6f0b-41ca-a22a-a16b52299c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:39.833211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be59c1d-3427-4dcf-87db-762a2a606c04 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:39.835331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:39.854498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 151/293] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:39.874155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004834c-b781-4951-99a3-f5cff0f86c2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:39.874772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004834c-b781-4951-99a3-f5cff0f86c2c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:39.875111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004834c-b781-4951-99a3-f5cff0f86c2c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:39.875384 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0004834c-b781-4951-99a3-f5cff0f86c2c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:39.967278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004834c-b781-4951-99a3-f5cff0f86c2c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:39.968691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0004834c-b781-4951-99a3-f5cff0f86c2c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:40.105997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 143/294] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 459 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:40.108349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0b806-6f0b-41ca-a22a-a16b52299c19 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:40.203144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:40.216481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c0b806-6f0b-41ca-a22a-a16b52299c19 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:40.253331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5341-75a0-437f-bce6-069ba198995a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:40.253975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5341-75a0-437f-bce6-069ba198995a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:40.254254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5341-75a0-437f-bce6-069ba198995a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:40.254529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1a5341-75a0-437f-bce6-069ba198995a None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:40.255650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5341-75a0-437f-bce6-069ba198995a None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:40.257121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1a5341-75a0-437f-bce6-069ba198995a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:40.263187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 152/295] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:40 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:40.265239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004834c-b781-4951-99a3-f5cff0f86c2c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:40.267998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:40.284326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5341-75a0-437f-bce6-069ba198995a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:40.495177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0004834c-b781-4951-99a3-f5cff0f86c2c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:40.498479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1a5341-75a0-437f-bce6-069ba198995a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:40.544845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f48faac-6224-4cfe-9a9e-4296fcf96a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:40.545412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48faac-6224-4cfe-9a9e-4296fcf96a85 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:40.545695 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48faac-6224-4cfe-9a9e-4296fcf96a85 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:40.545966 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f48faac-6224-4cfe-9a9e-4296fcf96a85 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:40.550314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab333d9-a54b-4dc0-b083-9134dedaed95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:40.550937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab333d9-a54b-4dc0-b083-9134dedaed95 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:40.551257 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab333d9-a54b-4dc0-b083-9134dedaed95 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:40.552634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab333d9-a54b-4dc0-b083-9134dedaed95 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:40.558965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f48faac-6224-4cfe-9a9e-4296fcf96a85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:40.561411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab333d9-a54b-4dc0-b083-9134dedaed95 None admin] RBAC: Adding query filter params (role.id=a4c95292940e4d359d48ad72b390ece0, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e, user.id=fd5e2d83d6d946249ecac34f74aa17a1) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:40.561743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab333d9-a54b-4dc0-b083-9134dedaed95 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:40.563238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab333d9-a54b-4dc0-b083-9134dedaed95 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2f48faac-6224-4cfe-9a9e-4296fcf96a85 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:40.565172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:40.566047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:40.566855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:40.567893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 153/296] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:40 2022] GET /identity/v3/roles/member => generated 84 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:12:40.570217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42a090-196c-4482-9aa4-e903e0e4032d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:40.570217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42a090-196c-4482-9aa4-e903e0e4032d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:40.570217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b42a090-196c-4482-9aa4-e903e0e4032d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:40.570629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 154/297] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:40.576597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578814f-2aef-49d9-b1d0-19ac330f9bc4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:40.577217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578814f-2aef-49d9-b1d0-19ac330f9bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:40.577722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578814f-2aef-49d9-b1d0-19ac330f9bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:40.582533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 144/298] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:40 2022] GET /identity/v3/role_assignments?user.id=fd5e2d83d6d946249ecac34f74aa17a1&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 608 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:40.584033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab333d9-a54b-4dc0-b083-9134dedaed95 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:40.614406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b578814f-2aef-49d9-b1d0-19ac330f9bc4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:40.615963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b578814f-2aef-49d9-b1d0-19ac330f9bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:40.639947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:40.676795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:40.709550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab333d9-a54b-4dc0-b083-9134dedaed95 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:40.732230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 155/299] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:40.734256 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6c6e-0689-4080-a929-ec6176b129ad None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:40.734743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6c6e-0689-4080-a929-ec6176b129ad None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:40.735218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e6c6e-0689-4080-a929-ec6176b129ad None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:40.736960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 156/300] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:40.746671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a27c9-70c1-4e1f-a5f5-cbb598656f43 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:40.746671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a27c9-70c1-4e1f-a5f5-cbb598656f43 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:40.746671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579a27c9-70c1-4e1f-a5f5-cbb598656f43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:40.764791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-579a27c9-70c1-4e1f-a5f5-cbb598656f43 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:40.766016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-579a27c9-70c1-4e1f-a5f5-cbb598656f43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:40.779441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa470a20-005a-4304-9a30-12cef208de33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:40.780094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa470a20-005a-4304-9a30-12cef208de33 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:40.780384 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa470a20-005a-4304-9a30-12cef208de33 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:40.780662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa470a20-005a-4304-9a30-12cef208de33 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:40.781338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa470a20-005a-4304-9a30-12cef208de33 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:40.781646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa470a20-005a-4304-9a30-12cef208de33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:40.783607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa470a20-005a-4304-9a30-12cef208de33 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:40.802646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 145/301] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:40 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:40.809566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa470a20-005a-4304-9a30-12cef208de33 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:40.868684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 157/302] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:40.943450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa470a20-005a-4304-9a30-12cef208de33 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:40.971047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:40.980475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f9894-5b56-4d99-8c1d-ff3c284b0b75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:40.981452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9894-5b56-4d99-8c1d-ff3c284b0b75 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:40.981960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9894-5b56-4d99-8c1d-ff3c284b0b75 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:40.982435 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0f9894-5b56-4d99-8c1d-ff3c284b0b75 None admin] PATH_INFO: `/v3/users/790690cd5e834816b90653101b49d59a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:40.983779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f9894-5b56-4d99-8c1d-ff3c284b0b75 None admin] RBAC: Authorizing `identity:get_user(user_id=790690cd5e834816b90653101b49d59a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:40.985510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0f9894-5b56-4d99-8c1d-ff3c284b0b75 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:40.988137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 146/303] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:40 2022] GET /identity/v3/users/790690cd5e834816b90653101b49d59a => generated 293 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:40.994091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a27c9-70c1-4e1f-a5f5-cbb598656f43 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:41.039559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f9894-5b56-4d99-8c1d-ff3c284b0b75 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:41.096646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:41.132504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579a27c9-70c1-4e1f-a5f5-cbb598656f43 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:41.168814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0f9894-5b56-4d99-8c1d-ff3c284b0b75 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:41.187753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a29055-5cc0-4005-8ae1-f9cad76eb601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:41.187753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a29055-5cc0-4005-8ae1-f9cad76eb601 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:41.187753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a29055-5cc0-4005-8ae1-f9cad76eb601 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:41.187753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a29055-5cc0-4005-8ae1-f9cad76eb601 None admin] PATH_INFO: `/v3/system/users/790690cd5e834816b90653101b49d59a/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:41.191343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a29055-5cc0-4005-8ae1-f9cad76eb601 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=790690cd5e834816b90653101b49d59a, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:41.192800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a29055-5cc0-4005-8ae1-f9cad76eb601 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:41.206080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 158/304] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Sep 24 14:12:40 2022] PUT /identity/v3/system/users/790690cd5e834816b90653101b49d59a/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:41.212184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a29055-5cc0-4005-8ae1-f9cad76eb601 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:41.217479 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefe5a4-c2de-4c19-8381-2120640bbab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:41.218138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefe5a4-c2de-4c19-8381-2120640bbab2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:41.218412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefe5a4-c2de-4c19-8381-2120640bbab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:41.218682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fefe5a4-c2de-4c19-8381-2120640bbab2 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:41.242010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fefe5a4-c2de-4c19-8381-2120640bbab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5fefe5a4-c2de-4c19-8381-2120640bbab2 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:41.248884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:41.250396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:41.251646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 147/305] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:12:41.257055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefe5a4-c2de-4c19-8381-2120640bbab2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:41.337310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:41.391411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a29055-5cc0-4005-8ae1-f9cad76eb601 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:41.405978 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fefe5a4-c2de-4c19-8381-2120640bbab2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:41.437364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa6463-9af2-42b4-b430-c591878808a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:41.438554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa6463-9af2-42b4-b430-c591878808a3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:41.439006 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa6463-9af2-42b4-b430-c591878808a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:41.439768 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa6463-9af2-42b4-b430-c591878808a3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:41.441778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa6463-9af2-42b4-b430-c591878808a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:41.444359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa6463-9af2-42b4-b430-c591878808a3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:41.446725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 159/306] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:41.451174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4543b-cfd1-46b9-adc4-88a3576fe1d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:41.451174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4543b-cfd1-46b9-adc4-88a3576fe1d4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:41.451174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4543b-cfd1-46b9-adc4-88a3576fe1d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:41.451174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba4543b-cfd1-46b9-adc4-88a3576fe1d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:41.451506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4543b-cfd1-46b9-adc4-88a3576fe1d4 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:41.451506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4543b-cfd1-46b9-adc4-88a3576fe1d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:41.452590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa6463-9af2-42b4-b430-c591878808a3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:41.452693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba4543b-cfd1-46b9-adc4-88a3576fe1d4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:41.461722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 148/307] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:41.467282 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4543b-cfd1-46b9-adc4-88a3576fe1d4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:41.468078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:41.586858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa6463-9af2-42b4-b430-c591878808a3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:41.603622 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba4543b-cfd1-46b9-adc4-88a3576fe1d4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:41.623502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87420c-bc0e-4a26-894f-7b47ddd80cc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:41.624139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87420c-bc0e-4a26-894f-7b47ddd80cc5 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:41.624495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87420c-bc0e-4a26-894f-7b47ddd80cc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:41.624710 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da87420c-bc0e-4a26-894f-7b47ddd80cc5 None admin] PATH_INFO: `/v3/groups` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:41.625348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87420c-bc0e-4a26-894f-7b47ddd80cc5 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:41.627896 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:41.628049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da87420c-bc0e-4a26-894f-7b47ddd80cc5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:41.652262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 160/308] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Sep 24 14:12:41 2022] POST /identity/v3/groups => generated 229 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:41.656350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c726b7c-db28-4ffb-bdb0-a88ceb20405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:41.657105 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c726b7c-db28-4ffb-bdb0-a88ceb20405e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:41.657391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c726b7c-db28-4ffb-bdb0-a88ceb20405e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:41.657664 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c726b7c-db28-4ffb-bdb0-a88ceb20405e None admin] PATH_INFO: `/v3/users/fa8dbb5bc6434625943c8b322969e6cb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:41.675089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c726b7c-db28-4ffb-bdb0-a88ceb20405e None admin] RBAC: Authorizing `identity:get_user(user_id=fa8dbb5bc6434625943c8b322969e6cb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:41.676839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c726b7c-db28-4ffb-bdb0-a88ceb20405e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:41.679078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 149/309] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:41 2022] GET /identity/v3/users/fa8dbb5bc6434625943c8b322969e6cb => generated 293 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:41.685324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87420c-bc0e-4a26-894f-7b47ddd80cc5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:41.768108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:41.805619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da87420c-bc0e-4a26-894f-7b47ddd80cc5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:41.842428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f7eccb1-9aed-4846-bfc8-683474b002e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:41.843077 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eccb1-9aed-4846-bfc8-683474b002e2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:41.843364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eccb1-9aed-4846-bfc8-683474b002e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:41.843636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f7eccb1-9aed-4846-bfc8-683474b002e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:41.844441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eccb1-9aed-4846-bfc8-683474b002e2 None admin] RBAC: Adding query filter params (role.id=80d4b3d42e60434b9994c77552e21e75, user.id=fa8dbb5bc6434625943c8b322969e6cb, scope.system=all) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:41.844750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eccb1-9aed-4846-bfc8-683474b002e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:41.846309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f7eccb1-9aed-4846-bfc8-683474b002e2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:41.852132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 161/310] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 24 14:12:41 2022] GET /identity/v3/role_assignments?user.id=fa8dbb5bc6434625943c8b322969e6cb&scope.system=all&role.id=80d4b3d42e60434b9994c77552e21e75 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:42.389592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb25e3b-628c-4bc0-873c-72554da446f5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:42.390159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb25e3b-628c-4bc0-873c-72554da446f5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:42.390438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb25e3b-628c-4bc0-873c-72554da446f5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:42.392434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 150/311] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:42.400045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6239de-1f20-4ddb-be3e-9bf493afe718 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:42.400477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6239de-1f20-4ddb-be3e-9bf493afe718 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:42.400861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6239de-1f20-4ddb-be3e-9bf493afe718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:42.425856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0d6239de-1f20-4ddb-be3e-9bf493afe718 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:42.427509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0d6239de-1f20-4ddb-be3e-9bf493afe718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:42.498858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 162/312] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:42.940442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb25e3b-628c-4bc0-873c-72554da446f5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:43.072783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb25e3b-628c-4bc0-873c-72554da446f5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:43.111577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab0bd0-df76-49ad-9340-d6969b2c291d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:43.112618 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab0bd0-df76-49ad-9340-d6969b2c291d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:43.113114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab0bd0-df76-49ad-9340-d6969b2c291d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:43.113576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acab0bd0-df76-49ad-9340-d6969b2c291d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:43.124236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acab0bd0-df76-49ad-9340-d6969b2c291d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-acab0bd0-df76-49ad-9340-d6969b2c291d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:43.129439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:43.130337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:43.131132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:43.133708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 151/313] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:43.141372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6239de-1f20-4ddb-be3e-9bf493afe718 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:43.226224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:43.277737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6239de-1f20-4ddb-be3e-9bf493afe718 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:43.322069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd88ecbf-c388-4d4f-877c-78b0a132655e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:43.322680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ecbf-c388-4d4f-877c-78b0a132655e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:43.322959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ecbf-c388-4d4f-877c-78b0a132655e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:43.323288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd88ecbf-c388-4d4f-877c-78b0a132655e None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:43.323959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ecbf-c388-4d4f-877c-78b0a132655e None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:43.324329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ecbf-c388-4d4f-877c-78b0a132655e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:43.325719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd88ecbf-c388-4d4f-877c-78b0a132655e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:43.338723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 163/314] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:43.345297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab0bd0-df76-49ad-9340-d6969b2c291d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:43.386254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:43.459347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acab0bd0-df76-49ad-9340-d6969b2c291d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:43.499562 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6b6e1-69da-4b6a-8e5b-757697c7d007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:43.500255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6b6e1-69da-4b6a-8e5b-757697c7d007 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:43.500550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6b6e1-69da-4b6a-8e5b-757697c7d007 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:43.500821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae6b6e1-69da-4b6a-8e5b-757697c7d007 None admin] PATH_INFO: `/v3/users/b13294e1ba384e3cb1684344c8e0e91b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:43.502531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6b6e1-69da-4b6a-8e5b-757697c7d007 None admin] RBAC: Authorizing `identity:get_user(user_id=b13294e1ba384e3cb1684344c8e0e91b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:43.504445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae6b6e1-69da-4b6a-8e5b-757697c7d007 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:43.505528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ffc6e-486b-4f2a-895b-4d1fcb68854e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:43.506023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ffc6e-486b-4f2a-895b-4d1fcb68854e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:43.506524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ffc6e-486b-4f2a-895b-4d1fcb68854e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:43.511870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 152/315] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:43 2022] GET /identity/v3/users/b13294e1ba384e3cb1684344c8e0e91b => generated 297 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:43.512338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6b6e1-69da-4b6a-8e5b-757697c7d007 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:43.512555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 164/316] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:43.513874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6564a4-4535-4500-8002-4b930cbf25de None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:43.514360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6564a4-4535-4500-8002-4b930cbf25de None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:43.514850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6564a4-4535-4500-8002-4b930cbf25de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:43.534982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6c6564a4-4535-4500-8002-4b930cbf25de None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:43.536225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6c6564a4-4535-4500-8002-4b930cbf25de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:43.620708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 165/317] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:43.632182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae6b6e1-69da-4b6a-8e5b-757697c7d007 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:43.633725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:43.663033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aded28c-b8f9-480c-8eaa-d2690defee96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:43.663835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aded28c-b8f9-480c-8eaa-d2690defee96 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:43.664221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aded28c-b8f9-480c-8eaa-d2690defee96 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:43.664572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aded28c-b8f9-480c-8eaa-d2690defee96 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:43.741022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aded28c-b8f9-480c-8eaa-d2690defee96 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:43.742793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aded28c-b8f9-480c-8eaa-d2690defee96 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:43.847062 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 153/318] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 14:12:43.853309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6564a4-4535-4500-8002-4b930cbf25de None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:43.906346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aded28c-b8f9-480c-8eaa-d2690defee96 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:43.910481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:43.917058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:43.971744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c6564a4-4535-4500-8002-4b930cbf25de None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:44.008621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e5a2f8-0c55-43cb-b652-94f8cac469a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:44.009257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a2f8-0c55-43cb-b652-94f8cac469a9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.009540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a2f8-0c55-43cb-b652-94f8cac469a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.009822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e5a2f8-0c55-43cb-b652-94f8cac469a9 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.010952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5a2f8-0c55-43cb-b652-94f8cac469a9 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:44.012424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e5a2f8-0c55-43cb-b652-94f8cac469a9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:44.014197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 166/319] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:43 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:44.015154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee03534-b9df-4a77-8d39-b3a7a4a8a336 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.015437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee03534-b9df-4a77-8d39-b3a7a4a8a336 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.015713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee03534-b9df-4a77-8d39-b3a7a4a8a336 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.021288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 167/320] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:44 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:44.021288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee03534-b9df-4a77-8d39-b3a7a4a8a336 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:44.026551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aded28c-b8f9-480c-8eaa-d2690defee96 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:44.077808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07feef5e-b5c2-415f-ab03-081e3d561413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:44.078702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feef5e-b5c2-415f-ab03-081e3d561413 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.078978 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feef5e-b5c2-415f-ab03-081e3d561413 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.079248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07feef5e-b5c2-415f-ab03-081e3d561413 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.090462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07feef5e-b5c2-415f-ab03-081e3d561413 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-07feef5e-b5c2-415f-ab03-081e3d561413 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:44.095323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:44.096760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:44.097590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 154/321] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:12:44.098236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43090e3-ccc0-4e48-9ed8-58489e129894 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.098301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43090e3-ccc0-4e48-9ed8-58489e129894 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.099215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43090e3-ccc0-4e48-9ed8-58489e129894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.118847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d43090e3-ccc0-4e48-9ed8-58489e129894 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:44.120038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d43090e3-ccc0-4e48-9ed8-58489e129894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:44.146485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee03534-b9df-4a77-8d39-b3a7a4a8a336 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:44.172293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:44.180425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:44.184731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41b4b63-35e8-4618-996f-3af3c9cbc4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:44.185325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b4b63-35e8-4618-996f-3af3c9cbc4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.185601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b4b63-35e8-4618-996f-3af3c9cbc4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.185872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41b4b63-35e8-4618-996f-3af3c9cbc4a1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.186584 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b4b63-35e8-4618-996f-3af3c9cbc4a1 None admin] RBAC: Adding query filter params (role.id=80d4b3d42e60434b9994c77552e21e75, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e, user.id=b13294e1ba384e3cb1684344c8e0e91b) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:44.186887 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b4b63-35e8-4618-996f-3af3c9cbc4a1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:44.188335 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41b4b63-35e8-4618-996f-3af3c9cbc4a1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:44.189184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 155/322] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:44.189993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43090e3-ccc0-4e48-9ed8-58489e129894 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:44.196797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 168/323] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:12:44 2022] GET /identity/v3/role_assignments?user.id=b13294e1ba384e3cb1684344c8e0e91b&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=80d4b3d42e60434b9994c77552e21e75 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:44.198179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae142a9-430d-41b9-95ba-d8a1ae78f9a7 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.198532 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae142a9-430d-41b9-95ba-d8a1ae78f9a7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.198878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae142a9-430d-41b9-95ba-d8a1ae78f9a7 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.200199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 169/324] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:44.206232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c77b-8b91-4af0-9264-093ecb7af03d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.215773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c77b-8b91-4af0-9264-093ecb7af03d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.215773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6767c77b-8b91-4af0-9264-093ecb7af03d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.233235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6767c77b-8b91-4af0-9264-093ecb7af03d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:44.235092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6767c77b-8b91-4af0-9264-093ecb7af03d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:44.320915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 170/325] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:44.342978 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43090e3-ccc0-4e48-9ed8-58489e129894 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:44.382102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceed06-5d86-4974-9c03-f7d439d7cd38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:44.383108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceed06-5d86-4974-9c03-f7d439d7cd38 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.383572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceed06-5d86-4974-9c03-f7d439d7cd38 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.384076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ceed06-5d86-4974-9c03-f7d439d7cd38 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.385057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceed06-5d86-4974-9c03-f7d439d7cd38 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:44.385541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceed06-5d86-4974-9c03-f7d439d7cd38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:44.387131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ceed06-5d86-4974-9c03-f7d439d7cd38 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:44.397143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 156/326] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:44.402992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767c77b-8b91-4af0-9264-093ecb7af03d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:44.459863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceed06-5d86-4974-9c03-f7d439d7cd38 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:44.528569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:44.530376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6767c77b-8b91-4af0-9264-093ecb7af03d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:44.547887 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:44.570556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937144e7-02a6-4368-926b-e44d678dd776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:44.571481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937144e7-02a6-4368-926b-e44d678dd776 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.571710 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937144e7-02a6-4368-926b-e44d678dd776 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.572093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-937144e7-02a6-4368-926b-e44d678dd776 None admin] PATH_INFO: `/v3/users/790690cd5e834816b90653101b49d59a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.573301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937144e7-02a6-4368-926b-e44d678dd776 None admin] RBAC: Authorizing `identity:get_user(user_id=790690cd5e834816b90653101b49d59a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:44.574732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-937144e7-02a6-4368-926b-e44d678dd776 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:44.575509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ceed06-5d86-4974-9c03-f7d439d7cd38 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:44.576521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 171/327] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:44 2022] GET /identity/v3/users/790690cd5e834816b90653101b49d59a => generated 293 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:44.582512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937144e7-02a6-4368-926b-e44d678dd776 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:44.614538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3ff62-c99c-4121-a410-2d00e4ccd772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:44.615170 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3ff62-c99c-4121-a410-2d00e4ccd772 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.615453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3ff62-c99c-4121-a410-2d00e4ccd772 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.615730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3ff62-c99c-4121-a410-2d00e4ccd772 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.616864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3ff62-c99c-4121-a410-2d00e4ccd772 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:44.618319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3ff62-c99c-4121-a410-2d00e4ccd772 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:44.619876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 157/328] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:12:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:44.620732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3ff62-c99c-4121-a410-2d00e4ccd772 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:44.687721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-937144e7-02a6-4368-926b-e44d678dd776 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:44.726898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf75b3-41d7-497d-b8dd-e2477e86fc8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:44.727494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf75b3-41d7-497d-b8dd-e2477e86fc8a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.727776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf75b3-41d7-497d-b8dd-e2477e86fc8a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.727925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3ff62-c99c-4121-a410-2d00e4ccd772 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:44.728044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eaf75b3-41d7-497d-b8dd-e2477e86fc8a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.728795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf75b3-41d7-497d-b8dd-e2477e86fc8a None admin] RBAC: Adding query filter params (role.id=a4c95292940e4d359d48ad72b390ece0, user.id=790690cd5e834816b90653101b49d59a, scope.system=all) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:44.729106 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf75b3-41d7-497d-b8dd-e2477e86fc8a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:44.730536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eaf75b3-41d7-497d-b8dd-e2477e86fc8a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:44.742320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 172/329] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 24 14:12:44 2022] GET /identity/v3/role_assignments?user.id=790690cd5e834816b90653101b49d59a&scope.system=all&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 510 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:44.743088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf75b3-41d7-497d-b8dd-e2477e86fc8a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:44.753178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:44.764828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d1d26-876b-4cfd-a9ba-e394bef0191b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:44.765667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d1d26-876b-4cfd-a9ba-e394bef0191b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.765786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d1d26-876b-4cfd-a9ba-e394bef0191b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.766015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-439d1d26-876b-4cfd-a9ba-e394bef0191b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.778030 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-439d1d26-876b-4cfd-a9ba-e394bef0191b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-439d1d26-876b-4cfd-a9ba-e394bef0191b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:44.783474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:44.784520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:44.785328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:44.789631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 158/330] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:44 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:44.790570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d1d26-876b-4cfd-a9ba-e394bef0191b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:44.797121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:44.863507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eaf75b3-41d7-497d-b8dd-e2477e86fc8a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:44.903580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa29a3-de69-41a1-b0a7-7f26eba1ba91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:44.903934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-439d1d26-876b-4cfd-a9ba-e394bef0191b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:44.904275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa29a3-de69-41a1-b0a7-7f26eba1ba91 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.904558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa29a3-de69-41a1-b0a7-7f26eba1ba91 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.904880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7fa29a3-de69-41a1-b0a7-7f26eba1ba91 None admin] PATH_INFO: `/v3/groups` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.905643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa29a3-de69-41a1-b0a7-7f26eba1ba91 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:44.907259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7fa29a3-de69-41a1-b0a7-7f26eba1ba91 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:44.932196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 173/331] 10.222.0.16 () {60 vars in 1134 bytes} [Sat Sep 24 14:12:44 2022] POST /identity/v3/groups => generated 226 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:12:44.942118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3c299-d0d0-4552-a015-a446be6575f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:44.942749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3c299-d0d0-4552-a015-a446be6575f8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:44.943031 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3c299-d0d0-4552-a015-a446be6575f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:44.943306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c3c299-d0d0-4552-a015-a446be6575f8 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:44.943992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3c299-d0d0-4552-a015-a446be6575f8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:44.944330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3c299-d0d0-4552-a015-a446be6575f8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:44.945760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c3c299-d0d0-4552-a015-a446be6575f8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:44.955405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 159/332] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:44 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:44.961358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa29a3-de69-41a1-b0a7-7f26eba1ba91 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:45.070822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7fa29a3-de69-41a1-b0a7-7f26eba1ba91 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:45.072484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:45.108119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd8a84-d9b5-4f87-be1b-03ae4136ba01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:45.108780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd8a84-d9b5-4f87-be1b-03ae4136ba01 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:45.109055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd8a84-d9b5-4f87-be1b-03ae4136ba01 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:45.109332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd8a84-d9b5-4f87-be1b-03ae4136ba01 None admin] PATH_INFO: `/v3/users/fa8dbb5bc6434625943c8b322969e6cb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:45.110463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd8a84-d9b5-4f87-be1b-03ae4136ba01 None admin] RBAC: Authorizing `identity:get_user(user_id=fa8dbb5bc6434625943c8b322969e6cb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:45.112484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbd8a84-d9b5-4f87-be1b-03ae4136ba01 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:45.114107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 174/333] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:44 2022] GET /identity/v3/users/fa8dbb5bc6434625943c8b322969e6cb => generated 293 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:45.119685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3c299-d0d0-4552-a015-a446be6575f8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:45.167694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:45.226355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c3c299-d0d0-4552-a015-a446be6575f8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:45.262474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c89b28-d790-4621-9e0e-67a1df9ab9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:45.263132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89b28-d790-4621-9e0e-67a1df9ab9bb None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:45.263414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89b28-d790-4621-9e0e-67a1df9ab9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:45.263691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c89b28-d790-4621-9e0e-67a1df9ab9bb None admin] PATH_INFO: `/v3/system/users/fa8dbb5bc6434625943c8b322969e6cb/roles/80d4b3d42e60434b9994c77552e21e75` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:45.265179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c89b28-d790-4621-9e0e-67a1df9ab9bb None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=fa8dbb5bc6434625943c8b322969e6cb, role_id=80d4b3d42e60434b9994c77552e21e75)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:45.266559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c89b28-d790-4621-9e0e-67a1df9ab9bb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:45.275401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 160/334] 10.222.0.16 () {58 vars in 1334 bytes} [Sat Sep 24 14:12:45 2022] PUT /identity/v3/system/users/fa8dbb5bc6434625943c8b322969e6cb/roles/80d4b3d42e60434b9994c77552e21e75 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:47.512173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d101598-6909-4245-a05c-de1475fecc9a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:47.512674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d101598-6909-4245-a05c-de1475fecc9a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:47.512747 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d101598-6909-4245-a05c-de1475fecc9a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:47.514397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 175/335] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:47.520609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5428c-75d1-474d-9044-ca3365ec8694 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:47.521109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5428c-75d1-474d-9044-ca3365ec8694 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:47.521214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c5428c-75d1-474d-9044-ca3365ec8694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:47.548492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-92c5428c-75d1-474d-9044-ca3365ec8694 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:47.549698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-92c5428c-75d1-474d-9044-ca3365ec8694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:47.629864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 161/336] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:47.844618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99c20-97c7-4f1d-988e-144d9d08132a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:47.845351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99c20-97c7-4f1d-988e-144d9d08132a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:47.845845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e99c20-97c7-4f1d-988e-144d9d08132a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:47.847636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 176/337] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:47.855088 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b4d0-4a11-40b4-8508-386816d7ec01 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:47.855379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b4d0-4a11-40b4-8508-386816d7ec01 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:47.855661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e5b4d0-4a11-40b4-8508-386816d7ec01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:47.881229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b7e5b4d0-4a11-40b4-8508-386816d7ec01 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:47.882447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b7e5b4d0-4a11-40b4-8508-386816d7ec01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:47.914967 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac07bdd-78b9-405a-a539-4040aaa7bb1e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:47.915494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac07bdd-78b9-405a-a539-4040aaa7bb1e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:47.915947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cac07bdd-78b9-405a-a539-4040aaa7bb1e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:47.917802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 177/338] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:47.924007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b80ec-01af-46f3-bd99-79510d10e6f2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:47.924547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b80ec-01af-46f3-bd99-79510d10e6f2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:47.924970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31b80ec-01af-46f3-bd99-79510d10e6f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:47.935059 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:47.953107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e31b80ec-01af-46f3-bd99-79510d10e6f2 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:47.955270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e31b80ec-01af-46f3-bd99-79510d10e6f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:47.985541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 162/339] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:48.052911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11703ead-e2e1-4314-991a-8b675d03e887 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:48.053547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11703ead-e2e1-4314-991a-8b675d03e887 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:48.054047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11703ead-e2e1-4314-991a-8b675d03e887 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:48.055855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 163/340] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:48.063674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a41ac-737a-4353-b3b0-329ef208695b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:48.064768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a41ac-737a-4353-b3b0-329ef208695b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:48.065242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86a41ac-737a-4353-b3b0-329ef208695b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:48.070967 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 178/341] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:48.101306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b86a41ac-737a-4353-b3b0-329ef208695b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:48.102813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b86a41ac-737a-4353-b3b0-329ef208695b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:48.116730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b80ec-01af-46f3-bd99-79510d10e6f2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:48.213617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 164/342] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:12:48.300128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31b80ec-01af-46f3-bd99-79510d10e6f2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:48.302010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:48.350149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596633cf-fcd8-4346-98e0-a3a997471e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:48.350797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596633cf-fcd8-4346-98e0-a3a997471e19 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:48.351173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596633cf-fcd8-4346-98e0-a3a997471e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:48.351499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596633cf-fcd8-4346-98e0-a3a997471e19 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:48.362243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-596633cf-fcd8-4346-98e0-a3a997471e19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-596633cf-fcd8-4346-98e0-a3a997471e19 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:48.371224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:48.372109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:48.373343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 179/343] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:12:48.378937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a41ac-737a-4353-b3b0-329ef208695b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:48.490895 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596633cf-fcd8-4346-98e0-a3a997471e19 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:48.522317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b86a41ac-737a-4353-b3b0-329ef208695b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:48.525318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:48.597787 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82263544-4fe5-48f3-acdc-59c8544b5469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:48.598412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82263544-4fe5-48f3-acdc-59c8544b5469 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:48.598688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82263544-4fe5-48f3-acdc-59c8544b5469 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:48.598957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82263544-4fe5-48f3-acdc-59c8544b5469 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:48.599617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82263544-4fe5-48f3-acdc-59c8544b5469 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:48.600187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82263544-4fe5-48f3-acdc-59c8544b5469 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:48.601865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82263544-4fe5-48f3-acdc-59c8544b5469 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:48.619801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 165/344] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:48.627188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82263544-4fe5-48f3-acdc-59c8544b5469 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:48.674510 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596633cf-fcd8-4346-98e0-a3a997471e19 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:48.722831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959abf80-8565-4f10-b025-54fdda6820f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:48.723533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abf80-8565-4f10-b025-54fdda6820f0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:48.723730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abf80-8565-4f10-b025-54fdda6820f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:48.724011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959abf80-8565-4f10-b025-54fdda6820f0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:48.734846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959abf80-8565-4f10-b025-54fdda6820f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-959abf80-8565-4f10-b025-54fdda6820f0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:48.742515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:48.743470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 180/345] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:48.744339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959abf80-8565-4f10-b025-54fdda6820f0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:48.768361 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:48.772860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82263544-4fe5-48f3-acdc-59c8544b5469 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:48.809131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cbc9f-bed2-46e6-a82c-e48b86873698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:48.810074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cbc9f-bed2-46e6-a82c-e48b86873698 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:48.810530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cbc9f-bed2-46e6-a82c-e48b86873698 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:48.810974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9cbc9f-bed2-46e6-a82c-e48b86873698 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:48.843807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:48.854139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959abf80-8565-4f10-b025-54fdda6820f0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:48.888022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cbc9f-bed2-46e6-a82c-e48b86873698 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:48.890029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc9cbc9f-bed2-46e6-a82c-e48b86873698 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:48.890313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c276bf5-0b7a-49c5-9d3c-257029bbdc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:48.891014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c276bf5-0b7a-49c5-9d3c-257029bbdc9c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:48.891359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c276bf5-0b7a-49c5-9d3c-257029bbdc9c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:48.891702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c276bf5-0b7a-49c5-9d3c-257029bbdc9c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:48.902445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c276bf5-0b7a-49c5-9d3c-257029bbdc9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-3c276bf5-0b7a-49c5-9d3c-257029bbdc9c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:48.907474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:48.909041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:48.909976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 181/346] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:48.915267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c276bf5-0b7a-49c5-9d3c-257029bbdc9c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:49.009193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 166/347] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:49.010332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cbc9f-bed2-46e6-a82c-e48b86873698 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:49.024550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:49.029512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c276bf5-0b7a-49c5-9d3c-257029bbdc9c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:49.067734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce694b8-2639-4d83-b842-058299f40afa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:49.068480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce694b8-2639-4d83-b842-058299f40afa None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:49.068830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce694b8-2639-4d83-b842-058299f40afa None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:49.069192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce694b8-2639-4d83-b842-058299f40afa None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:49.080568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:49.081446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce694b8-2639-4d83-b842-058299f40afa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5ce694b8-2639-4d83-b842-058299f40afa None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:49.087722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:49.088862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Sep 24 14:12:49.089647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:49.092099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 182/348] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:48 2022] GET /identity/v3/roles/reader => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:49.093344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce694b8-2639-4d83-b842-058299f40afa None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:49.124941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9cbc9f-bed2-46e6-a82c-e48b86873698 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:49.166206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8b6d5-fa90-41a0-9b06-a5ceaa0a81c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:49.167021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8b6d5-fa90-41a0-9b06-a5ceaa0a81c5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:49.167323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8b6d5-fa90-41a0-9b06-a5ceaa0a81c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:49.167652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db8b6d5-fa90-41a0-9b06-a5ceaa0a81c5 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:49.168577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8b6d5-fa90-41a0-9b06-a5ceaa0a81c5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:49.168869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8b6d5-fa90-41a0-9b06-a5ceaa0a81c5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:49.170305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db8b6d5-fa90-41a0-9b06-a5ceaa0a81c5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:49.180979 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 167/349] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:49.181816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8b6d5-fa90-41a0-9b06-a5ceaa0a81c5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:49.205820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce694b8-2639-4d83-b842-058299f40afa None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:49.244771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbb753-4d7e-4f25-a0f4-f065f479d80d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:49.245718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbb753-4d7e-4f25-a0f4-f065f479d80d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:49.246328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbb753-4d7e-4f25-a0f4-f065f479d80d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:49.246794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadbb753-4d7e-4f25-a0f4-f065f479d80d None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:49.247750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbb753-4d7e-4f25-a0f4-f065f479d80d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:49.248280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbb753-4d7e-4f25-a0f4-f065f479d80d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:49.249924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadbb753-4d7e-4f25-a0f4-f065f479d80d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:49.259249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 183/350] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:49.264501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbb753-4d7e-4f25-a0f4-f065f479d80d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:49.280520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:49.294593 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db8b6d5-fa90-41a0-9b06-a5ceaa0a81c5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:49.320401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:49.334216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0c85c-d7e6-45e3-aaa4-a1103e592d42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:49.334778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0c85c-d7e6-45e3-aaa4-a1103e592d42 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:49.335066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0c85c-d7e6-45e3-aaa4-a1103e592d42 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:49.335342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a0c85c-d7e6-45e3-aaa4-a1103e592d42 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:49.336513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0c85c-d7e6-45e3-aaa4-a1103e592d42 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:49.338021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a0c85c-d7e6-45e3-aaa4-a1103e592d42 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:49.339718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 168/351] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:49 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:49.340514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0c85c-d7e6-45e3-aaa4-a1103e592d42 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:49.384408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadbb753-4d7e-4f25-a0f4-f065f479d80d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:49.427860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98311f1-dce3-4d3f-b8cc-d282ab19d533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:49.428851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98311f1-dce3-4d3f-b8cc-d282ab19d533 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:49.429158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98311f1-dce3-4d3f-b8cc-d282ab19d533 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:49.429438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98311f1-dce3-4d3f-b8cc-d282ab19d533 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:49.430264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98311f1-dce3-4d3f-b8cc-d282ab19d533 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:49.430685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98311f1-dce3-4d3f-b8cc-d282ab19d533 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:49.432245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98311f1-dce3-4d3f-b8cc-d282ab19d533 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:49.446239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 184/352] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:49 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:49.447112 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98311f1-dce3-4d3f-b8cc-d282ab19d533 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:49.490259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a0c85c-d7e6-45e3-aaa4-a1103e592d42 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:49.528218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b1878-42f2-4044-a4e7-dd84308f1161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:49.528857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b1878-42f2-4044-a4e7-dd84308f1161 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:49.529089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b1878-42f2-4044-a4e7-dd84308f1161 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:49.529415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b1878-42f2-4044-a4e7-dd84308f1161 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:49.536764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:49.589657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98311f1-dce3-4d3f-b8cc-d282ab19d533 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:49.606603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:49.619555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b1878-42f2-4044-a4e7-dd84308f1161 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:49.621292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3b1878-42f2-4044-a4e7-dd84308f1161 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:49.633097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aefe1a-d05a-4281-87a1-f468a998c722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:49.633373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aefe1a-d05a-4281-87a1-f468a998c722 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:49.633658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aefe1a-d05a-4281-87a1-f468a998c722 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:49.633934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43aefe1a-d05a-4281-87a1-f468a998c722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:49.721762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aefe1a-d05a-4281-87a1-f468a998c722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:49.723289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43aefe1a-d05a-4281-87a1-f468a998c722 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:49.742260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 169/353] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:49.742952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b1878-42f2-4044-a4e7-dd84308f1161 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:49.797163 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:49.843824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 185/354] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:49.846471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aefe1a-d05a-4281-87a1-f468a998c722 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:49.859775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:49.872871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b1878-42f2-4044-a4e7-dd84308f1161 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:49.912761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b44c3-6c7e-43be-bb79-22be800a0dc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:49.914133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b44c3-6c7e-43be-bb79-22be800a0dc6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:49.914430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b44c3-6c7e-43be-bb79-22be800a0dc6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:49.914712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b44c3-6c7e-43be-bb79-22be800a0dc6 None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:49.920756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b44c3-6c7e-43be-bb79-22be800a0dc6 None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:49.922189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b44c3-6c7e-43be-bb79-22be800a0dc6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:49.924686 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 170/355] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:49 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:49.929485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4985b0b-8879-4332-8502-52574d4ab2a9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:49.929781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4985b0b-8879-4332-8502-52574d4ab2a9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:49.930066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4985b0b-8879-4332-8502-52574d4ab2a9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:49.931501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 171/356] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:49.932110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4985b0b-8879-4332-8502-52574d4ab2a9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:49.962726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43aefe1a-d05a-4281-87a1-f468a998c722 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:50.004502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f36ff10-8280-404f-92b9-28b4a83f1be2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:50.005149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ff10-8280-404f-92b9-28b4a83f1be2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.005426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ff10-8280-404f-92b9-28b4a83f1be2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.005698 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f36ff10-8280-404f-92b9-28b4a83f1be2 None admin] PATH_INFO: `/v3/users/fa8dbb5bc6434625943c8b322969e6cb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.008718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36ff10-8280-404f-92b9-28b4a83f1be2 None admin] RBAC: Authorizing `identity:get_user(user_id=fa8dbb5bc6434625943c8b322969e6cb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:50.008718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f36ff10-8280-404f-92b9-28b4a83f1be2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:50.009874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 186/357] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:12:49 2022] GET /identity/v3/users/fa8dbb5bc6434625943c8b322969e6cb => generated 293 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:50.010979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81761d-f4b2-415a-adb9-725eb710eefa None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.011269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81761d-f4b2-415a-adb9-725eb710eefa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.012499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf81761d-f4b2-415a-adb9-725eb710eefa None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.014617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 187/358] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:50.015795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81761d-f4b2-415a-adb9-725eb710eefa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:50.052302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:50.053497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4985b0b-8879-4332-8502-52574d4ab2a9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:50.095322 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68ac3-642d-42ce-8f8f-4e117c9e59cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:50.095753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68ac3-642d-42ce-8f8f-4e117c9e59cf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.096035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68ac3-642d-42ce-8f8f-4e117c9e59cf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.096366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e68ac3-642d-42ce-8f8f-4e117c9e59cf None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.098571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e68ac3-642d-42ce-8f8f-4e117c9e59cf None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:50.100329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e68ac3-642d-42ce-8f8f-4e117c9e59cf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:50.101983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 172/359] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:49 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:50.102745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68ac3-642d-42ce-8f8f-4e117c9e59cf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:50.132505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:50.146871 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf81761d-f4b2-415a-adb9-725eb710eefa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:50.192041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c9a2629-f6cb-4f1e-94d6-5ea7bb3e44cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:50.192718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a2629-f6cb-4f1e-94d6-5ea7bb3e44cd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.193003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a2629-f6cb-4f1e-94d6-5ea7bb3e44cd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.193280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c9a2629-f6cb-4f1e-94d6-5ea7bb3e44cd None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.194414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a2629-f6cb-4f1e-94d6-5ea7bb3e44cd None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:50.195845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c9a2629-f6cb-4f1e-94d6-5ea7bb3e44cd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:50.197631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 188/360] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:50 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:50.198768 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e6db-ffb0-421a-95ef-43b128e03be5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.199053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e6db-ffb0-421a-95ef-43b128e03be5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.199324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4e6db-ffb0-421a-95ef-43b128e03be5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.217463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1fd4e6db-ffb0-421a-95ef-43b128e03be5 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:50.218673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1fd4e6db-ffb0-421a-95ef-43b128e03be5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:50.222590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e68ac3-642d-42ce-8f8f-4e117c9e59cf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:50.261849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee74df-9794-4061-8f9a-ba615594aa78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:50.262379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee74df-9794-4061-8f9a-ba615594aa78 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.262667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee74df-9794-4061-8f9a-ba615594aa78 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.262943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8ee74df-9794-4061-8f9a-ba615594aa78 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.263674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee74df-9794-4061-8f9a-ba615594aa78 None admin] RBAC: Adding query filter params (group.id=3817ca24b42e4c7dbe197713f2389f6e, role.id=a4c95292940e4d359d48ad72b390ece0, scope.project.id=8940941bf57b4aeeabf404864a2b9d10) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:50.263990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee74df-9794-4061-8f9a-ba615594aa78 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:50.265489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8ee74df-9794-4061-8f9a-ba615594aa78 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:50.276188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 173/361] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 24 14:12:50 2022] GET /identity/v3/role_assignments?group.id=3817ca24b42e4c7dbe197713f2389f6e&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 260 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:50.276188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee74df-9794-4061-8f9a-ba615594aa78 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:50.313479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 189/362] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:50.315417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e351bbd-0d2e-4d46-91f6-530bb8f66dd0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.315636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e351bbd-0d2e-4d46-91f6-530bb8f66dd0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.315904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e351bbd-0d2e-4d46-91f6-530bb8f66dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.349074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9e351bbd-0d2e-4d46-91f6-530bb8f66dd0 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:50.350188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9e351bbd-0d2e-4d46-91f6-530bb8f66dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:50.392538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:50.409243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:50.431137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8ee74df-9794-4061-8f9a-ba615594aa78 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:50.441348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 190/363] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:50.442564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e351bbd-0d2e-4d46-91f6-530bb8f66dd0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:50.494812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50e723-ce6c-4c05-ad04-6268192b304b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:50.495428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50e723-ce6c-4c05-ad04-6268192b304b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.495710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50e723-ce6c-4c05-ad04-6268192b304b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.495982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e50e723-ce6c-4c05-ad04-6268192b304b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.496762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50e723-ce6c-4c05-ad04-6268192b304b None admin] RBAC: Adding query filter params (role.id=80d4b3d42e60434b9994c77552e21e75, user.id=fa8dbb5bc6434625943c8b322969e6cb, scope.system=all) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:50.497074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50e723-ce6c-4c05-ad04-6268192b304b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:50.498516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e50e723-ce6c-4c05-ad04-6268192b304b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:50.515057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 174/364] 10.222.0.16 () {56 vars in 1308 bytes} [Sat Sep 24 14:12:50 2022] GET /identity/v3/role_assignments?user.id=fa8dbb5bc6434625943c8b322969e6cb&scope.system=all&role.id=80d4b3d42e60434b9994c77552e21e75 => generated 510 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:50.515815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50e723-ce6c-4c05-ad04-6268192b304b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:50.575503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e351bbd-0d2e-4d46-91f6-530bb8f66dd0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:50.617378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b6d7b-f0ba-47e4-858a-e8cff093d7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:50.617918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b6d7b-f0ba-47e4-858a-e8cff093d7fd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.618206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b6d7b-f0ba-47e4-858a-e8cff093d7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.618494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b6d7b-f0ba-47e4-858a-e8cff093d7fd None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.619791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b6d7b-f0ba-47e4-858a-e8cff093d7fd None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:50.621316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0b6d7b-f0ba-47e4-858a-e8cff093d7fd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:50.623279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 191/365] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:50 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:50.630117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b6d7b-f0ba-47e4-858a-e8cff093d7fd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:50.663600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:50.692185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e50e723-ce6c-4c05-ad04-6268192b304b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:50.749257 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae23d2-7f76-484f-a8c3-951ffe55a96e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:50.750145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae23d2-7f76-484f-a8c3-951ffe55a96e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.750591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae23d2-7f76-484f-a8c3-951ffe55a96e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.751006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ae23d2-7f76-484f-a8c3-951ffe55a96e None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.752912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae23d2-7f76-484f-a8c3-951ffe55a96e None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:50.754492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ae23d2-7f76-484f-a8c3-951ffe55a96e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:50.755476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b6d7b-f0ba-47e4-858a-e8cff093d7fd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:50.757041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 175/366] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:50 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:50.757955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae23d2-7f76-484f-a8c3-951ffe55a96e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:50.781573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:50.800357 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111286b-6bf0-438a-b93b-a149268edfa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:50.800976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111286b-6bf0-438a-b93b-a149268edfa8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:50.801259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111286b-6bf0-438a-b93b-a149268edfa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:50.801539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4111286b-6bf0-438a-b93b-a149268edfa8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:50.802308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111286b-6bf0-438a-b93b-a149268edfa8 None admin] RBAC: Adding query filter params (group.id=3817ca24b42e4c7dbe197713f2389f6e, role.id=a4c95292940e4d359d48ad72b390ece0, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:50.802621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111286b-6bf0-438a-b93b-a149268edfa8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:50.804052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4111286b-6bf0-438a-b93b-a149268edfa8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:50.816297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 192/367] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 24 14:12:50 2022] GET /identity/v3/role_assignments?group.id=3817ca24b42e4c7dbe197713f2389f6e&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 260 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:50.817251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111286b-6bf0-438a-b93b-a149268edfa8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:50.925634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ae23d2-7f76-484f-a8c3-951ffe55a96e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:50.984910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:50.998596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4111286b-6bf0-438a-b93b-a149268edfa8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:51.010707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b77fec-b16b-4425-a879-d60a67c3357d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:51.011790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b77fec-b16b-4425-a879-d60a67c3357d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:51.012325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b77fec-b16b-4425-a879-d60a67c3357d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:51.012802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3b77fec-b16b-4425-a879-d60a67c3357d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:51.026005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3b77fec-b16b-4425-a879-d60a67c3357d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c3b77fec-b16b-4425-a879-d60a67c3357d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:51.032517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:51.033462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:51.034298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:51.037151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 176/368] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:51.038236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b77fec-b16b-4425-a879-d60a67c3357d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:51.044778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98e1ae-f17d-4622-a389-47dd4e1f7235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:51.045407 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98e1ae-f17d-4622-a389-47dd4e1f7235 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:51.045690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98e1ae-f17d-4622-a389-47dd4e1f7235 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:51.045969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d98e1ae-f17d-4622-a389-47dd4e1f7235 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:51.046732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98e1ae-f17d-4622-a389-47dd4e1f7235 None admin] RBAC: Adding query filter params (group.id=3817ca24b42e4c7dbe197713f2389f6e, role.id=4f8d839474214ed89390c34864229684, scope.project.id=8940941bf57b4aeeabf404864a2b9d10) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:51.047019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98e1ae-f17d-4622-a389-47dd4e1f7235 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:51.049039 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d98e1ae-f17d-4622-a389-47dd4e1f7235 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:51.058426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 193/369] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 24 14:12:50 2022] GET /identity/v3/role_assignments?group.id=3817ca24b42e4c7dbe197713f2389f6e&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=4f8d839474214ed89390c34864229684 => generated 260 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:51.062294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98e1ae-f17d-4622-a389-47dd4e1f7235 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:51.167160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:51.199344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3b77fec-b16b-4425-a879-d60a67c3357d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:51.242781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72f89b-1a6b-4aec-aa42-7da4ee32b80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:51.243802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72f89b-1a6b-4aec-aa42-7da4ee32b80c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:51.244327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72f89b-1a6b-4aec-aa42-7da4ee32b80c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:51.244806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f72f89b-1a6b-4aec-aa42-7da4ee32b80c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:51.259262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f72f89b-1a6b-4aec-aa42-7da4ee32b80c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7f72f89b-1a6b-4aec-aa42-7da4ee32b80c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:51.266655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:51.267683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:51.268527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:51.271658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 177/370] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:12:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:51.278231 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72f89b-1a6b-4aec-aa42-7da4ee32b80c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:51.314797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d98e1ae-f17d-4622-a389-47dd4e1f7235 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:51.357645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac31a2-bdc3-42c2-ab59-02f5c9a1c9aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:51.358669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac31a2-bdc3-42c2-ab59-02f5c9a1c9aa None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:51.359155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac31a2-bdc3-42c2-ab59-02f5c9a1c9aa None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:51.359628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ac31a2-bdc3-42c2-ab59-02f5c9a1c9aa None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:51.360551 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac31a2-bdc3-42c2-ab59-02f5c9a1c9aa None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:51.361153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac31a2-bdc3-42c2-ab59-02f5c9a1c9aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:51.362805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ac31a2-bdc3-42c2-ab59-02f5c9a1c9aa None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:51.372379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 194/371] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:51 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:51.379640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac31a2-bdc3-42c2-ab59-02f5c9a1c9aa None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:51.414664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:51.491985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f72f89b-1a6b-4aec-aa42-7da4ee32b80c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:51.537090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ac31a2-bdc3-42c2-ab59-02f5c9a1c9aa None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:51.568941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46513f5c-a87d-4fd5-8882-65192fb072ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:51.569492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46513f5c-a87d-4fd5-8882-65192fb072ac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:51.569774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46513f5c-a87d-4fd5-8882-65192fb072ac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:51.570046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46513f5c-a87d-4fd5-8882-65192fb072ac None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:51.570840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46513f5c-a87d-4fd5-8882-65192fb072ac None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:51.571015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46513f5c-a87d-4fd5-8882-65192fb072ac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:51.572443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46513f5c-a87d-4fd5-8882-65192fb072ac None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:51.577845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:51.585265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 178/372] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:51.586396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad5d7-93de-4b5b-97e4-6a21dcd58201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:51.587290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad5d7-93de-4b5b-97e4-6a21dcd58201 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:51.587791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad5d7-93de-4b5b-97e4-6a21dcd58201 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:51.588303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77ad5d7-93de-4b5b-97e4-6a21dcd58201 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:51.591326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46513f5c-a87d-4fd5-8882-65192fb072ac None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:51.696129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ad5d7-93de-4b5b-97e4-6a21dcd58201 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:51.698007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77ad5d7-93de-4b5b-97e4-6a21dcd58201 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:51.718159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:51.812925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 195/373] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 14:12:51.818757 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad5d7-93de-4b5b-97e4-6a21dcd58201 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:51.823879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46513f5c-a87d-4fd5-8882-65192fb072ac None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:51.899022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52691ba-be85-4605-a551-91461c3ece7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:51.899648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52691ba-be85-4605-a551-91461c3ece7b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:51.899925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52691ba-be85-4605-a551-91461c3ece7b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:51.900216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b52691ba-be85-4605-a551-91461c3ece7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:52.020855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77ad5d7-93de-4b5b-97e4-6a21dcd58201 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:52.042021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:52.046102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:52.047635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52691ba-be85-4605-a551-91461c3ece7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:52.049391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b52691ba-be85-4605-a551-91461c3ece7b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:52.080043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d98550-6913-4f5d-8964-27f4a14f5dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:52.080627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d98550-6913-4f5d-8964-27f4a14f5dde None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:52.080905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d98550-6913-4f5d-8964-27f4a14f5dde None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:52.081178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d98550-6913-4f5d-8964-27f4a14f5dde None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:52.082497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d98550-6913-4f5d-8964-27f4a14f5dde None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:52.083949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d98550-6913-4f5d-8964-27f4a14f5dde None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:52.096052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 196/374] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:51 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:52.098266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d98550-6913-4f5d-8964-27f4a14f5dde None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:52.254734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d98550-6913-4f5d-8964-27f4a14f5dde None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:52.286776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 179/375] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:52.293226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52691ba-be85-4605-a551-91461c3ece7b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:52.306954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59f9b-20d3-4e72-9276-9e6096595b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:52.307597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59f9b-20d3-4e72-9276-9e6096595b79 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:52.307872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59f9b-20d3-4e72-9276-9e6096595b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:52.308143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e59f9b-20d3-4e72-9276-9e6096595b79 None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:52.312325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e59f9b-20d3-4e72-9276-9e6096595b79 None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:52.313840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e59f9b-20d3-4e72-9276-9e6096595b79 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:52.315854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 197/376] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:52 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:52.321230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59f9b-20d3-4e72-9276-9e6096595b79 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:52.428596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:52.465856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:52.475546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b52691ba-be85-4605-a551-91461c3ece7b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:52.511698 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e59f9b-20d3-4e72-9276-9e6096595b79 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:52.545050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa3d52-4052-42db-889c-f6e73911a6e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:52.545697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3d52-4052-42db-889c-f6e73911a6e3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:52.545977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3d52-4052-42db-889c-f6e73911a6e3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:52.546256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfa3d52-4052-42db-889c-f6e73911a6e3 None admin] PATH_INFO: `/v3/projects/2c480881ed7348f895e92a35f216f258` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:52.550373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa3d52-4052-42db-889c-f6e73911a6e3 None admin] RBAC: Authorizing `identity:get_project(project_id=2c480881ed7348f895e92a35f216f258)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:52.551855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfa3d52-4052-42db-889c-f6e73911a6e3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:52.555108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 180/377] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:52 2022] GET /identity/v3/projects/2c480881ed7348f895e92a35f216f258 => generated 344 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:52.560735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa3d52-4052-42db-889c-f6e73911a6e3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:52.584890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10cdbb-bdca-45d8-9370-17cc3becdeec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:52.585850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10cdbb-bdca-45d8-9370-17cc3becdeec None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:52.586334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10cdbb-bdca-45d8-9370-17cc3becdeec None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:52.586805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e10cdbb-bdca-45d8-9370-17cc3becdeec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:52.587872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10cdbb-bdca-45d8-9370-17cc3becdeec None admin] RBAC: Adding query filter params (group.id=3817ca24b42e4c7dbe197713f2389f6e, role.id=4f8d839474214ed89390c34864229684, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:52.588423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10cdbb-bdca-45d8-9370-17cc3becdeec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:52.590132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e10cdbb-bdca-45d8-9370-17cc3becdeec None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:52.601100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 198/378] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 24 14:12:52 2022] GET /identity/v3/role_assignments?group.id=3817ca24b42e4c7dbe197713f2389f6e&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=4f8d839474214ed89390c34864229684 => generated 260 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:52.699040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfa3d52-4052-42db-889c-f6e73911a6e3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:52.740459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48796c2f-e426-43f3-ab48-2a85d288b0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:52.741165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48796c2f-e426-43f3-ab48-2a85d288b0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:52.741496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48796c2f-e426-43f3-ab48-2a85d288b0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:52.741774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48796c2f-e426-43f3-ab48-2a85d288b0b0 None admin] PATH_INFO: `/v3/groups/4aac6a96cca848b6a3042e6bcdc2a5cf` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:52.746982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48796c2f-e426-43f3-ab48-2a85d288b0b0 None admin] RBAC: Authorizing `identity:get_group(group_id=4aac6a96cca848b6a3042e6bcdc2a5cf)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:52.748470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48796c2f-e426-43f3-ab48-2a85d288b0b0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:52.750373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 181/379] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:52 2022] GET /identity/v3/groups/4aac6a96cca848b6a3042e6bcdc2a5cf => generated 229 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:52.756064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10cdbb-bdca-45d8-9370-17cc3becdeec None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:52.870501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e10cdbb-bdca-45d8-9370-17cc3becdeec None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:52.888745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:52.907021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa44d578-6ea5-4dec-9152-1def16fef1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:52.907689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d578-6ea5-4dec-9152-1def16fef1df None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:52.907970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d578-6ea5-4dec-9152-1def16fef1df None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:52.908277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa44d578-6ea5-4dec-9152-1def16fef1df None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:52.909236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44d578-6ea5-4dec-9152-1def16fef1df None admin] RBAC: Adding query filter params (group.id=4aac6a96cca848b6a3042e6bcdc2a5cf, role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=2c480881ed7348f895e92a35f216f258) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:52.909833 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44d578-6ea5-4dec-9152-1def16fef1df None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:52.911258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa44d578-6ea5-4dec-9152-1def16fef1df None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:52.917377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 199/380] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 24 14:12:52 2022] GET /identity/v3/role_assignments?group.id=4aac6a96cca848b6a3042e6bcdc2a5cf&scope.project.id=2c480881ed7348f895e92a35f216f258&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 260 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:53.138293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa6412-b43a-487f-8e2f-882d0d6fb949 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:53.138858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa6412-b43a-487f-8e2f-882d0d6fb949 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:53.138858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23aa6412-b43a-487f-8e2f-882d0d6fb949 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:53.140662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 182/381] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:53.156245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602e92c-0739-47cf-b32e-e1c7ed6322a5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:53.156890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602e92c-0739-47cf-b32e-e1c7ed6322a5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:53.157365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4602e92c-0739-47cf-b32e-e1c7ed6322a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:53.183611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4602e92c-0739-47cf-b32e-e1c7ed6322a5 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:53.185210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4602e92c-0739-47cf-b32e-e1c7ed6322a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:53.267465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 200/382] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:53.596952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa6412-b43a-487f-8e2f-882d0d6fb949 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:53.639517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:53.696728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aa5da-ddea-4e7f-882b-222a4ae2150b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:53.697560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aa5da-ddea-4e7f-882b-222a4ae2150b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:53.698074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388aa5da-ddea-4e7f-882b-222a4ae2150b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:53.699917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 201/383] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:53.705699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56a479-2ac5-4c30-9f21-ba91edb1e6b9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:53.706306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56a479-2ac5-4c30-9f21-ba91edb1e6b9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:53.706791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f56a479-2ac5-4c30-9f21-ba91edb1e6b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:53.735380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6f56a479-2ac5-4c30-9f21-ba91edb1e6b9 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:53.737069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6f56a479-2ac5-4c30-9f21-ba91edb1e6b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:53.741748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23aa6412-b43a-487f-8e2f-882d0d6fb949 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:53.797142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b2f242-9b6d-4ce0-9fee-a706346790e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:53.797781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2f242-9b6d-4ce0-9fee-a706346790e5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:53.798623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2f242-9b6d-4ce0-9fee-a706346790e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:53.798909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b2f242-9b6d-4ce0-9fee-a706346790e5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:53.820221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b2f242-9b6d-4ce0-9fee-a706346790e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-51b2f242-9b6d-4ce0-9fee-a706346790e5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:53.827385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:53.828655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:53.829759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:53.836332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 183/384] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:53.837507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b6ce-7586-455b-922d-fdc9dad4e2b7 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:53.837792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b6ce-7586-455b-922d-fdc9dad4e2b7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:53.838066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3255b6ce-7586-455b-922d-fdc9dad4e2b7 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:53.840300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 184/385] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:53.845758 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255b6ce-7586-455b-922d-fdc9dad4e2b7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:53.856800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 202/386] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:53.864712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae33822-ec6a-43d4-98a6-2e3f3c6e30cf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:53.864712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae33822-ec6a-43d4-98a6-2e3f3c6e30cf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:53.864712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae33822-ec6a-43d4-98a6-2e3f3c6e30cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:53.896200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2ae33822-ec6a-43d4-98a6-2e3f3c6e30cf None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:53.897425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2ae33822-ec6a-43d4-98a6-2e3f3c6e30cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:53.974495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:54.014517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:54.015975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 203/387] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:54.041483 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3255b6ce-7586-455b-922d-fdc9dad4e2b7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:54.091730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e18f29-d4d6-4284-a66f-945af0ebbfdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:54.092395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e18f29-d4d6-4284-a66f-945af0ebbfdc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:54.092687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e18f29-d4d6-4284-a66f-945af0ebbfdc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:54.092956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e18f29-d4d6-4284-a66f-945af0ebbfdc None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:54.093615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e18f29-d4d6-4284-a66f-945af0ebbfdc None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:54.093921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e18f29-d4d6-4284-a66f-945af0ebbfdc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:54.095354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e18f29-d4d6-4284-a66f-945af0ebbfdc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:54.107053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 185/388] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:54.112844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae33822-ec6a-43d4-98a6-2e3f3c6e30cf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:54.170465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e18f29-d4d6-4284-a66f-945af0ebbfdc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:54.280093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae33822-ec6a-43d4-98a6-2e3f3c6e30cf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:54.312817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e18f29-d4d6-4284-a66f-945af0ebbfdc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:54.347308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc65c4a-b6eb-4814-be23-c69116714b68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:54.348058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65c4a-b6eb-4814-be23-c69116714b68 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:54.348382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65c4a-b6eb-4814-be23-c69116714b68 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:54.348659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc65c4a-b6eb-4814-be23-c69116714b68 None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:54.350299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc65c4a-b6eb-4814-be23-c69116714b68 None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:54.351733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dc65c4a-b6eb-4814-be23-c69116714b68 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:54.354179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 204/389] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:54 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:54.355287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc65c4a-b6eb-4814-be23-c69116714b68 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:54.370089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb57096-1d49-46b6-9ad0-662042453fd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:54.371159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb57096-1d49-46b6-9ad0-662042453fd9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:54.371644 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb57096-1d49-46b6-9ad0-662042453fd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:54.372183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb57096-1d49-46b6-9ad0-662042453fd9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:54.384102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb57096-1d49-46b6-9ad0-662042453fd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-4bb57096-1d49-46b6-9ad0-662042453fd9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:54.390104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:54.390981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:54.391830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:54.394474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 186/390] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:12:54.400382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb57096-1d49-46b6-9ad0-662042453fd9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:54.403245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:54.415644 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:54.464176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc65c4a-b6eb-4814-be23-c69116714b68 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:54.509904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff0f1f-29ed-4391-9d93-d265c376b51d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:54.510541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff0f1f-29ed-4391-9d93-d265c376b51d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:54.510825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff0f1f-29ed-4391-9d93-d265c376b51d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:54.511100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bff0f1f-29ed-4391-9d93-d265c376b51d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:54.512078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb57096-1d49-46b6-9ad0-662042453fd9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:54.522580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bff0f1f-29ed-4391-9d93-d265c376b51d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0bff0f1f-29ed-4391-9d93-d265c376b51d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:54.528764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:54.529685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:54.530527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 205/391] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:54 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:54.531193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff0f1f-29ed-4391-9d93-d265c376b51d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:54.553305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c3b37-aafb-4d99-8ee3-9437c1922381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:54.554373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3b37-aafb-4d99-8ee3-9437c1922381 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:54.554875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3b37-aafb-4d99-8ee3-9437c1922381 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:54.555354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c3b37-aafb-4d99-8ee3-9437c1922381 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:54.556794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c3b37-aafb-4d99-8ee3-9437c1922381 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:54.558598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c3b37-aafb-4d99-8ee3-9437c1922381 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:54.560691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 187/392] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:54 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:54.561696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c3b37-aafb-4d99-8ee3-9437c1922381 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:54.636458 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:54.639192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bff0f1f-29ed-4391-9d93-d265c376b51d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:54.648561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:54.671445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c3b37-aafb-4d99-8ee3-9437c1922381 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:54.675596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e8b9d-ed98-4545-a7d2-de9803535036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:54.676249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e8b9d-ed98-4545-a7d2-de9803535036 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:54.676540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e8b9d-ed98-4545-a7d2-de9803535036 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:54.676821 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295e8b9d-ed98-4545-a7d2-de9803535036 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:54.677541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e8b9d-ed98-4545-a7d2-de9803535036 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:54.677854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e8b9d-ed98-4545-a7d2-de9803535036 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:54.679288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295e8b9d-ed98-4545-a7d2-de9803535036 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:54.692728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 206/393] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:54.692728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e8b9d-ed98-4545-a7d2-de9803535036 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:54.716744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d9f7e-eb89-4997-b165-af2fd1306a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:54.717708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d9f7e-eb89-4997-b165-af2fd1306a6c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:54.718341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d9f7e-eb89-4997-b165-af2fd1306a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:54.718830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25d9f7e-eb89-4997-b165-af2fd1306a6c None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:54.719768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d9f7e-eb89-4997-b165-af2fd1306a6c None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:54.720380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d9f7e-eb89-4997-b165-af2fd1306a6c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:54.722047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25d9f7e-eb89-4997-b165-af2fd1306a6c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:54.731734 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 188/394] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:54 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:54.732862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d9f7e-eb89-4997-b165-af2fd1306a6c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:54.801591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295e8b9d-ed98-4545-a7d2-de9803535036 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:54.838943 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb2e82-76fe-46bb-960a-f897d9862a5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:54.839615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb2e82-76fe-46bb-960a-f897d9862a5e None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:54.839902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb2e82-76fe-46bb-960a-f897d9862a5e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:54.840218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfb2e82-76fe-46bb-960a-f897d9862a5e None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10/groups/3817ca24b42e4c7dbe197713f2389f6e/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:54.842167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25d9f7e-eb89-4997-b165-af2fd1306a6c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:54.842296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb2e82-76fe-46bb-960a-f897d9862a5e None admin] RBAC: Authorizing `identity:create_grant(project_id=8940941bf57b4aeeabf404864a2b9d10, group_id=3817ca24b42e4c7dbe197713f2389f6e, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:54.843622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfb2e82-76fe-46bb-960a-f897d9862a5e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:54.868387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 207/395] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 24 14:12:54 2022] PUT /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10/groups/3817ca24b42e4c7dbe197713f2389f6e/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:54.869643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb2e82-76fe-46bb-960a-f897d9862a5e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:54.880097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f05d32-a3a6-4489-b13b-2d6ea84f8690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:54.881162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f05d32-a3a6-4489-b13b-2d6ea84f8690 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:54.881735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f05d32-a3a6-4489-b13b-2d6ea84f8690 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:54.882204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f05d32-a3a6-4489-b13b-2d6ea84f8690 None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:54.886282 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f05d32-a3a6-4489-b13b-2d6ea84f8690 None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:54.888112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f05d32-a3a6-4489-b13b-2d6ea84f8690 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:54.890396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 189/396] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:54 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:54.899153 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f05d32-a3a6-4489-b13b-2d6ea84f8690 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:54.921021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:54.925167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:55.094394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfb2e82-76fe-46bb-960a-f897d9862a5e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:55.103748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f05d32-a3a6-4489-b13b-2d6ea84f8690 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:55.139819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fde99a-3704-4893-9557-6754de33f8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:55.140515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fde99a-3704-4893-9557-6754de33f8fa None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:55.140800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fde99a-3704-4893-9557-6754de33f8fa None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:55.141078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4fde99a-3704-4893-9557-6754de33f8fa None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:55.142732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fde99a-3704-4893-9557-6754de33f8fa None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:55.144309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4fde99a-3704-4893-9557-6754de33f8fa None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:55.144572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8b68a-6c3d-4144-8bb0-be9ce84be389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:55.145408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8b68a-6c3d-4144-8bb0-be9ce84be389 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:55.145925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8b68a-6c3d-4144-8bb0-be9ce84be389 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:55.146391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d8b68a-6c3d-4144-8bb0-be9ce84be389 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:55.147739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8b68a-6c3d-4144-8bb0-be9ce84be389 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:55.148642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 208/397] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:54 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:55.150122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d8b68a-6c3d-4144-8bb0-be9ce84be389 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:55.151390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fde99a-3704-4893-9557-6754de33f8fa None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:55.152510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 190/398] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:54 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:55.158765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8b68a-6c3d-4144-8bb0-be9ce84be389 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:55.267849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:55.279556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4fde99a-3704-4893-9557-6754de33f8fa None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:55.306339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:55.324507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a2ff5c-784f-4a4f-92f4-259cc422cf12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:55.325630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ff5c-784f-4a4f-92f4-259cc422cf12 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:55.326504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ff5c-784f-4a4f-92f4-259cc422cf12 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:55.327277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a2ff5c-784f-4a4f-92f4-259cc422cf12 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:55.328798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2ff5c-784f-4a4f-92f4-259cc422cf12 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:55.331029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a2ff5c-784f-4a4f-92f4-259cc422cf12 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:55.331801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d8b68a-6c3d-4144-8bb0-be9ce84be389 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:55.333772 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 209/399] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:55 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:55.335225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3768f7e-28c6-4a86-9639-f236ef7de6ae None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:55.335713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3768f7e-28c6-4a86-9639-f236ef7de6ae None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:55.336208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3768f7e-28c6-4a86-9639-f236ef7de6ae None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:55.337972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 210/400] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:55.338936 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3768f7e-28c6-4a86-9639-f236ef7de6ae None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:55.384011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd4e9e27-c38f-405e-ab0b-3e717df55cc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:55.384633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e9e27-c38f-405e-ab0b-3e717df55cc0 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:55.384906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e9e27-c38f-405e-ab0b-3e717df55cc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:55.385181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd4e9e27-c38f-405e-ab0b-3e717df55cc0 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10/groups/3817ca24b42e4c7dbe197713f2389f6e/roles/4f8d839474214ed89390c34864229684` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:55.387401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e9e27-c38f-405e-ab0b-3e717df55cc0 None admin] RBAC: Authorizing `identity:create_grant(project_id=8940941bf57b4aeeabf404864a2b9d10, group_id=3817ca24b42e4c7dbe197713f2389f6e, role_id=4f8d839474214ed89390c34864229684)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:55.389390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd4e9e27-c38f-405e-ab0b-3e717df55cc0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:55.404894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 191/401] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 24 14:12:55 2022] PUT /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10/groups/3817ca24b42e4c7dbe197713f2389f6e/roles/4f8d839474214ed89390c34864229684 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:12:55.406345 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba24c8a-455c-437c-9d2b-328cf34e9743 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:55.406632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba24c8a-455c-437c-9d2b-328cf34e9743 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:55.406904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba24c8a-455c-437c-9d2b-328cf34e9743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:55.433757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0ba24c8a-455c-437c-9d2b-328cf34e9743 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:55.435190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0ba24c8a-455c-437c-9d2b-328cf34e9743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:55.477101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3768f7e-28c6-4a86-9639-f236ef7de6ae None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:55.525859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d20a9-9eb4-4b87-aaa8-d8a697509090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:55.527019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 192/402] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:55.527223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d20a9-9eb4-4b87-aaa8-d8a697509090 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:55.527683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d20a9-9eb4-4b87-aaa8-d8a697509090 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:55.528210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467d20a9-9eb4-4b87-aaa8-d8a697509090 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/groups/3817ca24b42e4c7dbe197713f2389f6e/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:55.530483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d20a9-9eb4-4b87-aaa8-d8a697509090 None admin] RBAC: Authorizing `identity:create_grant(project_id=6d2a6809aef84ed58cd8ac0e168a051e, group_id=3817ca24b42e4c7dbe197713f2389f6e, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:55.532258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467d20a9-9eb4-4b87-aaa8-d8a697509090 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:55.533989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fe0b-84d6-4a0e-b891-e0737b2a9349 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:55.534346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fe0b-84d6-4a0e-b891-e0737b2a9349 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:55.534690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b209fe0b-84d6-4a0e-b891-e0737b2a9349 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:55.536809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 193/403] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:55 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:55.542780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb554b-3846-4388-8ba3-78ad31aff2bb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:55.543938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb554b-3846-4388-8ba3-78ad31aff2bb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:55.543938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fb554b-3846-4388-8ba3-78ad31aff2bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:55.555607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 211/404] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 24 14:12:55 2022] PUT /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/groups/3817ca24b42e4c7dbe197713f2389f6e/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:55.581921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-09fb554b-3846-4388-8ba3-78ad31aff2bb None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:55.583273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-09fb554b-3846-4388-8ba3-78ad31aff2bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:55.665774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:55.676229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 194/405] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:55.844380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d20a9-9eb4-4b87-aaa8-d8a697509090 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:55.865916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:55.952036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467d20a9-9eb4-4b87-aaa8-d8a697509090 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:55.988209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad707f2a-52d4-4b3c-b9d6-e9c93ff270d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:55.988858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad707f2a-52d4-4b3c-b9d6-e9c93ff270d7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:55.989143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad707f2a-52d4-4b3c-b9d6-e9c93ff270d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:55.989414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad707f2a-52d4-4b3c-b9d6-e9c93ff270d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:55.999814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad707f2a-52d4-4b3c-b9d6-e9c93ff270d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:56.003488 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb554b-3846-4388-8ba3-78ad31aff2bb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ad707f2a-52d4-4b3c-b9d6-e9c93ff270d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:56.004789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:56.005682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:56.006497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:56.010706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 212/406] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:56.012559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad707f2a-52d4-4b3c-b9d6-e9c93ff270d7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:56.098583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:56.121288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad707f2a-52d4-4b3c-b9d6-e9c93ff270d7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:56.159808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5ad55-f5d8-4b74-8388-75162a9cf6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:56.160563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5ad55-f5d8-4b74-8388-75162a9cf6da None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:56.160913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5ad55-f5d8-4b74-8388-75162a9cf6da None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:56.161261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b5ad55-f5d8-4b74-8388-75162a9cf6da None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:56.162055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5ad55-f5d8-4b74-8388-75162a9cf6da None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:56.162433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5ad55-f5d8-4b74-8388-75162a9cf6da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:56.163886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31b5ad55-f5d8-4b74-8388-75162a9cf6da None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:56.178508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 213/407] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:56.179761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5ad55-f5d8-4b74-8388-75162a9cf6da None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:56.238107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fb554b-3846-4388-8ba3-78ad31aff2bb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:56.293811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b5ad55-f5d8-4b74-8388-75162a9cf6da None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:56.329304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b6cbc-f0d4-48dc-aaba-744ef4625122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:56.330446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b6cbc-f0d4-48dc-aaba-744ef4625122 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:56.330730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b6cbc-f0d4-48dc-aaba-744ef4625122 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:56.331032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6b6cbc-f0d4-48dc-aaba-744ef4625122 None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:56.332229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b6cbc-f0d4-48dc-aaba-744ef4625122 None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:56.333795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e6b6cbc-f0d4-48dc-aaba-744ef4625122 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:56.336857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ba879-1ce1-4848-816e-5affbf2c586d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:56.337511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba879-1ce1-4848-816e-5affbf2c586d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:56.337793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba879-1ce1-4848-816e-5affbf2c586d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:56.338067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435ba879-1ce1-4848-816e-5affbf2c586d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:56.339980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 214/408] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:56 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:56.341155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b6cbc-f0d4-48dc-aaba-744ef4625122 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:56.356535 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:56.372237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435ba879-1ce1-4848-816e-5affbf2c586d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-435ba879-1ce1-4848-816e-5affbf2c586d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:56.385280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:56.386201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:56.386989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 195/409] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:12:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:56.394370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ba879-1ce1-4848-816e-5affbf2c586d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:56.451600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6b6cbc-f0d4-48dc-aaba-744ef4625122 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:56.501287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e012b2-21ec-4ce2-947e-6200babdd8e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:56.501927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e012b2-21ec-4ce2-947e-6200babdd8e1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:56.502227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e012b2-21ec-4ce2-947e-6200babdd8e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:56.502509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61e012b2-21ec-4ce2-947e-6200babdd8e1 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:56.503661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e012b2-21ec-4ce2-947e-6200babdd8e1 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:56.505367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61e012b2-21ec-4ce2-947e-6200babdd8e1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:56.507458 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 215/410] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:56 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:12:56.513754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e012b2-21ec-4ce2-947e-6200babdd8e1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:56.549888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:56.612600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:56.626280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61e012b2-21ec-4ce2-947e-6200babdd8e1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:56.663570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3484a-59b5-4ef0-8a5e-b961d6cb740e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:56.664345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3484a-59b5-4ef0-8a5e-b961d6cb740e None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:56.664632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3484a-59b5-4ef0-8a5e-b961d6cb740e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:56.664962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd3484a-59b5-4ef0-8a5e-b961d6cb740e None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/groups/3817ca24b42e4c7dbe197713f2389f6e/roles/4f8d839474214ed89390c34864229684` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:56.667155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3484a-59b5-4ef0-8a5e-b961d6cb740e None admin] RBAC: Authorizing `identity:create_grant(project_id=6d2a6809aef84ed58cd8ac0e168a051e, group_id=3817ca24b42e4c7dbe197713f2389f6e, role_id=4f8d839474214ed89390c34864229684)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:56.668767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd3484a-59b5-4ef0-8a5e-b961d6cb740e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:56.674486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435ba879-1ce1-4848-816e-5affbf2c586d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:56.696650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 216/411] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 24 14:12:56 2022] PUT /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e/groups/3817ca24b42e4c7dbe197713f2389f6e/roles/4f8d839474214ed89390c34864229684 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:56.747033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c71888-8ff0-4df1-9942-cb6acc2f569f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:56.747719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c71888-8ff0-4df1-9942-cb6acc2f569f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:56.748048 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c71888-8ff0-4df1-9942-cb6acc2f569f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:56.748403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c71888-8ff0-4df1-9942-cb6acc2f569f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:56.749122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c71888-8ff0-4df1-9942-cb6acc2f569f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:56.749428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c71888-8ff0-4df1-9942-cb6acc2f569f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:56.751179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c71888-8ff0-4df1-9942-cb6acc2f569f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:56.768779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 196/412] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 374 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:56.774056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3484a-59b5-4ef0-8a5e-b961d6cb740e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:56.918650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd3484a-59b5-4ef0-8a5e-b961d6cb740e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:56.957212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d487e-59ef-4a8a-822e-a209c872da97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:56.958690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d487e-59ef-4a8a-822e-a209c872da97 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:56.959205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d487e-59ef-4a8a-822e-a209c872da97 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:56.959692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d487e-59ef-4a8a-822e-a209c872da97 None admin] PATH_INFO: `/v3/groups/4aac6a96cca848b6a3042e6bcdc2a5cf` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:56.961126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d487e-59ef-4a8a-822e-a209c872da97 None admin] RBAC: Authorizing `identity:get_group(group_id=4aac6a96cca848b6a3042e6bcdc2a5cf)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:56.962784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d487e-59ef-4a8a-822e-a209c872da97 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:56.965011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 217/413] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:56 2022] GET /identity/v3/groups/4aac6a96cca848b6a3042e6bcdc2a5cf => generated 229 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:56.973691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c71888-8ff0-4df1-9942-cb6acc2f569f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:57.093183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c71888-8ff0-4df1-9942-cb6acc2f569f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:57.119990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:57.150291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921b078-e812-43b3-a6d0-d6d33480b252 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:57.150931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921b078-e812-43b3-a6d0-d6d33480b252 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:57.151208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921b078-e812-43b3-a6d0-d6d33480b252 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:57.151474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921b078-e812-43b3-a6d0-d6d33480b252 None admin] PATH_INFO: `/v3/projects/2c480881ed7348f895e92a35f216f258` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:57.152697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921b078-e812-43b3-a6d0-d6d33480b252 None admin] RBAC: Authorizing `identity:get_project(project_id=2c480881ed7348f895e92a35f216f258)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:57.154133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921b078-e812-43b3-a6d0-d6d33480b252 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:57.155747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 197/414] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:56 2022] GET /identity/v3/projects/2c480881ed7348f895e92a35f216f258 => generated 344 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:57.162281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d487e-59ef-4a8a-822e-a209c872da97 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:57.166222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:57.302619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d487e-59ef-4a8a-822e-a209c872da97 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:57.358785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2fc0ef-7430-4060-ab22-d98e1551554b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:57.359795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fc0ef-7430-4060-ab22-d98e1551554b None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:57.360306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fc0ef-7430-4060-ab22-d98e1551554b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:57.360805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2fc0ef-7430-4060-ab22-d98e1551554b None admin] PATH_INFO: `/v3/projects/2c480881ed7348f895e92a35f216f258/groups/4aac6a96cca848b6a3042e6bcdc2a5cf/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:57.365376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fc0ef-7430-4060-ab22-d98e1551554b None admin] RBAC: Authorizing `identity:create_grant(project_id=2c480881ed7348f895e92a35f216f258, group_id=4aac6a96cca848b6a3042e6bcdc2a5cf, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:57.367043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2fc0ef-7430-4060-ab22-d98e1551554b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:57.393857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 218/415] 10.222.0.16 () {58 vars in 1442 bytes} [Sat Sep 24 14:12:57 2022] PUT /identity/v3/projects/2c480881ed7348f895e92a35f216f258/groups/4aac6a96cca848b6a3042e6bcdc2a5cf/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:12:57.623465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb77d-dd23-43dc-aa47-8412989a6d49 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:57.623984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb77d-dd23-43dc-aa47-8412989a6d49 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:57.623984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986fb77d-dd23-43dc-aa47-8412989a6d49 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:57.625648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 198/416] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:57.632263 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324773f9-4609-4ab9-b298-dd24ea8ab067 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:57.632575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324773f9-4609-4ab9-b298-dd24ea8ab067 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:57.632881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324773f9-4609-4ab9-b298-dd24ea8ab067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:57.651473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-324773f9-4609-4ab9-b298-dd24ea8ab067 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:57.652696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-324773f9-4609-4ab9-b298-dd24ea8ab067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:57.717085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:57.726892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 219/417] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:58.055039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fb77d-dd23-43dc-aa47-8412989a6d49 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:58.198941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986fb77d-dd23-43dc-aa47-8412989a6d49 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:58.204664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3878fb-5de4-4cb2-a052-48f540c72795 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:58.205105 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3878fb-5de4-4cb2-a052-48f540c72795 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:58.205281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3878fb-5de4-4cb2-a052-48f540c72795 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:58.206777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 220/418] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:58.218805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76670b-5ab6-4186-a3e5-e4bf85f9a0c8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:58.219087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76670b-5ab6-4186-a3e5-e4bf85f9a0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:58.219362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c76670b-5ab6-4186-a3e5-e4bf85f9a0c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:58.248386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a13691-12e7-44ef-8493-d5c2a711df78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:58.249173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a13691-12e7-44ef-8493-d5c2a711df78 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:58.249446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a13691-12e7-44ef-8493-d5c2a711df78 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:58.249714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a13691-12e7-44ef-8493-d5c2a711df78 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:58.260280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5c76670b-5ab6-4186-a3e5-e4bf85f9a0c8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:58.261470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5c76670b-5ab6-4186-a3e5-e4bf85f9a0c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:58.275801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a13691-12e7-44ef-8493-d5c2a711df78 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-35a13691-12e7-44ef-8493-d5c2a711df78 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:58.281477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:58.282958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:58.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 199/419] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:58.287536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530a11-61fc-4ad0-bb18-fd62ca3ab0cc None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:58.287536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530a11-61fc-4ad0-bb18-fd62ca3ab0cc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:58.287536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d530a11-61fc-4ad0-bb18-fd62ca3ab0cc None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:58.287536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 200/420] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:58.290310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d530a11-61fc-4ad0-bb18-fd62ca3ab0cc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:58.342673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:58.358329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 221/421] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:58.359734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f250f-4407-45c9-94e0-8b6e2cb5be01 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:58.360002 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f250f-4407-45c9-94e0-8b6e2cb5be01 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:58.360310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044f250f-4407-45c9-94e0-8b6e2cb5be01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:58.379039 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-044f250f-4407-45c9-94e0-8b6e2cb5be01 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:58.380254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-044f250f-4407-45c9-94e0-8b6e2cb5be01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:58.444865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d530a11-61fc-4ad0-bb18-fd62ca3ab0cc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:58.460288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 222/422] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:58.507303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df914dc3-d62c-4637-afa1-bef2efae1a2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:58.507918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df914dc3-d62c-4637-afa1-bef2efae1a2b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:58.508222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df914dc3-d62c-4637-afa1-bef2efae1a2b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:58.508498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df914dc3-d62c-4637-afa1-bef2efae1a2b None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:58.509165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df914dc3-d62c-4637-afa1-bef2efae1a2b None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:58.509467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df914dc3-d62c-4637-afa1-bef2efae1a2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:58.510842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df914dc3-d62c-4637-afa1-bef2efae1a2b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:58.528242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 201/423] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:58 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:58.531559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f250f-4407-45c9-94e0-8b6e2cb5be01 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:58.597965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:58.645439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044f250f-4407-45c9-94e0-8b6e2cb5be01 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:58.685434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b8dcc-4a43-4bb5-a60e-a29332f52cab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:58.686042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b8dcc-4a43-4bb5-a60e-a29332f52cab None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:58.686322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b8dcc-4a43-4bb5-a60e-a29332f52cab None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:58.686595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3b8dcc-4a43-4bb5-a60e-a29332f52cab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:58.755986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df914dc3-d62c-4637-afa1-bef2efae1a2b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:58.799450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b8dcc-4a43-4bb5-a60e-a29332f52cab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:58.801956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3b8dcc-4a43-4bb5-a60e-a29332f52cab None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:58.903506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:58.929466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df914dc3-d62c-4637-afa1-bef2efae1a2b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:58.943542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:58.957234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 223/424] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:58.963451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b8dcc-4a43-4bb5-a60e-a29332f52cab None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:58.975420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f088814-5428-4750-954c-740282167c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:58.976303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f088814-5428-4750-954c-740282167c73 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:58.976725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f088814-5428-4750-954c-740282167c73 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:58.977168 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f088814-5428-4750-954c-740282167c73 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:58.988996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f088814-5428-4750-954c-740282167c73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9f088814-5428-4750-954c-740282167c73 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:58.994101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:58.995209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:12:58.996232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:12:58.998373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 202/425] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:12:58 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:58.999362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f088814-5428-4750-954c-740282167c73 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:59.070019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3b8dcc-4a43-4bb5-a60e-a29332f52cab None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:59.105750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c963dd9-5786-4026-9145-d4c5fc377d87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:59.106604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c963dd9-5786-4026-9145-d4c5fc377d87 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.107053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c963dd9-5786-4026-9145-d4c5fc377d87 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.107177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f088814-5428-4750-954c-740282167c73 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:59.107588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c963dd9-5786-4026-9145-d4c5fc377d87 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.118090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c963dd9-5786-4026-9145-d4c5fc377d87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8c963dd9-5786-4026-9145-d4c5fc377d87 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:12:59.123000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:12:59.123889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Sep 24 14:12:59.124729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:12:59.128432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 224/426] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:12:58 2022] GET /identity/v3/roles/member => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:12:59.129640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c963dd9-5786-4026-9145-d4c5fc377d87 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:59.144050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b384b-e7ad-4aab-8660-90d1916873de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:59.144815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b384b-e7ad-4aab-8660-90d1916873de None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.145200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b384b-e7ad-4aab-8660-90d1916873de None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.145564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b384b-e7ad-4aab-8660-90d1916873de None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.147269 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b384b-e7ad-4aab-8660-90d1916873de None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:59.148047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:59.149389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b384b-e7ad-4aab-8660-90d1916873de None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:59.159808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 203/427] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:58 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:59.159808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b384b-e7ad-4aab-8660-90d1916873de None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:59.199082 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:59.247788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c963dd9-5786-4026-9145-d4c5fc377d87 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:59.269073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b384b-e7ad-4aab-8660-90d1916873de None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:59.284726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df786f-d005-4791-b7fd-9ae6581f6fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:59.285634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df786f-d005-4791-b7fd-9ae6581f6fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.286138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df786f-d005-4791-b7fd-9ae6581f6fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.286859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1df786f-d005-4791-b7fd-9ae6581f6fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.288201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df786f-d005-4791-b7fd-9ae6581f6fb7 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:59.288754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df786f-d005-4791-b7fd-9ae6581f6fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:59.290313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1df786f-d005-4791-b7fd-9ae6581f6fb7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:59.300038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 225/428] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:12:59 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:59.301284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df786f-d005-4791-b7fd-9ae6581f6fb7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:59.305099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14943e-01c9-4321-8ec3-ff3cda6d25d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:59.305762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14943e-01c9-4321-8ec3-ff3cda6d25d4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.306041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14943e-01c9-4321-8ec3-ff3cda6d25d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.306388 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e14943e-01c9-4321-8ec3-ff3cda6d25d4 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.307475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14943e-01c9-4321-8ec3-ff3cda6d25d4 None admin] RBAC: Adding query filter params (name=member) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:59.307475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14943e-01c9-4321-8ec3-ff3cda6d25d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:59.308889 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e14943e-01c9-4321-8ec3-ff3cda6d25d4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:59.319675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 204/429] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:12:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:59.320394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14943e-01c9-4321-8ec3-ff3cda6d25d4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:59.405795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:59.422504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:59.426780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e14943e-01c9-4321-8ec3-ff3cda6d25d4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:59.435026 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1df786f-d005-4791-b7fd-9ae6581f6fb7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:59.464429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0ebbc8-486a-4c56-9b97-7e9890307902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:59.465041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ebbc8-486a-4c56-9b97-7e9890307902 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.465324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ebbc8-486a-4c56-9b97-7e9890307902 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.465602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0ebbc8-486a-4c56-9b97-7e9890307902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.474197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e679f09-8802-4b91-a0af-964c72375ecd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:59.475086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679f09-8802-4b91-a0af-964c72375ecd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.475368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679f09-8802-4b91-a0af-964c72375ecd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.475644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e679f09-8802-4b91-a0af-964c72375ecd None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.476901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e679f09-8802-4b91-a0af-964c72375ecd None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:59.478388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e679f09-8802-4b91-a0af-964c72375ecd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:59.486073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 226/430] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:12:59 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:59.486073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e679f09-8802-4b91-a0af-964c72375ecd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:59.549189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ebbc8-486a-4c56-9b97-7e9890307902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:59.550754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0ebbc8-486a-4c56-9b97-7e9890307902 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:59.598129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e679f09-8802-4b91-a0af-964c72375ecd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:59.633055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1767cc-31c5-4d87-9a4b-8a4e4e2964a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:59.633655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1767cc-31c5-4d87-9a4b-8a4e4e2964a6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.633935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1767cc-31c5-4d87-9a4b-8a4e4e2964a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.634236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1767cc-31c5-4d87-9a4b-8a4e4e2964a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.649630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:59.658341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:59.668938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 205/431] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:59.670334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fea8-a3fb-4f8e-9a42-b1989a13f356 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.670587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fea8-a3fb-4f8e-9a42-b1989a13f356 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.670840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1c2fea8-a3fb-4f8e-9a42-b1989a13f356 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.672283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 206/432] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:12:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:12:59.677729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2fea8-a3fb-4f8e-9a42-b1989a13f356 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:59.710771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1767cc-31c5-4d87-9a4b-8a4e4e2964a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:59.712262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f1767cc-31c5-4d87-9a4b-8a4e4e2964a6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:59.786937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1c2fea8-a3fb-4f8e-9a42-b1989a13f356 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:59.820626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 227/433] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:12:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:12:59.821615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1767cc-31c5-4d87-9a4b-8a4e4e2964a6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:59.830081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8257515c-f995-433d-ba86-ab58c28aae13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:59.830388 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257515c-f995-433d-ba86-ab58c28aae13 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.830667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257515c-f995-433d-ba86-ab58c28aae13 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.830939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8257515c-f995-433d-ba86-ab58c28aae13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.831663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257515c-f995-433d-ba86-ab58c28aae13 None admin] RBAC: Adding query filter params (group.id=3817ca24b42e4c7dbe197713f2389f6e, role.id=a4c95292940e4d359d48ad72b390ece0, scope.project.id=8940941bf57b4aeeabf404864a2b9d10) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:12:59.832291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257515c-f995-433d-ba86-ab58c28aae13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:59.833437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8257515c-f995-433d-ba86-ab58c28aae13 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:12:59.839957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 207/434] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 24 14:12:59 2022] GET /identity/v3/role_assignments?group.id=3817ca24b42e4c7dbe197713f2389f6e&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 611 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:12:59.853753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d832-39f2-47cd-a54d-09eb9711f785 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.854070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d832-39f2-47cd-a54d-09eb9711f785 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.854289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23d832-39f2-47cd-a54d-09eb9711f785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.887312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ed23d832-39f2-47cd-a54d-09eb9711f785 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:12:59.887713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:59.889644 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed23d832-39f2-47cd-a54d-09eb9711f785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:12:59.953663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1767cc-31c5-4d87-9a4b-8a4e4e2964a6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:12:59.976759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:12:59.990930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 208/435] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:12:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:12:59.992087 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23d832-39f2-47cd-a54d-09eb9711f785 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:12:59.995369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e0646c2-2230-49a7-9f0d-8ef87f8f73a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:12:59.996273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0646c2-2230-49a7-9f0d-8ef87f8f73a6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:12:59.996628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0646c2-2230-49a7-9f0d-8ef87f8f73a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:12:59.996982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e0646c2-2230-49a7-9f0d-8ef87f8f73a6 None admin] PATH_INFO: `/v3/projects/8940941bf57b4aeeabf404864a2b9d10` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:12:59.998337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0646c2-2230-49a7-9f0d-8ef87f8f73a6 None admin] RBAC: Authorizing `identity:get_project(project_id=8940941bf57b4aeeabf404864a2b9d10)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:12:59.999893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e0646c2-2230-49a7-9f0d-8ef87f8f73a6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:00.006657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 228/436] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:59 2022] GET /identity/v3/projects/8940941bf57b4aeeabf404864a2b9d10 => generated 298 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:00.006657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680850b3-bd9b-4a6b-92a7-76666147c0f7 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.006657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680850b3-bd9b-4a6b-92a7-76666147c0f7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.006657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680850b3-bd9b-4a6b-92a7-76666147c0f7 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.006657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 229/437] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:00.007869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680850b3-bd9b-4a6b-92a7-76666147c0f7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:00.143590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23d832-39f2-47cd-a54d-09eb9711f785 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:00.145743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680850b3-bd9b-4a6b-92a7-76666147c0f7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:00.166025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:00.188121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d08d51e-cbe4-46b6-a7d0-c4dbd2689692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:00.189069 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d51e-cbe4-46b6-a7d0-c4dbd2689692 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.189344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d51e-cbe4-46b6-a7d0-c4dbd2689692 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.189727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d08d51e-cbe4-46b6-a7d0-c4dbd2689692 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.191160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08d51e-cbe4-46b6-a7d0-c4dbd2689692 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:00.192878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d08d51e-cbe4-46b6-a7d0-c4dbd2689692 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:00.194785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 209/438] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:12:59 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:00.195924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cc46c-9e46-43a3-ad00-4bc9315bd1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:00.196047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc828-7651-4161-b9dc-07cc04c84866 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.196138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc46c-9e46-43a3-ad00-4bc9315bd1a2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.196312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc828-7651-4161-b9dc-07cc04c84866 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.196384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc46c-9e46-43a3-ad00-4bc9315bd1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.196460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ededc828-7651-4161-b9dc-07cc04c84866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.196539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782cc46c-9e46-43a3-ad00-4bc9315bd1a2 None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.197688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cc46c-9e46-43a3-ad00-4bc9315bd1a2 None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:00.199098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782cc46c-9e46-43a3-ad00-4bc9315bd1a2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:00.200994 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 230/439] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:13:00 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:00.207328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cc46c-9e46-43a3-ad00-4bc9315bd1a2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:00.216092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ededc828-7651-4161-b9dc-07cc04c84866 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:00.217300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ededc828-7651-4161-b9dc-07cc04c84866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:00.284687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:00.296666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 210/440] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:00.297630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc828-7651-4161-b9dc-07cc04c84866 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:00.336691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782cc46c-9e46-43a3-ad00-4bc9315bd1a2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:00.377750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef46dd-1be1-4154-b3e9-ea4255b03c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:00.378706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef46dd-1be1-4154-b3e9-ea4255b03c04 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.379312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef46dd-1be1-4154-b3e9-ea4255b03c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.379906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ef46dd-1be1-4154-b3e9-ea4255b03c04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.380737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef46dd-1be1-4154-b3e9-ea4255b03c04 None admin] RBAC: Adding query filter params (group.id=3817ca24b42e4c7dbe197713f2389f6e, role.id=4f8d839474214ed89390c34864229684, scope.project.id=8940941bf57b4aeeabf404864a2b9d10) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:00.381052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef46dd-1be1-4154-b3e9-ea4255b03c04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:00.382845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ef46dd-1be1-4154-b3e9-ea4255b03c04 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:00.389588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 231/441] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 24 14:13:00 2022] GET /identity/v3/role_assignments?group.id=3817ca24b42e4c7dbe197713f2389f6e&scope.project.id=8940941bf57b4aeeabf404864a2b9d10&role.id=4f8d839474214ed89390c34864229684 => generated 611 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:00.390512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef46dd-1be1-4154-b3e9-ea4255b03c04 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:00.421558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ededc828-7651-4161-b9dc-07cc04c84866 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:00.453529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:00.462568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa054ce-0822-4ca5-9689-725727513f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:00.463190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa054ce-0822-4ca5-9689-725727513f8c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.463472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa054ce-0822-4ca5-9689-725727513f8c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.463751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa054ce-0822-4ca5-9689-725727513f8c None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.465151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa054ce-0822-4ca5-9689-725727513f8c None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:00.466639 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa054ce-0822-4ca5-9689-725727513f8c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:00.471247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 211/442] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:13:00 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:00.474550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa054ce-0822-4ca5-9689-725727513f8c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:00.527825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ef46dd-1be1-4154-b3e9-ea4255b03c04 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:00.547576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:00.571178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918ac71-a442-4bda-8576-3becf6ef6145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:00.572222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918ac71-a442-4bda-8576-3becf6ef6145 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.572555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918ac71-a442-4bda-8576-3becf6ef6145 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.572838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0918ac71-a442-4bda-8576-3becf6ef6145 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.584563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0918ac71-a442-4bda-8576-3becf6ef6145 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0918ac71-a442-4bda-8576-3becf6ef6145 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:00.589825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:00.590733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:13:00.591522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:00.592634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 232/443] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:00.593076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918ac71-a442-4bda-8576-3becf6ef6145 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:00.595403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa054ce-0822-4ca5-9689-725727513f8c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:00.635451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed354b9-2f3f-4ab5-96c3-c5cae7198248 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:00.636061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed354b9-2f3f-4ab5-96c3-c5cae7198248 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.636378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed354b9-2f3f-4ab5-96c3-c5cae7198248 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.636968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed354b9-2f3f-4ab5-96c3-c5cae7198248 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.637372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed354b9-2f3f-4ab5-96c3-c5cae7198248 None admin] RBAC: Adding query filter params (group.id=3817ca24b42e4c7dbe197713f2389f6e, role.id=a4c95292940e4d359d48ad72b390ece0, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:00.637673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed354b9-2f3f-4ab5-96c3-c5cae7198248 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:00.639117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed354b9-2f3f-4ab5-96c3-c5cae7198248 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:00.646077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 212/444] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 24 14:13:00 2022] GET /identity/v3/role_assignments?group.id=3817ca24b42e4c7dbe197713f2389f6e&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=a4c95292940e4d359d48ad72b390ece0 => generated 611 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:00.647193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed354b9-2f3f-4ab5-96c3-c5cae7198248 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:00.726755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0918ac71-a442-4bda-8576-3becf6ef6145 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:00.729507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:00.785413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed354b9-2f3f-4ab5-96c3-c5cae7198248 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:00.788394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e96d8-67a8-4a35-92e7-56520a1d2ac6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:00.789690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e96d8-67a8-4a35-92e7-56520a1d2ac6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.789690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e96d8-67a8-4a35-92e7-56520a1d2ac6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.789690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e96d8-67a8-4a35-92e7-56520a1d2ac6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.807514 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e96d8-67a8-4a35-92e7-56520a1d2ac6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-585e96d8-67a8-4a35-92e7-56520a1d2ac6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:00.812516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:00.814134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:00.814974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:00.816229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 233/445] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:00 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:00.816591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:00.821177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e96d8-67a8-4a35-92e7-56520a1d2ac6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:00.839545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef59f-a0cd-43d9-9050-2772a05b8602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:00.840229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef59f-a0cd-43d9-9050-2772a05b8602 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.840523 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef59f-a0cd-43d9-9050-2772a05b8602 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.840798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feef59f-a0cd-43d9-9050-2772a05b8602 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.841525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef59f-a0cd-43d9-9050-2772a05b8602 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:00.841823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef59f-a0cd-43d9-9050-2772a05b8602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:00.843216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6feef59f-a0cd-43d9-9050-2772a05b8602 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:00.852325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 213/446] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:00.859056 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef59f-a0cd-43d9-9050-2772a05b8602 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:00.949388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e96d8-67a8-4a35-92e7-56520a1d2ac6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:00.988435 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feef59f-a0cd-43d9-9050-2772a05b8602 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:00.992172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b6468-78d4-4ed4-a51a-f4f1d643a7a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:00.992797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b6468-78d4-4ed4-a51a-f4f1d643a7a9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:00.993090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b6468-78d4-4ed4-a51a-f4f1d643a7a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:00.993365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50b6468-78d4-4ed4-a51a-f4f1d643a7a9 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:00.994037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b6468-78d4-4ed4-a51a-f4f1d643a7a9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:00.994346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b6468-78d4-4ed4-a51a-f4f1d643a7a9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:00.995723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e50b6468-78d4-4ed4-a51a-f4f1d643a7a9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:01.006884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 234/447] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:01.011839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b6468-78d4-4ed4-a51a-f4f1d643a7a9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:01.030212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb31cd0-9408-4d92-b990-4766473b6421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:01.030918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb31cd0-9408-4d92-b990-4766473b6421 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:01.031203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb31cd0-9408-4d92-b990-4766473b6421 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:01.031474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb31cd0-9408-4d92-b990-4766473b6421 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:01.046723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:01.087188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:01.103258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb31cd0-9408-4d92-b990-4766473b6421 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:01.104833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb31cd0-9408-4d92-b990-4766473b6421 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:01.123229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e50b6468-78d4-4ed4-a51a-f4f1d643a7a9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:01.157536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec359b-2906-40b7-8a70-7808b332b3fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:01.158134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec359b-2906-40b7-8a70-7808b332b3fc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:01.158412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec359b-2906-40b7-8a70-7808b332b3fc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:01.158686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cec359b-2906-40b7-8a70-7808b332b3fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:01.205613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 214/448] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:01.211208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb31cd0-9408-4d92-b990-4766473b6421 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:01.229715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec359b-2906-40b7-8a70-7808b332b3fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:01.231171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cec359b-2906-40b7-8a70-7808b332b3fc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:01.257782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:01.293210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:01.308969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb31cd0-9408-4d92-b990-4766473b6421 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:01.331603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 235/449] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 14:13:01.337201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec359b-2906-40b7-8a70-7808b332b3fc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:01.342266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12b60a-67cf-4f5b-8bf5-71c44d825ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:01.342896 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12b60a-67cf-4f5b-8bf5-71c44d825ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:01.343177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12b60a-67cf-4f5b-8bf5-71c44d825ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:01.343453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12b60a-67cf-4f5b-8bf5-71c44d825ec5 None admin] PATH_INFO: `/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:01.344608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12b60a-67cf-4f5b-8bf5-71c44d825ec5 None admin] RBAC: Authorizing `identity:get_project(project_id=6d2a6809aef84ed58cd8ac0e168a051e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:01.346592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12b60a-67cf-4f5b-8bf5-71c44d825ec5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:01.352920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 215/450] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:13:01 2022] GET /identity/v3/projects/6d2a6809aef84ed58cd8ac0e168a051e => generated 302 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:01.353856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12b60a-67cf-4f5b-8bf5-71c44d825ec5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:01.434406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cec359b-2906-40b7-8a70-7808b332b3fc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:01.449014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12b60a-67cf-4f5b-8bf5-71c44d825ec5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:01.459278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:01.467860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70f9ac-eb62-4781-9a82-0636f5915240 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:01.468513 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70f9ac-eb62-4781-9a82-0636f5915240 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:01.468794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70f9ac-eb62-4781-9a82-0636f5915240 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:01.469068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f70f9ac-eb62-4781-9a82-0636f5915240 None admin] PATH_INFO: `/v3/projects/2c480881ed7348f895e92a35f216f258` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:01.470711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70f9ac-eb62-4781-9a82-0636f5915240 None admin] RBAC: Authorizing `identity:get_project(project_id=2c480881ed7348f895e92a35f216f258)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:01.472138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f70f9ac-eb62-4781-9a82-0636f5915240 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:01.473977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 236/451] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:13:01 2022] GET /identity/v3/projects/2c480881ed7348f895e92a35f216f258 => generated 344 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:01.479303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70f9ac-eb62-4781-9a82-0636f5915240 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:01.483776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccd481-12a9-4604-aa87-f8733fffe12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:01.484438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccd481-12a9-4604-aa87-f8733fffe12c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:01.484717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccd481-12a9-4604-aa87-f8733fffe12c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:01.484991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ccd481-12a9-4604-aa87-f8733fffe12c None admin] PATH_INFO: `/v3/groups/3817ca24b42e4c7dbe197713f2389f6e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:01.486699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccd481-12a9-4604-aa87-f8733fffe12c None admin] RBAC: Authorizing `identity:get_group(group_id=3817ca24b42e4c7dbe197713f2389f6e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:01.488144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ccd481-12a9-4604-aa87-f8733fffe12c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:01.489724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 216/452] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:13:01 2022] GET /identity/v3/groups/3817ca24b42e4c7dbe197713f2389f6e => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:01.495363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccd481-12a9-4604-aa87-f8733fffe12c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:01.516240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:01.578745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f70f9ac-eb62-4781-9a82-0636f5915240 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:01.595943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ccd481-12a9-4604-aa87-f8733fffe12c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:01.612516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef973a6c-8c83-4aa1-9a76-2fdb9b95692a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:01.613127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef973a6c-8c83-4aa1-9a76-2fdb9b95692a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:01.613408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef973a6c-8c83-4aa1-9a76-2fdb9b95692a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:01.613674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef973a6c-8c83-4aa1-9a76-2fdb9b95692a None admin] PATH_INFO: `/v3/groups/4aac6a96cca848b6a3042e6bcdc2a5cf` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:01.614776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef973a6c-8c83-4aa1-9a76-2fdb9b95692a None admin] RBAC: Authorizing `identity:get_group(group_id=4aac6a96cca848b6a3042e6bcdc2a5cf)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:01.616232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef973a6c-8c83-4aa1-9a76-2fdb9b95692a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:01.617769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 237/453] 10.222.0.16 () {56 vars in 1180 bytes} [Sat Sep 24 14:13:01 2022] GET /identity/v3/groups/4aac6a96cca848b6a3042e6bcdc2a5cf => generated 229 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:01.623451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef973a6c-8c83-4aa1-9a76-2fdb9b95692a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:01.629742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cbc82d-3dfa-4466-af02-f3380a904af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:01.630352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbc82d-3dfa-4466-af02-f3380a904af5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:01.630632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbc82d-3dfa-4466-af02-f3380a904af5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:01.630908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cbc82d-3dfa-4466-af02-f3380a904af5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:01.631628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbc82d-3dfa-4466-af02-f3380a904af5 None admin] RBAC: Adding query filter params (group.id=3817ca24b42e4c7dbe197713f2389f6e, role.id=4f8d839474214ed89390c34864229684, scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:01.631945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbc82d-3dfa-4466-af02-f3380a904af5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:01.633422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cbc82d-3dfa-4466-af02-f3380a904af5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:01.639026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 217/454] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 24 14:13:01 2022] GET /identity/v3/role_assignments?group.id=3817ca24b42e4c7dbe197713f2389f6e&scope.project.id=6d2a6809aef84ed58cd8ac0e168a051e&role.id=4f8d839474214ed89390c34864229684 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:01.686323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:01.728354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef973a6c-8c83-4aa1-9a76-2fdb9b95692a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:01.763556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3747776-1408-4e2f-9737-b12e566e79fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:01.764203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3747776-1408-4e2f-9737-b12e566e79fb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:01.764485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3747776-1408-4e2f-9737-b12e566e79fb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:01.764758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3747776-1408-4e2f-9737-b12e566e79fb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:01.765495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3747776-1408-4e2f-9737-b12e566e79fb None admin] RBAC: Adding query filter params (group.id=4aac6a96cca848b6a3042e6bcdc2a5cf, role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=2c480881ed7348f895e92a35f216f258) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:01.765807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3747776-1408-4e2f-9737-b12e566e79fb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:01.767329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3747776-1408-4e2f-9737-b12e566e79fb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:01.773711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 238/455] 10.222.0.16 () {56 vars in 1376 bytes} [Sat Sep 24 14:13:01 2022] GET /identity/v3/role_assignments?group.id=4aac6a96cca848b6a3042e6bcdc2a5cf&scope.project.id=2c480881ed7348f895e92a35f216f258&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 611 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:04.409489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fccea7-45dc-4f41-a1f4-08e43502d05b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:04.410016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fccea7-45dc-4f41-a1f4-08e43502d05b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:04.410016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fccea7-45dc-4f41-a1f4-08e43502d05b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:04.411699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 218/456] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:04.417733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae608fb-450b-4039-a26a-cee4c56bad14 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:04.418246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae608fb-450b-4039-a26a-cee4c56bad14 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:04.418318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae608fb-450b-4039-a26a-cee4c56bad14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:04.443869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2ae608fb-450b-4039-a26a-cee4c56bad14 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:04.445107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2ae608fb-450b-4039-a26a-cee4c56bad14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:04.542415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840ba4a-4973-445d-a819-a707093c56a5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:04.542735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840ba4a-4973-445d-a819-a707093c56a5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:04.542968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6840ba4a-4973-445d-a819-a707093c56a5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:04.544570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 219/457] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:04.550142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 239/458] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:13:04.550622 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8346cc-1144-4ca0-a4ff-422289fcccfe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:04.550914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8346cc-1144-4ca0-a4ff-422289fcccfe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:04.551288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8346cc-1144-4ca0-a4ff-422289fcccfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:04.585502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ac8346cc-1144-4ca0-a4ff-422289fcccfe None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:04.586698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ac8346cc-1144-4ca0-a4ff-422289fcccfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:04.682448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 220/459] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:13:04.902820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae608fb-450b-4039-a26a-cee4c56bad14 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:04.960733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:05.009583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197976-1b14-45c6-ab51-5b064041b0e0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.010199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197976-1b14-45c6-ab51-5b064041b0e0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.010664 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33197976-1b14-45c6-ab51-5b064041b0e0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.012428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 221/460] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:05.022146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b775ca-aee0-4b76-9ddb-ad0b9d733b40 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.022661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b775ca-aee0-4b76-9ddb-ad0b9d733b40 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.023171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5b775ca-aee0-4b76-9ddb-ad0b9d733b40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.042741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae608fb-450b-4039-a26a-cee4c56bad14 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:05.056041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d5b775ca-aee0-4b76-9ddb-ad0b9d733b40 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:05.057809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d5b775ca-aee0-4b76-9ddb-ad0b9d733b40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:05.070710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:05.084562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9797167-f883-4114-bfdd-7a48ad492c74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:05.085948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9797167-f883-4114-bfdd-7a48ad492c74 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.086695 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9797167-f883-4114-bfdd-7a48ad492c74 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.087166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9797167-f883-4114-bfdd-7a48ad492c74 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.100979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9797167-f883-4114-bfdd-7a48ad492c74 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:05.103878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9797167-f883-4114-bfdd-7a48ad492c74 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e9797167-f883-4114-bfdd-7a48ad492c74 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:05.123595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:05.124549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:05.125409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:05.125409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:05.125409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:05.128229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 240/461] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:05.129239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9797167-f883-4114-bfdd-7a48ad492c74 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:05.147713 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 222/462] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:05.155570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b775ca-aee0-4b76-9ddb-ad0b9d733b40 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:05.294473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9797167-f883-4114-bfdd-7a48ad492c74 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:05.303763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:05.314746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5b775ca-aee0-4b76-9ddb-ad0b9d733b40 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:05.331393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823e91f-deff-432c-b309-6ceb60e45fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:05.332093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823e91f-deff-432c-b309-6ceb60e45fc3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.332318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823e91f-deff-432c-b309-6ceb60e45fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.332597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2823e91f-deff-432c-b309-6ceb60e45fc3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.343701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823e91f-deff-432c-b309-6ceb60e45fc3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:05.345253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2823e91f-deff-432c-b309-6ceb60e45fc3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:05.353475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ae12a-36c4-4ae6-882e-d0f8ef4e4fbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:05.354332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ae12a-36c4-4ae6-882e-d0f8ef4e4fbc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.354820 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ae12a-36c4-4ae6-882e-d0f8ef4e4fbc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.355299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2ae12a-36c4-4ae6-882e-d0f8ef4e4fbc None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.356209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ae12a-36c4-4ae6-882e-d0f8ef4e4fbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:05.356705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ae12a-36c4-4ae6-882e-d0f8ef4e4fbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:05.358265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2ae12a-36c4-4ae6-882e-d0f8ef4e4fbc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2823e91f-deff-432c-b309-6ceb60e45fc3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:05.360648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:05.361629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:05.362482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:05.362482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:05.362482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:05.362482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 241/463] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:05.369087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823e91f-deff-432c-b309-6ceb60e45fc3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:05.379970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 223/464] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:05.389162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ae12a-36c4-4ae6-882e-d0f8ef4e4fbc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:05.393700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:05.482201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2823e91f-deff-432c-b309-6ceb60e45fc3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:05.509820 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2ae12a-36c4-4ae6-882e-d0f8ef4e4fbc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:05.518558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6b2f4f-cc0a-402e-941a-3d8cc75f3627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:05.519165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2f4f-cc0a-402e-941a-3d8cc75f3627 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.519442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2f4f-cc0a-402e-941a-3d8cc75f3627 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.519716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b2f4f-cc0a-402e-941a-3d8cc75f3627 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.520389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b2f4f-cc0a-402e-941a-3d8cc75f3627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:05.520691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b2f4f-cc0a-402e-941a-3d8cc75f3627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:05.522044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6b2f4f-cc0a-402e-941a-3d8cc75f3627 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:05.535278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 242/465] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:05.539619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71a674-6e19-4f12-ab9c-4fb4f7faf3e2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.539619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71a674-6e19-4f12-ab9c-4fb4f7faf3e2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.539619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e71a674-6e19-4f12-ab9c-4fb4f7faf3e2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.539619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 243/466] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:05.539619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71a674-6e19-4f12-ab9c-4fb4f7faf3e2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:05.550853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a5331-a385-4890-95ea-111a9a43fc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:05.551447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a5331-a385-4890-95ea-111a9a43fc00 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.551731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a5331-a385-4890-95ea-111a9a43fc00 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.552017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f0a5331-a385-4890-95ea-111a9a43fc00 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.552687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a5331-a385-4890-95ea-111a9a43fc00 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:05.554108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f0a5331-a385-4890-95ea-111a9a43fc00 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:05.564312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:05.584191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 224/467] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:13:05 2022] POST /identity/v3/users => generated 246 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:05.584191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a5331-a385-4890-95ea-111a9a43fc00 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:05.664285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:05.682691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e71a674-6e19-4f12-ab9c-4fb4f7faf3e2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:05.717416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f0a5331-a385-4890-95ea-111a9a43fc00 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:05.728030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4882ac-8470-4370-a522-271134a17fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:05.729497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4882ac-8470-4370-a522-271134a17fcf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.729839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4882ac-8470-4370-a522-271134a17fcf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.730176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4882ac-8470-4370-a522-271134a17fcf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.744232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4882ac-8470-4370-a522-271134a17fcf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:05.746469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4882ac-8470-4370-a522-271134a17fcf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:05.762203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e074a-fc51-4cc7-8248-62eb69e2554a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:05.762819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e074a-fc51-4cc7-8248-62eb69e2554a None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.763098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e074a-fc51-4cc7-8248-62eb69e2554a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.763370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d1e074a-fc51-4cc7-8248-62eb69e2554a None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.764013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e074a-fc51-4cc7-8248-62eb69e2554a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:05.765543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d1e074a-fc51-4cc7-8248-62eb69e2554a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-bd4882ac-8470-4370-a522-271134a17fcf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:05.766103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:05.767523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:05.770057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:05.770057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:05.770057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:05.770057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 244/468] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:05.770057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3aa1c-6d30-4859-b532-843961fb0a5f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.770057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3aa1c-6d30-4859-b532-843961fb0a5f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.770057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fa3aa1c-6d30-4859-b532-843961fb0a5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.789868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 225/469] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:13:05 2022] POST /identity/v3/users => generated 248 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:05.790696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e074a-fc51-4cc7-8248-62eb69e2554a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:05.794537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1fa3aa1c-6d30-4859-b532-843961fb0a5f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:05.795770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1fa3aa1c-6d30-4859-b532-843961fb0a5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:05.900283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 245/470] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:05.967326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d1e074a-fc51-4cc7-8248-62eb69e2554a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:05.971211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762067f5-53a5-4d4d-980d-e0d8a762ab63 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.971585 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762067f5-53a5-4d4d-980d-e0d8a762ab63 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.971854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-762067f5-53a5-4d4d-980d-e0d8a762ab63 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.974522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 246/471] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:13:05.982210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968a60c-01d0-4882-8bbc-ae8bad4d05cc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:05.982620 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968a60c-01d0-4882-8bbc-ae8bad4d05cc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:05.982987 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e968a60c-01d0-4882-8bbc-ae8bad4d05cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:05.990725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:05.993670 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:06.014025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e968a60c-01d0-4882-8bbc-ae8bad4d05cc None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:06.015241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e968a60c-01d0-4882-8bbc-ae8bad4d05cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:06.021967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e9233-e28f-4a5c-9063-21416254ac5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:06.022852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e9233-e28f-4a5c-9063-21416254ac5c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:06.023353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e9233-e28f-4a5c-9063-21416254ac5c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:06.023828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0e9233-e28f-4a5c-9063-21416254ac5c None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:06.024707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e9233-e28f-4a5c-9063-21416254ac5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:06.025238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e9233-e28f-4a5c-9063-21416254ac5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:06.026933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0e9233-e28f-4a5c-9063-21416254ac5c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:06.039604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 226/472] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:06.046895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e9233-e28f-4a5c-9063-21416254ac5c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:06.103645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 247/473] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:06.169849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0e9233-e28f-4a5c-9063-21416254ac5c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:06.206074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968a60c-01d0-4882-8bbc-ae8bad4d05cc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:06.216198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e9066-7164-4c6b-8c7c-19135800ae65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:06.216807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9066-7164-4c6b-8c7c-19135800ae65 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:06.217085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9066-7164-4c6b-8c7c-19135800ae65 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:06.217356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536e9066-7164-4c6b-8c7c-19135800ae65 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:06.218129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e9066-7164-4c6b-8c7c-19135800ae65 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:06.219720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536e9066-7164-4c6b-8c7c-19135800ae65 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:06.253097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 227/474] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:13:06 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:13:06.335715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e968a60c-01d0-4882-8bbc-ae8bad4d05cc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:06.370913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:06.378318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b63d8c-e21f-4c8f-b6e1-4209d6db1c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:06.379403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b63d8c-e21f-4c8f-b6e1-4209d6db1c41 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:06.379896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b63d8c-e21f-4c8f-b6e1-4209d6db1c41 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:06.380395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b63d8c-e21f-4c8f-b6e1-4209d6db1c41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:06.393931 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b63d8c-e21f-4c8f-b6e1-4209d6db1c41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:06.395839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b63d8c-e21f-4c8f-b6e1-4209d6db1c41 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-01b63d8c-e21f-4c8f-b6e1-4209d6db1c41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:06.414152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:06.415173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:06.416047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:06.416047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:06.416047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:06.418255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 248/475] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:06.426035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e9066-7164-4c6b-8c7c-19135800ae65 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:06.446569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b63d8c-e21f-4c8f-b6e1-4209d6db1c41 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:06.479619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:06.577068 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536e9066-7164-4c6b-8c7c-19135800ae65 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:06.596594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b63d8c-e21f-4c8f-b6e1-4209d6db1c41 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:06.628968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a014-d3d9-49ef-88f8-e785fbd0179f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:06.630952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a014-d3d9-49ef-88f8-e785fbd0179f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:06.631433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a014-d3d9-49ef-88f8-e785fbd0179f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:06.631900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f73a014-d3d9-49ef-88f8-e785fbd0179f None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:06.632744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a014-d3d9-49ef-88f8-e785fbd0179f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:06.633247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a014-d3d9-49ef-88f8-e785fbd0179f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:06.634826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f73a014-d3d9-49ef-88f8-e785fbd0179f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:06.641978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396947d3-09f9-4206-87be-0e37488151ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:06.642595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396947d3-09f9-4206-87be-0e37488151ef None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:06.642879 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396947d3-09f9-4206-87be-0e37488151ef None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:06.643154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396947d3-09f9-4206-87be-0e37488151ef None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:06.643823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396947d3-09f9-4206-87be-0e37488151ef None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:06.645831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396947d3-09f9-4206-87be-0e37488151ef None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:06.650349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 228/476] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:06.656174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a014-d3d9-49ef-88f8-e785fbd0179f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:06.659380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.sql.core [None req-396947d3-09f9-4206-87be-0e37488151ef None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 14:13:06.659380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 24 14:13:06.659380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [parameters: {'id': '58aeda07005d40f9bec33587043d4303', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 24 14:13:06.659380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-396947d3-09f9-4206-87be-0e37488151ef None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Sep 24 14:13:06.678114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return ref.to_dict() Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 14:13:06.679046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application yield resource Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise self.value Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application session.commit() Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 14:13:06.679960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.flush() Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application compat.raise_( Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 14:13:06.680849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 14:13:06.681723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 14:13:06.682553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [parameters: {'id': '58aeda07005d40f9bec33587043d4303', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:06.683343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Sep 24 14:13:06.684722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:06.685807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 249/477] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 24 14:13:06 2022] POST /identity/v3/roles => generated 144 bytes in 233 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:06.685807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396947d3-09f9-4206-87be-0e37488151ef None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:06.747900 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:06.792718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:06.810502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f73a014-d3d9-49ef-88f8-e785fbd0179f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:06.835154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396947d3-09f9-4206-87be-0e37488151ef None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:06.886112 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00d83e-b6a5-47d2-b945-e2daa51f3b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:06.886743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00d83e-b6a5-47d2-b945-e2daa51f3b04 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:06.887027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00d83e-b6a5-47d2-b945-e2daa51f3b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:06.887304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f00d83e-b6a5-47d2-b945-e2daa51f3b04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:06.890382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9e65b9-2874-46f2-b25a-83d8c23913ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:06.890988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e65b9-2874-46f2-b25a-83d8c23913ec None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:06.891265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e65b9-2874-46f2-b25a-83d8c23913ec None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:06.892077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9e65b9-2874-46f2-b25a-83d8c23913ec None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:06.892764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e65b9-2874-46f2-b25a-83d8c23913ec None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:06.894202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f9e65b9-2874-46f2-b25a-83d8c23913ec None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:06.911215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f00d83e-b6a5-47d2-b945-e2daa51f3b04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0f00d83e-b6a5-47d2-b945-e2daa51f3b04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:06.917667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:06.918554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:06.919368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 250/478] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:06.928304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00d83e-b6a5-47d2-b945-e2daa51f3b04 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:06.944934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 229/479] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:13:06 2022] POST /identity/v3/users => generated 249 bytes in 290 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:13:07.044334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f00d83e-b6a5-47d2-b945-e2daa51f3b04 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:07.058255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:07.090564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-228b6954-fba5-4d1d-a9f6-d949f0b54d3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:07.091187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b6954-fba5-4d1d-a9f6-d949f0b54d3e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:07.091467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b6954-fba5-4d1d-a9f6-d949f0b54d3e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:07.091738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228b6954-fba5-4d1d-a9f6-d949f0b54d3e None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:07.092436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b6954-fba5-4d1d-a9f6-d949f0b54d3e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:07.092741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b6954-fba5-4d1d-a9f6-d949f0b54d3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:07.094140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-228b6954-fba5-4d1d-a9f6-d949f0b54d3e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:07.108340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 251/480] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:08.208185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589a54a-2ea8-4734-8cc0-1f6662d86a1b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:08.208703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589a54a-2ea8-4734-8cc0-1f6662d86a1b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:08.208811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c589a54a-2ea8-4734-8cc0-1f6662d86a1b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:08.210544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 230/481] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:08.222051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612c11-13d3-4930-8131-df616360e9fa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:08.222615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612c11-13d3-4930-8131-df616360e9fa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:08.222615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16612c11-13d3-4930-8131-df616360e9fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:08.253126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-16612c11-13d3-4930-8131-df616360e9fa None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:08.254333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-16612c11-13d3-4930-8131-df616360e9fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:08.348825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 252/482] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:08.710780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589a54a-2ea8-4734-8cc0-1f6662d86a1b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:08.838711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c589a54a-2ea8-4734-8cc0-1f6662d86a1b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:08.888865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35c6190b-17e5-40ea-9afc-760cc4c5e3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:08.889510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6190b-17e5-40ea-9afc-760cc4c5e3ee None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:08.889792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6190b-17e5-40ea-9afc-760cc4c5e3ee None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:08.890062 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35c6190b-17e5-40ea-9afc-760cc4c5e3ee None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:08.902148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35c6190b-17e5-40ea-9afc-760cc4c5e3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-35c6190b-17e5-40ea-9afc-760cc4c5e3ee None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:08.907522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:08.908415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:08.909234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 231/483] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:08.914450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16612c11-13d3-4930-8131-df616360e9fa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:09.045603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5aea4-123e-4436-ad68-603fbd9ad4fb None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.046000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5aea4-123e-4436-ad68-603fbd9ad4fb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.046149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e5aea4-123e-4436-ad68-603fbd9ad4fb None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.048563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 232/484] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:09.061398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0b1d8-964a-431a-9020-daafc0b15c89 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.061973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0b1d8-964a-431a-9020-daafc0b15c89 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.062446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0b1d8-964a-431a-9020-daafc0b15c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.076558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:09.080653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16612c11-13d3-4930-8131-df616360e9fa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:09.092974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c5f0b1d8-964a-431a-9020-daafc0b15c89 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:09.094098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c5f0b1d8-964a-431a-9020-daafc0b15c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:09.097093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:09.136295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89efeeef-f336-4787-b892-041a76f5d76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:09.136885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efeeef-f336-4787-b892-041a76f5d76b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.137160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efeeef-f336-4787-b892-041a76f5d76b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.137680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89efeeef-f336-4787-b892-041a76f5d76b None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.138746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efeeef-f336-4787-b892-041a76f5d76b None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:09.139191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efeeef-f336-4787-b892-041a76f5d76b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:09.140874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89efeeef-f336-4787-b892-041a76f5d76b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:09.150172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 253/485] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:09.151228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f9f00-4f39-422c-8ab0-7fe5d9a68f5f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.151508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f9f00-4f39-422c-8ab0-7fe5d9a68f5f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.151781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db3f9f00-4f39-422c-8ab0-7fe5d9a68f5f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.153289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 254/486] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:09.161713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f9f00-4f39-422c-8ab0-7fe5d9a68f5f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:09.185274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 233/487] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:09.186647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5841a-f11f-475c-96c6-6480739d1d76 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.186932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5841a-f11f-475c-96c6-6480739d1d76 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.187342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb5841a-f11f-475c-96c6-6480739d1d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.226057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6fb5841a-f11f-475c-96c6-6480739d1d76 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:09.227269 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6fb5841a-f11f-475c-96c6-6480739d1d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:09.281178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db3f9f00-4f39-422c-8ab0-7fe5d9a68f5f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:09.331473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0afcea-3f65-452b-97d8-83f472fbe0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:09.332142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0afcea-3f65-452b-97d8-83f472fbe0c2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.332445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0afcea-3f65-452b-97d8-83f472fbe0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.332718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0afcea-3f65-452b-97d8-83f472fbe0c2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.344114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0afcea-3f65-452b-97d8-83f472fbe0c2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:09.346159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0afcea-3f65-452b-97d8-83f472fbe0c2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:09.352644 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 234/488] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0d0afcea-3f65-452b-97d8-83f472fbe0c2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:09.368014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:09.368986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:09.369824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:09.369824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:09.369824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:09.373811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 255/489] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:09.381292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5841a-f11f-475c-96c6-6480739d1d76 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:09.462146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0afcea-3f65-452b-97d8-83f472fbe0c2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:09.487398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:09.500506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:09.534963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb5841a-f11f-475c-96c6-6480739d1d76 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:09.599615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0afcea-3f65-452b-97d8-83f472fbe0c2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:09.622888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af9b62-6eea-43f2-97ed-fe9fba04b7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:09.623526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af9b62-6eea-43f2-97ed-fe9fba04b7e7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.623904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af9b62-6eea-43f2-97ed-fe9fba04b7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.624325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65af9b62-6eea-43f2-97ed-fe9fba04b7e7 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.625052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af9b62-6eea-43f2-97ed-fe9fba04b7e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:09.625424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af9b62-6eea-43f2-97ed-fe9fba04b7e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:09.627530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65af9b62-6eea-43f2-97ed-fe9fba04b7e7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:09.640010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e16936-a890-4b97-bfc7-7747e632565a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:09.640995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e16936-a890-4b97-bfc7-7747e632565a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.642181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e16936-a890-4b97-bfc7-7747e632565a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.642749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e16936-a890-4b97-bfc7-7747e632565a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.654049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 235/490] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:09.659916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af9b62-6eea-43f2-97ed-fe9fba04b7e7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:09.661956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e16936-a890-4b97-bfc7-7747e632565a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-60e16936-a890-4b97-bfc7-7747e632565a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:09.666823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:09.667721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:09.668556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 256/491] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:09.669343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e16936-a890-4b97-bfc7-7747e632565a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:09.763127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:09.790631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e16936-a890-4b97-bfc7-7747e632565a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:09.820409 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65af9b62-6eea-43f2-97ed-fe9fba04b7e7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:09.826857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154c40f-4ae0-41dd-b571-eb23f304d2a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:09.827486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154c40f-4ae0-41dd-b571-eb23f304d2a8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.827826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154c40f-4ae0-41dd-b571-eb23f304d2a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.828105 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b154c40f-4ae0-41dd-b571-eb23f304d2a8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.839242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b154c40f-4ae0-41dd-b571-eb23f304d2a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b154c40f-4ae0-41dd-b571-eb23f304d2a8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:09.844839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:09.845779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:09.846588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:09.851224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 257/492] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:09.851858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:09.851965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154c40f-4ae0-41dd-b571-eb23f304d2a8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:09.859659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c8e8c2-f1c3-4fb9-9630-30e2bb13e7fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:09.860635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e8c2-f1c3-4fb9-9630-30e2bb13e7fd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.861243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e8c2-f1c3-4fb9-9630-30e2bb13e7fd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.861518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c8e8c2-f1c3-4fb9-9630-30e2bb13e7fd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.869418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8e8c2-f1c3-4fb9-9630-30e2bb13e7fd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:09.871410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c8e8c2-f1c3-4fb9-9630-30e2bb13e7fd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f4c8e8c2-f1c3-4fb9-9630-30e2bb13e7fd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:09.885579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:09.886511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:09.887449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 236/493] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 24 14:13:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:09.888030 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef92a8-8414-4836-911e-af2d36b5fa59 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:09.888824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef92a8-8414-4836-911e-af2d36b5fa59 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:09.888824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ef92a8-8414-4836-911e-af2d36b5fa59 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:09.889820 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 237/494] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:09.890372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef92a8-8414-4836-911e-af2d36b5fa59 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:09.969196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b154c40f-4ae0-41dd-b571-eb23f304d2a8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:09.995990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ef92a8-8414-4836-911e-af2d36b5fa59 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:10.006569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6865f9-8f2a-4fa3-97e2-f10d29ba3810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.007200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6865f9-8f2a-4fa3-97e2-f10d29ba3810 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.007479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6865f9-8f2a-4fa3-97e2-f10d29ba3810 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.007758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6865f9-8f2a-4fa3-97e2-f10d29ba3810 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.008484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6865f9-8f2a-4fa3-97e2-f10d29ba3810 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:10.008795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6865f9-8f2a-4fa3-97e2-f10d29ba3810 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:10.010226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6865f9-8f2a-4fa3-97e2-f10d29ba3810 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:10.012085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:10.022195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 258/495] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:10.023087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6865f9-8f2a-4fa3-97e2-f10d29ba3810 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:10.041910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a9c8b8-a8d8-4179-bf1b-d76668c8ddf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.042523 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c8b8-a8d8-4179-bf1b-d76668c8ddf7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.042798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c8b8-a8d8-4179-bf1b-d76668c8ddf7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.043065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a9c8b8-a8d8-4179-bf1b-d76668c8ddf7 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.043729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9c8b8-a8d8-4179-bf1b-d76668c8ddf7 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:10.044033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9c8b8-a8d8-4179-bf1b-d76668c8ddf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:10.045464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a9c8b8-a8d8-4179-bf1b-d76668c8ddf7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:10.059191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 238/496] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:10.059191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71acfe-84fa-428d-a757-9eec0db07771 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.059191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71acfe-84fa-428d-a757-9eec0db07771 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.059191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a71acfe-84fa-428d-a757-9eec0db07771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.076433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6a71acfe-84fa-428d-a757-9eec0db07771 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:10.077621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6a71acfe-84fa-428d-a757-9eec0db07771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:10.127468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:10.140795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6865f9-8f2a-4fa3-97e2-f10d29ba3810 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:10.148710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 239/497] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:10.149528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71acfe-84fa-428d-a757-9eec0db07771 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:10.175794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba834087-ac03-4588-8d5b-3bc6b6bc7968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.176432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834087-ac03-4588-8d5b-3bc6b6bc7968 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.176710 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834087-ac03-4588-8d5b-3bc6b6bc7968 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.176979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba834087-ac03-4588-8d5b-3bc6b6bc7968 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.177700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba834087-ac03-4588-8d5b-3bc6b6bc7968 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:10.178005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba834087-ac03-4588-8d5b-3bc6b6bc7968 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:10.179415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba834087-ac03-4588-8d5b-3bc6b6bc7968 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:10.216999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 259/498] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 24 14:13:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:10.217661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba834087-ac03-4588-8d5b-3bc6b6bc7968 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:10.268208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a71acfe-84fa-428d-a757-9eec0db07771 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:10.274655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:10.304797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-261882b3-676c-4f18-ab98-f6560e5ea0f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.305681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261882b3-676c-4f18-ab98-f6560e5ea0f8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.305959 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261882b3-676c-4f18-ab98-f6560e5ea0f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.306232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-261882b3-676c-4f18-ab98-f6560e5ea0f8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.319308 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261882b3-676c-4f18-ab98-f6560e5ea0f8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:10.320915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-261882b3-676c-4f18-ab98-f6560e5ea0f8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:10.324633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba834087-ac03-4588-8d5b-3bc6b6bc7968 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-261882b3-676c-4f18-ab98-f6560e5ea0f8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:10.337467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:10.338389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:10.339221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:10.339221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:10.339221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:10.339221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 240/499] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:10.339945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697b192-283c-4f5c-ab83-09f8328588f2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.340053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697b192-283c-4f5c-ab83-09f8328588f2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.340374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8697b192-283c-4f5c-ab83-09f8328588f2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.346546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 241/500] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:10 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:10.347157 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697b192-283c-4f5c-ab83-09f8328588f2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:10.366288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639d1a-9039-42a4-9e97-823405207a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.367011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639d1a-9039-42a4-9e97-823405207a41 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.367292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639d1a-9039-42a4-9e97-823405207a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.367565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad639d1a-9039-42a4-9e97-823405207a41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.378038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad639d1a-9039-42a4-9e97-823405207a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:10.379427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad639d1a-9039-42a4-9e97-823405207a41 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:10.382984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ad639d1a-9039-42a4-9e97-823405207a41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:10.395949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:10.396978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:10.397847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:10.397847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:10.397847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:10.397847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 260/501] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:10.397847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639d1a-9039-42a4-9e97-823405207a41 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:10.462480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8697b192-283c-4f5c-ab83-09f8328588f2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:10.496458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe68ef8-b735-4da9-80c7-8df028ed3c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.497067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68ef8-b735-4da9-80c7-8df028ed3c4c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.497349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68ef8-b735-4da9-80c7-8df028ed3c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.497629 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe68ef8-b735-4da9-80c7-8df028ed3c4c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.504091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad639d1a-9039-42a4-9e97-823405207a41 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:10.511059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:10.538962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca96e71-1f02-4511-ba31-d3938a2493ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.539563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca96e71-1f02-4511-ba31-d3938a2493ec None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.539841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca96e71-1f02-4511-ba31-d3938a2493ec None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.540115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca96e71-1f02-4511-ba31-d3938a2493ec None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.540790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca96e71-1f02-4511-ba31-d3938a2493ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:10.541158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca96e71-1f02-4511-ba31-d3938a2493ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:10.542528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca96e71-1f02-4511-ba31-d3938a2493ec None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:10.554333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 261/502] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:10.555496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b14d-761e-460e-87e4-82fec0026d85 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.555779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b14d-761e-460e-87e4-82fec0026d85 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.556053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f88b14d-761e-460e-87e4-82fec0026d85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.567728 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe68ef8-b735-4da9-80c7-8df028ed3c4c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:10.569235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe68ef8-b735-4da9-80c7-8df028ed3c4c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:10.573267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4f88b14d-761e-460e-87e4-82fec0026d85 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:10.574451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4f88b14d-761e-460e-87e4-82fec0026d85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:10.599434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:10.639646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 262/503] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:10.640428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b14d-761e-460e-87e4-82fec0026d85 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:10.681575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 242/504] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:10.681575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe68ef8-b735-4da9-80c7-8df028ed3c4c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:10.743656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:10.754440 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f88b14d-761e-460e-87e4-82fec0026d85 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:10.778332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe68ef8-b735-4da9-80c7-8df028ed3c4c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:10.794763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a582a4-525a-4928-8ed8-4c1cafbd5567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.795367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a582a4-525a-4928-8ed8-4c1cafbd5567 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.795659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a582a4-525a-4928-8ed8-4c1cafbd5567 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.795915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a582a4-525a-4928-8ed8-4c1cafbd5567 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.796577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a582a4-525a-4928-8ed8-4c1cafbd5567 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:10.796878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a582a4-525a-4928-8ed8-4c1cafbd5567 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:10.798267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a582a4-525a-4928-8ed8-4c1cafbd5567 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:10.812891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:10.814835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 263/505] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:10.815226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a582a4-525a-4928-8ed8-4c1cafbd5567 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:10.823063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216ec7c-ae92-47e1-aa7b-b9b3e4d3d495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.823702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ec7c-ae92-47e1-aa7b-b9b3e4d3d495 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.823983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ec7c-ae92-47e1-aa7b-b9b3e4d3d495 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.824289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1216ec7c-ae92-47e1-aa7b-b9b3e4d3d495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.835756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216ec7c-ae92-47e1-aa7b-b9b3e4d3d495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:10.837259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1216ec7c-ae92-47e1-aa7b-b9b3e4d3d495 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1216ec7c-ae92-47e1-aa7b-b9b3e4d3d495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:10.853214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:10.854147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:10.854991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:10.854991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:10.854991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:10.854991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 243/506] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:10.856280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216ec7c-ae92-47e1-aa7b-b9b3e4d3d495 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:10.927795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a582a4-525a-4928-8ed8-4c1cafbd5567 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:10.960097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1216ec7c-ae92-47e1-aa7b-b9b3e4d3d495 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:10.960383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe4428-092f-4888-a56b-375f0b07770a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.961001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe4428-092f-4888-a56b-375f0b07770a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.961277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe4428-092f-4888-a56b-375f0b07770a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.961550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe4428-092f-4888-a56b-375f0b07770a None admin] PATH_INFO: `/v3/users/glance` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:10.968700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe4428-092f-4888-a56b-375f0b07770a None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:10.970706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe4428-092f-4888-a56b-375f0b07770a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-53fe4428-092f-4888-a56b-375f0b07770a None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:10.982888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:10.983790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 264/507] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:10 2022] GET /identity/v3/users/glance => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:10.984720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe4428-092f-4888-a56b-375f0b07770a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:10.996973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96caae-e8b0-4303-bb6c-61d440efc9dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:10.997599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96caae-e8b0-4303-bb6c-61d440efc9dd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:10.997877 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96caae-e8b0-4303-bb6c-61d440efc9dd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:10.998145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a96caae-e8b0-4303-bb6c-61d440efc9dd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.002032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:11.008585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96caae-e8b0-4303-bb6c-61d440efc9dd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:11.010039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a96caae-e8b0-4303-bb6c-61d440efc9dd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7a96caae-e8b0-4303-bb6c-61d440efc9dd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:11.024603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:11.025568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:11.027193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:11.027193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:11.027193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:11.027193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 244/508] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:11.027193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96caae-e8b0-4303-bb6c-61d440efc9dd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.062623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:11.086703 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe4428-092f-4888-a56b-375f0b07770a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:11.119583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226a26f-8bdb-48d8-be6d-47a6095b5750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:11.120225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226a26f-8bdb-48d8-be6d-47a6095b5750 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:11.120504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226a26f-8bdb-48d8-be6d-47a6095b5750 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:11.120779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d226a26f-8bdb-48d8-be6d-47a6095b5750 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.127102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a96caae-e8b0-4303-bb6c-61d440efc9dd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:11.128645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226a26f-8bdb-48d8-be6d-47a6095b5750 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:11.130101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d226a26f-8bdb-48d8-be6d-47a6095b5750 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d226a26f-8bdb-48d8-be6d-47a6095b5750 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:11.140842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:11.142301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:11.143193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 265/509] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:11.143759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226a26f-8bdb-48d8-be6d-47a6095b5750 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.163143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7508365-5fd5-4c61-9e23-14279047139a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:11.163735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7508365-5fd5-4c61-9e23-14279047139a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:11.164011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7508365-5fd5-4c61-9e23-14279047139a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:11.164319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7508365-5fd5-4c61-9e23-14279047139a None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.164953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7508365-5fd5-4c61-9e23-14279047139a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:11.165250 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7508365-5fd5-4c61-9e23-14279047139a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:11.166613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7508365-5fd5-4c61-9e23-14279047139a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:11.178095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 245/510] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:11.178793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7508365-5fd5-4c61-9e23-14279047139a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.219457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:11.243053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d226a26f-8bdb-48d8-be6d-47a6095b5750 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:11.270871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:11.277058 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7508365-5fd5-4c61-9e23-14279047139a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:11.277394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994045-13f9-4e55-bc42-a57ef2233838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:11.278018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994045-13f9-4e55-bc42-a57ef2233838 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:11.278299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994045-13f9-4e55-bc42-a57ef2233838 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:11.278576 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea994045-13f9-4e55-bc42-a57ef2233838 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.288932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea994045-13f9-4e55-bc42-a57ef2233838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ea994045-13f9-4e55-bc42-a57ef2233838 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:11.294124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:11.295044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:11.295876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 266/511] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:11.296588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994045-13f9-4e55-bc42-a57ef2233838 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.314694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11164648-1c66-4f54-8ebf-fba91e3adb18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:11.315296 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11164648-1c66-4f54-8ebf-fba91e3adb18 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:11.315578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11164648-1c66-4f54-8ebf-fba91e3adb18 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:11.315854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11164648-1c66-4f54-8ebf-fba91e3adb18 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.316614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11164648-1c66-4f54-8ebf-fba91e3adb18 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:11.316922 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11164648-1c66-4f54-8ebf-fba91e3adb18 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:11.318377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11164648-1c66-4f54-8ebf-fba91e3adb18 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:11.359053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 246/512] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 24 14:13:11 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:11.359053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11164648-1c66-4f54-8ebf-fba91e3adb18 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.399645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea994045-13f9-4e55-bc42-a57ef2233838 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:11.433528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21a95d-c1bd-42fa-8d3a-b579448195fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:11.434060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a95d-c1bd-42fa-8d3a-b579448195fa None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:11.434342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a95d-c1bd-42fa-8d3a-b579448195fa None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:11.434622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c21a95d-c1bd-42fa-8d3a-b579448195fa None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.435260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21a95d-c1bd-42fa-8d3a-b579448195fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:11.435567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21a95d-c1bd-42fa-8d3a-b579448195fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:11.436961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c21a95d-c1bd-42fa-8d3a-b579448195fa None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:11.439745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:11.449701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 267/513] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:11.450473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21a95d-c1bd-42fa-8d3a-b579448195fa None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.457203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11164648-1c66-4f54-8ebf-fba91e3adb18 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:11.493985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84d767-f984-4723-b043-dc00e8a19910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:11.494585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84d767-f984-4723-b043-dc00e8a19910 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:11.494869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84d767-f984-4723-b043-dc00e8a19910 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:11.495133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b84d767-f984-4723-b043-dc00e8a19910 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.495846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84d767-f984-4723-b043-dc00e8a19910 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:11.496184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84d767-f984-4723-b043-dc00e8a19910 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:11.497612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b84d767-f984-4723-b043-dc00e8a19910 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:11.515081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 247/514] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 24 14:13:11 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:11.515876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84d767-f984-4723-b043-dc00e8a19910 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.530510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:11.553373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c21a95d-c1bd-42fa-8d3a-b579448195fa None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:11.586691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a98138-7877-4c98-a7ad-15e93c26bf3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:11.587289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98138-7877-4c98-a7ad-15e93c26bf3c None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:11.587564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98138-7877-4c98-a7ad-15e93c26bf3c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:11.587835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a98138-7877-4c98-a7ad-15e93c26bf3c None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.588505 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a98138-7877-4c98-a7ad-15e93c26bf3c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:11.589924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a98138-7877-4c98-a7ad-15e93c26bf3c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:11.611244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 268/515] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:13:11 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:11.612055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a98138-7877-4c98-a7ad-15e93c26bf3c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.626503 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b84d767-f984-4723-b043-dc00e8a19910 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:11.666520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5230b7-221b-4763-9146-a61f8b77ba24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:11.667462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5230b7-221b-4763-9146-a61f8b77ba24 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:11.667744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5230b7-221b-4763-9146-a61f8b77ba24 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:11.668019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5230b7-221b-4763-9146-a61f8b77ba24 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.668803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5230b7-221b-4763-9146-a61f8b77ba24 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:11.669076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5230b7-221b-4763-9146-a61f8b77ba24 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:11.670515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5230b7-221b-4763-9146-a61f8b77ba24 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:11.678187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:11.685680 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 248/516] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:11.685680 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5230b7-221b-4763-9146-a61f8b77ba24 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.743586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a98138-7877-4c98-a7ad-15e93c26bf3c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:11.773091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:11.784274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39b45-796d-4d99-84b8-ca1b7f3c623d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:11.784997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39b45-796d-4d99-84b8-ca1b7f3c623d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:11.785276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39b45-796d-4d99-84b8-ca1b7f3c623d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:11.785550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc39b45-796d-4d99-84b8-ca1b7f3c623d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.805975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5230b7-221b-4763-9146-a61f8b77ba24 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:11.846460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a650e-313e-4aac-86c3-34847de3b3ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:11.847093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a650e-313e-4aac-86c3-34847de3b3ce None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:11.847376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a650e-313e-4aac-86c3-34847de3b3ce None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:11.847651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74a650e-313e-4aac-86c3-34847de3b3ce None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:11.855084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a650e-313e-4aac-86c3-34847de3b3ce None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:11.856602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f74a650e-313e-4aac-86c3-34847de3b3ce None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:11.864806 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc39b45-796d-4d99-84b8-ca1b7f3c623d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:11.866435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc39b45-796d-4d99-84b8-ca1b7f3c623d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f74a650e-313e-4aac-86c3-34847de3b3ce None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:11.869145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:11.869995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:11.871044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:11.871044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:11.871044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:11.871044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:11.871044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:11.871044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:11.871044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:11.871044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:11.871044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 249/517] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:11.871609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a650e-313e-4aac-86c3-34847de3b3ce None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.928322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:11.978442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 269/518] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:11.979216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39b45-796d-4d99-84b8-ca1b7f3c623d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:11.991041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f74a650e-313e-4aac-86c3-34847de3b3ce None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:12.027038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70496f-403d-4db5-8dcc-878348755591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:12.027642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70496f-403d-4db5-8dcc-878348755591 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:12.027926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70496f-403d-4db5-8dcc-878348755591 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:12.028226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac70496f-403d-4db5-8dcc-878348755591 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:12.031025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:12.085760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc39b45-796d-4d99-84b8-ca1b7f3c623d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:12.102837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70496f-403d-4db5-8dcc-878348755591 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:12.104597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac70496f-403d-4db5-8dcc-878348755591 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:12.120478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fabbc8-07da-49b0-ab22-d8918446a468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:12.121106 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabbc8-07da-49b0-ab22-d8918446a468 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:12.121385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabbc8-07da-49b0-ab22-d8918446a468 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:12.121656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5fabbc8-07da-49b0-ab22-d8918446a468 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:12.133202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fabbc8-07da-49b0-ab22-d8918446a468 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:12.135728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5fabbc8-07da-49b0-ab22-d8918446a468 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a5fabbc8-07da-49b0-ab22-d8918446a468 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:12.149847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:12.150754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:12.151618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:12.151618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:12.151618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:12.151618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 270/519] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:12.151835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fabbc8-07da-49b0-ab22-d8918446a468 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:12.158334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:12.224081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 250/520] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:12.225306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70496f-403d-4db5-8dcc-878348755591 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:12.261580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:12.263886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5fabbc8-07da-49b0-ab22-d8918446a468 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:12.299386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57a6f7-4ec0-47d0-b59e-f67da736d483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:12.299998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57a6f7-4ec0-47d0-b59e-f67da736d483 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:12.300308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57a6f7-4ec0-47d0-b59e-f67da736d483 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:12.301336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e57a6f7-4ec0-47d0-b59e-f67da736d483 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:12.301336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57a6f7-4ec0-47d0-b59e-f67da736d483 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:12.301592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57a6f7-4ec0-47d0-b59e-f67da736d483 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:12.303730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e57a6f7-4ec0-47d0-b59e-f67da736d483 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:12.326770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 271/521] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:12.329129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57a6f7-4ec0-47d0-b59e-f67da736d483 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:12.334187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac70496f-403d-4db5-8dcc-878348755591 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:12.372691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85532d40-c84a-4bf8-95ab-8689367fb396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:12.373335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85532d40-c84a-4bf8-95ab-8689367fb396 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:12.373620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85532d40-c84a-4bf8-95ab-8689367fb396 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:12.373897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85532d40-c84a-4bf8-95ab-8689367fb396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:12.384818 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85532d40-c84a-4bf8-95ab-8689367fb396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:12.386311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85532d40-c84a-4bf8-95ab-8689367fb396 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-85532d40-c84a-4bf8-95ab-8689367fb396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:12.403061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:12.404021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:12.404918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:12.404918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:12.404918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:12.404918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 251/522] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:12.404918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85532d40-c84a-4bf8-95ab-8689367fb396 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:12.412359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:12.455744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e57a6f7-4ec0-47d0-b59e-f67da736d483 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:12.496642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:12.498634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6455e-6206-471c-a69d-9e0ca211258a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:12.499290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6455e-6206-471c-a69d-9e0ca211258a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:12.500061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6455e-6206-471c-a69d-9e0ca211258a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:12.500540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c6455e-6206-471c-a69d-9e0ca211258a None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:12.501787 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6455e-6206-471c-a69d-9e0ca211258a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:12.502106 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6455e-6206-471c-a69d-9e0ca211258a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:12.503860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71c6455e-6206-471c-a69d-9e0ca211258a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:12.511881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85532d40-c84a-4bf8-95ab-8689367fb396 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:12.521790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 272/523] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:12.521790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6455e-6206-471c-a69d-9e0ca211258a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:12.551682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99978684-f901-47a3-a7c1-7ecd23cca96b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:12.552368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978684-f901-47a3-a7c1-7ecd23cca96b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:12.552649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978684-f901-47a3-a7c1-7ecd23cca96b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:12.552924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99978684-f901-47a3-a7c1-7ecd23cca96b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:12.565511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99978684-f901-47a3-a7c1-7ecd23cca96b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:12.566970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99978684-f901-47a3-a7c1-7ecd23cca96b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-99978684-f901-47a3-a7c1-7ecd23cca96b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:12.582834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:12.583751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:12.585151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:12.585151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:12.585151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:12.585151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 252/524] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:12.585151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99978684-f901-47a3-a7c1-7ecd23cca96b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:12.637399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c6455e-6206-471c-a69d-9e0ca211258a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:12.661617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:12.673329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc61153-4622-452b-8ab1-365bb3598a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:12.673930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc61153-4622-452b-8ab1-365bb3598a83 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:12.674207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc61153-4622-452b-8ab1-365bb3598a83 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:12.674480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc61153-4622-452b-8ab1-365bb3598a83 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:12.675194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc61153-4622-452b-8ab1-365bb3598a83 None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=758be68931aa49e5828bc2c164940571) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:12.675503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc61153-4622-452b-8ab1-365bb3598a83 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:12.677007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc61153-4622-452b-8ab1-365bb3598a83 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:12.692196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 273/525] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:12 2022] GET /identity/v3/role_assignments?user.id=758be68931aa49e5828bc2c164940571&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:12.692196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc61153-4622-452b-8ab1-365bb3598a83 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:12.703248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99978684-f901-47a3-a7c1-7ecd23cca96b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:12.745284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d29e2c-926e-41a3-9078-caa17789d994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:12.746147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29e2c-926e-41a3-9078-caa17789d994 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:12.746527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29e2c-926e-41a3-9078-caa17789d994 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:12.746923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d29e2c-926e-41a3-9078-caa17789d994 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:12.747676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d29e2c-926e-41a3-9078-caa17789d994 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:12.748083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d29e2c-926e-41a3-9078-caa17789d994 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:12.749632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d29e2c-926e-41a3-9078-caa17789d994 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:12.758454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:12.769649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 253/526] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:12.770671 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d29e2c-926e-41a3-9078-caa17789d994 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:12.817816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc61153-4622-452b-8ab1-365bb3598a83 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:12.863865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c2cdb-f959-49c1-95e0-72632cd76e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:12.864542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c2cdb-f959-49c1-95e0-72632cd76e8d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:12.864825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c2cdb-f959-49c1-95e0-72632cd76e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:12.865099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6c2cdb-f959-49c1-95e0-72632cd76e8d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:12.875281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c2cdb-f959-49c1-95e0-72632cd76e8d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:12.876867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de6c2cdb-f959-49c1-95e0-72632cd76e8d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:12.887829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d29e2c-926e-41a3-9078-caa17789d994 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-de6c2cdb-f959-49c1-95e0-72632cd76e8d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:12.890583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:12.892029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:12.893433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:12.893433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:12.893433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:12.893433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:12.893433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:12.893433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:12.893433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:12.893433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:12.893433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 14:13:12.893433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:12.896912 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 274/527] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:12 2022] GET /identity/v3/users/neutron => generated 85 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:12.897792 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c2cdb-f959-49c1-95e0-72632cd76e8d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:12.928645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c03f8-1e73-4b48-bd9c-1f88102d2b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:12.929496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c03f8-1e73-4b48-bd9c-1f88102d2b80 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:12.930056 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c03f8-1e73-4b48-bd9c-1f88102d2b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:12.930476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795c03f8-1e73-4b48-bd9c-1f88102d2b80 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:12.931363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c03f8-1e73-4b48-bd9c-1f88102d2b80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:12.931840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c03f8-1e73-4b48-bd9c-1f88102d2b80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:12.933447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795c03f8-1e73-4b48-bd9c-1f88102d2b80 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:12.948938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:12.951475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 254/528] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:12.952543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c03f8-1e73-4b48-bd9c-1f88102d2b80 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:13.008178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6c2cdb-f959-49c1-95e0-72632cd76e8d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:13.028753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:13.042925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc26f46-05cb-423e-9da1-3f246d1a5aa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:13.043556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc26f46-05cb-423e-9da1-3f246d1a5aa5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:13.043841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc26f46-05cb-423e-9da1-3f246d1a5aa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:13.044117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcc26f46-05cb-423e-9da1-3f246d1a5aa5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:13.054419 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc26f46-05cb-423e-9da1-3f246d1a5aa5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:13.054419 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcc26f46-05cb-423e-9da1-3f246d1a5aa5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-fcc26f46-05cb-423e-9da1-3f246d1a5aa5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:13.070774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:13.071851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:13.072959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:13.072959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:13.072959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:13.072959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:13.072959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:13.072959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:13.072959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:13.072959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:13.072959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 275/529] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:13.073546 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc26f46-05cb-423e-9da1-3f246d1a5aa5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:13.083859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795c03f8-1e73-4b48-bd9c-1f88102d2b80 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:13.120123 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac78f1e-d53a-44f7-9622-f284b298096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:13.120762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac78f1e-d53a-44f7-9622-f284b298096a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:13.121041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac78f1e-d53a-44f7-9622-f284b298096a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:13.121417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac78f1e-d53a-44f7-9622-f284b298096a None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:13.122264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac78f1e-d53a-44f7-9622-f284b298096a None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:13.122577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac78f1e-d53a-44f7-9622-f284b298096a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:13.124032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac78f1e-d53a-44f7-9622-f284b298096a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:13.149610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 255/530] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Sep 24 14:13:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:13.150448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac78f1e-d53a-44f7-9622-f284b298096a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:13.185082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcc26f46-05cb-423e-9da1-3f246d1a5aa5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:13.194320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:13.221280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffafc43-00e8-4056-bc22-9962f88f74b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:13.221917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffafc43-00e8-4056-bc22-9962f88f74b4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:13.222190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffafc43-00e8-4056-bc22-9962f88f74b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:13.222499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffafc43-00e8-4056-bc22-9962f88f74b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:13.230160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffafc43-00e8-4056-bc22-9962f88f74b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:13.231629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffafc43-00e8-4056-bc22-9962f88f74b4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5ffafc43-00e8-4056-bc22-9962f88f74b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:13.245992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:13.247078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:13.247959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:13.247959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:13.247959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:13.247959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:13.247959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:13.247959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:13.247959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:13.247959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:13.247959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 276/531] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:13.252573 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffafc43-00e8-4056-bc22-9962f88f74b4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:13.276232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac78f1e-d53a-44f7-9622-f284b298096a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:13.294718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:13.314338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96548beb-564c-4b01-937e-76d09d92fd0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:13.314946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548beb-564c-4b01-937e-76d09d92fd0c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:13.315223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548beb-564c-4b01-937e-76d09d92fd0c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:13.315554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96548beb-564c-4b01-937e-76d09d92fd0c None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:13.316435 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96548beb-564c-4b01-937e-76d09d92fd0c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:13.316743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96548beb-564c-4b01-937e-76d09d92fd0c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:13.318840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96548beb-564c-4b01-937e-76d09d92fd0c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:13.346446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 256/532] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:13.346446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96548beb-564c-4b01-937e-76d09d92fd0c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:13.393650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffafc43-00e8-4056-bc22-9962f88f74b4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:13.441039 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa17236-6899-4ca7-9723-6c318877f581 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:13.441676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa17236-6899-4ca7-9723-6c318877f581 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:13.441915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa17236-6899-4ca7-9723-6c318877f581 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:13.442224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa17236-6899-4ca7-9723-6c318877f581 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:13.455407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96548beb-564c-4b01-937e-76d09d92fd0c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:13.501485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:13.502480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cd6f5-ddd9-44e5-9c02-2ef2c86e2a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:13.503316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cd6f5-ddd9-44e5-9c02-2ef2c86e2a0f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:13.507698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cd6f5-ddd9-44e5-9c02-2ef2c86e2a0f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:13.507698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6cd6f5-ddd9-44e5-9c02-2ef2c86e2a0f None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:13.507698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cd6f5-ddd9-44e5-9c02-2ef2c86e2a0f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:13.507698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cd6f5-ddd9-44e5-9c02-2ef2c86e2a0f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:13.507698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6cd6f5-ddd9-44e5-9c02-2ef2c86e2a0f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:13.523908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 257/533] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:13.524901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cd6f5-ddd9-44e5-9c02-2ef2c86e2a0f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:13.543787 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa17236-6899-4ca7-9723-6c318877f581 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:13.545999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa17236-6899-4ca7-9723-6c318877f581 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:13.562745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:13.632952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6cd6f5-ddd9-44e5-9c02-2ef2c86e2a0f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:13.674023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf8d88-4958-4ffc-a590-d8c59c315f61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:13.674739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf8d88-4958-4ffc-a590-d8c59c315f61 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:13.675086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf8d88-4958-4ffc-a590-d8c59c315f61 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:13.675431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddf8d88-4958-4ffc-a590-d8c59c315f61 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:13.676306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf8d88-4958-4ffc-a590-d8c59c315f61 None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=0ece8645e0954e1d81837cdcaa2ef1e5) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:13.676690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf8d88-4958-4ffc-a590-d8c59c315f61 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:13.678256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddf8d88-4958-4ffc-a590-d8c59c315f61 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:13.683509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 277/534] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:13.684464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa17236-6899-4ca7-9723-6c318877f581 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:13.688997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 258/535] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:13 2022] GET /identity/v3/role_assignments?user.id=0ece8645e0954e1d81837cdcaa2ef1e5&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 259 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:13.697226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf8d88-4958-4ffc-a590-d8c59c315f61 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:13.780595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:13.824925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa17236-6899-4ca7-9723-6c318877f581 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:13.867783 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577e0027-5620-41f3-a8ab-3eec6643a1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:13.868424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0027-5620-41f3-a8ab-3eec6643a1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:13.868705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0027-5620-41f3-a8ab-3eec6643a1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:13.868974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577e0027-5620-41f3-a8ab-3eec6643a1d6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:13.869704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e0027-5620-41f3-a8ab-3eec6643a1d6 None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=c1152b27494941deae022b8a3eb48802) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:13.870013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e0027-5620-41f3-a8ab-3eec6643a1d6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:13.872075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577e0027-5620-41f3-a8ab-3eec6643a1d6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:13.879425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 278/536] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:13 2022] GET /identity/v3/role_assignments?user.id=c1152b27494941deae022b8a3eb48802&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:13.893597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4b3b5-e927-4c8f-9ad4-7a0ef4a31e1b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:13.893891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4b3b5-e927-4c8f-9ad4-7a0ef4a31e1b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:13.894171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d4b3b5-e927-4c8f-9ad4-7a0ef4a31e1b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:13.896204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 279/537] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:13.903605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ec58-4c18-4813-9a87-ad44c43c5dbe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:13.904234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ec58-4c18-4813-9a87-ad44c43c5dbe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:13.904510 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8ec58-4c18-4813-9a87-ad44c43c5dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:13.928418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:13.931760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddf8d88-4958-4ffc-a590-d8c59c315f61 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:13.947763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-76b8ec58-4c18-4813-9a87-ad44c43c5dbe None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:13.949287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-76b8ec58-4c18-4813-9a87-ad44c43c5dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:14.004270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05b201-7d40-45b2-b46d-5e37512e0c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:14.004938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05b201-7d40-45b2-b46d-5e37512e0c5d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:14.005220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05b201-7d40-45b2-b46d-5e37512e0c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:14.005496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05b201-7d40-45b2-b46d-5e37512e0c5d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:14.020611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05b201-7d40-45b2-b46d-5e37512e0c5d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:14.022115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05b201-7d40-45b2-b46d-5e37512e0c5d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-dc05b201-7d40-45b2-b46d-5e37512e0c5d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:14.040398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:14.041472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:14.042313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:14.042313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:14.042313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:14.042921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 259/538] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:14.048957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05b201-7d40-45b2-b46d-5e37512e0c5d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:14.069747 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 280/539] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:14.178252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05b201-7d40-45b2-b46d-5e37512e0c5d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:14.226971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062374e6-ac08-400d-9c1e-d35094ca7cbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:14.227585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062374e6-ac08-400d-9c1e-d35094ca7cbc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:14.227867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062374e6-ac08-400d-9c1e-d35094ca7cbc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:14.228133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062374e6-ac08-400d-9c1e-d35094ca7cbc None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:14.228799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062374e6-ac08-400d-9c1e-d35094ca7cbc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:14.229099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062374e6-ac08-400d-9c1e-d35094ca7cbc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:14.230477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062374e6-ac08-400d-9c1e-d35094ca7cbc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:14.251036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 260/540] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:14.256536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8ec58-4c18-4813-9a87-ad44c43c5dbe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:14.338541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:14.365485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062374e6-ac08-400d-9c1e-d35094ca7cbc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:14.388536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:14.397508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8ec58-4c18-4813-9a87-ad44c43c5dbe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:14.456788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6241e-2f92-4315-b15a-336eeb30d9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:14.458167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6241e-2f92-4315-b15a-336eeb30d9b4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:14.458661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6241e-2f92-4315-b15a-336eeb30d9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:14.459144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c6241e-2f92-4315-b15a-336eeb30d9b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:14.475166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6241e-2f92-4315-b15a-336eeb30d9b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:14.477000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51c6241e-2f92-4315-b15a-336eeb30d9b4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-51c6241e-2f92-4315-b15a-336eeb30d9b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:14.499990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:14.500930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:14.501769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:14.501769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:14.501769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:14.501769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:14.501769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:14.501769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:14.501769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:14.501769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:14.506429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 281/541] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:14.508481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6241e-2f92-4315-b15a-336eeb30d9b4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:14.539407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062374e6-ac08-400d-9c1e-d35094ca7cbc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:14.630231 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6cff3-710a-4d1c-b7ea-d1f3bb322155 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:14.630879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6cff3-710a-4d1c-b7ea-d1f3bb322155 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:14.631155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6cff3-710a-4d1c-b7ea-d1f3bb322155 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:14.631424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb6cff3-710a-4d1c-b7ea-d1f3bb322155 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:14.660566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c6241e-2f92-4315-b15a-336eeb30d9b4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:14.661227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb6cff3-710a-4d1c-b7ea-d1f3bb322155 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1eb6cff3-710a-4d1c-b7ea-d1f3bb322155 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:14.666120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:14.667024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:14.669181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 261/542] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:14.677126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6cff3-710a-4d1c-b7ea-d1f3bb322155 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:14.684915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:14.699629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918e31d-5679-40e6-9559-e35b1c1a011c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:14.700267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e31d-5679-40e6-9559-e35b1c1a011c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:14.700549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e31d-5679-40e6-9559-e35b1c1a011c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:14.700820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2918e31d-5679-40e6-9559-e35b1c1a011c None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:14.701514 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918e31d-5679-40e6-9559-e35b1c1a011c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:14.701818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918e31d-5679-40e6-9559-e35b1c1a011c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:14.703234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2918e31d-5679-40e6-9559-e35b1c1a011c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:14.730158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 282/543] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:14.742826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918e31d-5679-40e6-9559-e35b1c1a011c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:14.819852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:14.882857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2918e31d-5679-40e6-9559-e35b1c1a011c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:14.887893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb6cff3-710a-4d1c-b7ea-d1f3bb322155 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:14.953952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2af31d-6895-4017-828a-1d7d83edbeea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:14.955977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2af31d-6895-4017-828a-1d7d83edbeea None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:14.956547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2af31d-6895-4017-828a-1d7d83edbeea None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:14.957407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c3cd5e-31ec-4193-8e34-1bec95f223ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:14.958263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3cd5e-31ec-4193-8e34-1bec95f223ee None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:14.958802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2af31d-6895-4017-828a-1d7d83edbeea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:14.959791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2af31d-6895-4017-828a-1d7d83edbeea None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=7014b2868d4b4acea242d068f247c21f) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:14.960364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3cd5e-31ec-4193-8e34-1bec95f223ee None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:14.961005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c3cd5e-31ec-4193-8e34-1bec95f223ee None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:14.961911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3cd5e-31ec-4193-8e34-1bec95f223ee None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:14.962491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2af31d-6895-4017-828a-1d7d83edbeea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:14.963579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3cd5e-31ec-4193-8e34-1bec95f223ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:14.964981 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2af31d-6895-4017-828a-1d7d83edbeea None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:14.967298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c3cd5e-31ec-4193-8e34-1bec95f223ee None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:14.984425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 283/544] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:14 2022] GET /identity/v3/role_assignments?user.id=7014b2868d4b4acea242d068f247c21f&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 259 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:14.992970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 262/545] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:14.999156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2af31d-6895-4017-828a-1d7d83edbeea None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:15.085501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4819fb-f45c-4f48-8277-63c98b8648eb None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:15.086141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4819fb-f45c-4f48-8277-63c98b8648eb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:15.086669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4819fb-f45c-4f48-8277-63c98b8648eb None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:15.088310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 263/546] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:13:15.092950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:15.093993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c1b19-25ca-4d09-896d-cee1855825a4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:15.094319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c1b19-25ca-4d09-896d-cee1855825a4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:15.094594 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c1b19-25ca-4d09-896d-cee1855825a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:15.136288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cf3c1b19-25ca-4d09-896d-cee1855825a4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:15.137516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cf3c1b19-25ca-4d09-896d-cee1855825a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:15.141728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2af31d-6895-4017-828a-1d7d83edbeea None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:15.181453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8cbf7-26e7-4159-b983-3ba4576dfed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:15.182791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8cbf7-26e7-4159-b983-3ba4576dfed5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:15.183265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8cbf7-26e7-4159-b983-3ba4576dfed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:15.183803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eb8cbf7-26e7-4159-b983-3ba4576dfed5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:15.196442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8cbf7-26e7-4159-b983-3ba4576dfed5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:15.198316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eb8cbf7-26e7-4159-b983-3ba4576dfed5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5eb8cbf7-26e7-4159-b983-3ba4576dfed5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:15.216207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:15.217176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:15.218037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:15.218037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:15.218037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:15.218037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 284/547] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:15.225795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8cbf7-26e7-4159-b983-3ba4576dfed5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:15.294709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 264/548] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:13:15.372877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:15.376839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eb8cbf7-26e7-4159-b983-3ba4576dfed5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:15.411963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd391c4c-056a-4b82-a241-55b2a30009fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:15.412611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd391c4c-056a-4b82-a241-55b2a30009fc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:15.412890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd391c4c-056a-4b82-a241-55b2a30009fc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:15.413167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd391c4c-056a-4b82-a241-55b2a30009fc None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:15.413815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd391c4c-056a-4b82-a241-55b2a30009fc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:15.414123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd391c4c-056a-4b82-a241-55b2a30009fc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:15.415487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd391c4c-056a-4b82-a241-55b2a30009fc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:15.428095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 285/549] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:15.433378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c1b19-25ca-4d09-896d-cee1855825a4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:15.505882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:15.550856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c1b19-25ca-4d09-896d-cee1855825a4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:15.599500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103304ae-5a66-4735-b3e8-2e4dd4288931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:15.600425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103304ae-5a66-4735-b3e8-2e4dd4288931 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:15.600705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103304ae-5a66-4735-b3e8-2e4dd4288931 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:15.600976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103304ae-5a66-4735-b3e8-2e4dd4288931 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:15.609764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103304ae-5a66-4735-b3e8-2e4dd4288931 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:15.611230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103304ae-5a66-4735-b3e8-2e4dd4288931 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-103304ae-5a66-4735-b3e8-2e4dd4288931 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:15.623378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:15.624898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:15.626431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 265/550] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:15 2022] GET /identity/v3/users/swift => generated 83 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:15.637290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd391c4c-056a-4b82-a241-55b2a30009fc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:15.760885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103304ae-5a66-4735-b3e8-2e4dd4288931 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:15.775698 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd391c4c-056a-4b82-a241-55b2a30009fc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:15.846282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fea25-bb5f-46d8-a83c-c59f549db1d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:15.846810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fea25-bb5f-46d8-a83c-c59f549db1d2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:15.847086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fea25-bb5f-46d8-a83c-c59f549db1d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:15.847356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5fea25-bb5f-46d8-a83c-c59f549db1d2 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:15.848083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fea25-bb5f-46d8-a83c-c59f549db1d2 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:15.848414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fea25-bb5f-46d8-a83c-c59f549db1d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:15.850824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5fea25-bb5f-46d8-a83c-c59f549db1d2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:15.893833 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 286/551] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 24 14:13:15 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:15.897083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fea25-bb5f-46d8-a83c-c59f549db1d2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:15.917252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103304ae-5a66-4735-b3e8-2e4dd4288931 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:15.930049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:15.960147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:15.970509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ab646-1f2b-4364-86f6-e30e75abe956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:15.971180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ab646-1f2b-4364-86f6-e30e75abe956 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:15.971462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ab646-1f2b-4364-86f6-e30e75abe956 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:15.971737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87ab646-1f2b-4364-86f6-e30e75abe956 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:15.983878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87ab646-1f2b-4364-86f6-e30e75abe956 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a87ab646-1f2b-4364-86f6-e30e75abe956 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:15.990120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:15.991238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:15.992073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 266/552] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 231 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:15.998270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ab646-1f2b-4364-86f6-e30e75abe956 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:16.088565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5fea25-bb5f-46d8-a83c-c59f549db1d2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:16.166257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0e19d3-3ade-4d92-aa28-df0b53aca5b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:16.166783 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e19d3-3ade-4d92-aa28-df0b53aca5b6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:16.167115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e19d3-3ade-4d92-aa28-df0b53aca5b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:16.167388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0e19d3-3ade-4d92-aa28-df0b53aca5b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:16.183254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87ab646-1f2b-4364-86f6-e30e75abe956 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:16.272958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dac81-92a1-4e45-82a1-825a37fb7826 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:16.273588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dac81-92a1-4e45-82a1-825a37fb7826 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:16.273872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dac81-92a1-4e45-82a1-825a37fb7826 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:16.274149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493dac81-92a1-4e45-82a1-825a37fb7826 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:16.274834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dac81-92a1-4e45-82a1-825a37fb7826 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:16.275142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dac81-92a1-4e45-82a1-825a37fb7826 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:16.276922 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493dac81-92a1-4e45-82a1-825a37fb7826 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:16.281418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e19d3-3ade-4d92-aa28-df0b53aca5b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:16.283018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0e19d3-3ade-4d92-aa28-df0b53aca5b6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:16.295768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 267/553] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:16.301223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dac81-92a1-4e45-82a1-825a37fb7826 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:16.302633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:16.395026 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 287/554] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Sep 24 14:13:16.396391 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264edccc-1c35-4b20-8fb2-b2b46b0ca440 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:16.396673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264edccc-1c35-4b20-8fb2-b2b46b0ca440 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:16.396948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264edccc-1c35-4b20-8fb2-b2b46b0ca440 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:16.402009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 288/555] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:16.402009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264edccc-1c35-4b20-8fb2-b2b46b0ca440 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:16.415137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:16.481010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493dac81-92a1-4e45-82a1-825a37fb7826 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:16.512705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264edccc-1c35-4b20-8fb2-b2b46b0ca440 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:16.520846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1980c4c-fe78-4515-9a04-0b2e92b415f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:16.521648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1980c4c-fe78-4515-9a04-0b2e92b415f0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:16.522112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1980c4c-fe78-4515-9a04-0b2e92b415f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:16.522602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1980c4c-fe78-4515-9a04-0b2e92b415f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:16.529262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:16.534701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1980c4c-fe78-4515-9a04-0b2e92b415f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:16.536400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1980c4c-fe78-4515-9a04-0b2e92b415f0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:16.547768 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10e45f0-12cc-412e-b71e-72cdc8903731 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:16.548403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e45f0-12cc-412e-b71e-72cdc8903731 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:16.548677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e45f0-12cc-412e-b71e-72cdc8903731 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:16.548944 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10e45f0-12cc-412e-b71e-72cdc8903731 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c1980c4c-fe78-4515-9a04-0b2e92b415f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:16.550668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:16.551551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:16.552459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:16.552459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:16.552459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:16.552459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 268/556] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:16.553096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b173fc7-50de-4aea-beab-e3ef2d51db7c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:16.553096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b173fc7-50de-4aea-beab-e3ef2d51db7c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:16.553331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b173fc7-50de-4aea-beab-e3ef2d51db7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:16.565895 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e45f0-12cc-412e-b71e-72cdc8903731 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:16.567377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10e45f0-12cc-412e-b71e-72cdc8903731 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:16.572263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4b173fc7-50de-4aea-beab-e3ef2d51db7c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:16.573425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4b173fc7-50de-4aea-beab-e3ef2d51db7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f10e45f0-12cc-412e-b71e-72cdc8903731 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:16.582145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:16.583526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:16.584449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:16.584449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:16.584449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:16.584449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 289/557] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:16.584449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde8aa3-8ee5-42d6-b0f7-74706b004f94 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:16.584725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde8aa3-8ee5-42d6-b0f7-74706b004f94 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:16.585230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afde8aa3-8ee5-42d6-b0f7-74706b004f94 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:16.586312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 290/558] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:16.589355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde8aa3-8ee5-42d6-b0f7-74706b004f94 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:16.659648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 269/559] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:16.660529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b173fc7-50de-4aea-beab-e3ef2d51db7c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:16.705106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:16.716293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afde8aa3-8ee5-42d6-b0f7-74706b004f94 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:16.758693 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26394eda-00ad-4979-a354-80e82f4008b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:16.759529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394eda-00ad-4979-a354-80e82f4008b5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:16.759959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394eda-00ad-4979-a354-80e82f4008b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:16.760408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26394eda-00ad-4979-a354-80e82f4008b5 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:16.761323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26394eda-00ad-4979-a354-80e82f4008b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:16.761772 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26394eda-00ad-4979-a354-80e82f4008b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:16.763365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26394eda-00ad-4979-a354-80e82f4008b5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:16.778432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 291/560] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:16.779981 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1690-891b-40b9-82d8-c88db8cd57a6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:16.780454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1690-891b-40b9-82d8-c88db8cd57a6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:16.780875 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28fb1690-891b-40b9-82d8-c88db8cd57a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:16.786540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b173fc7-50de-4aea-beab-e3ef2d51db7c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:16.802275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-28fb1690-891b-40b9-82d8-c88db8cd57a6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:16.804024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-28fb1690-891b-40b9-82d8-c88db8cd57a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:16.822071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba66ec-3eda-495d-82ed-4f5856a8fdb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:16.822837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba66ec-3eda-495d-82ed-4f5856a8fdb7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:16.823214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba66ec-3eda-495d-82ed-4f5856a8fdb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:16.823585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba66ec-3eda-495d-82ed-4f5856a8fdb7 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:16.824394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba66ec-3eda-495d-82ed-4f5856a8fdb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:16.824798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba66ec-3eda-495d-82ed-4f5856a8fdb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:16.826289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba66ec-3eda-495d-82ed-4f5856a8fdb7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:16.831740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:16.839354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 270/561] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:16.840263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba66ec-3eda-495d-82ed-4f5856a8fdb7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:16.891651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 292/562] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:16.893128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb1690-891b-40b9-82d8-c88db8cd57a6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:16.935572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:16.960591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba66ec-3eda-495d-82ed-4f5856a8fdb7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.003608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc429f-1529-4916-a69d-a3b3062c06df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.004585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc429f-1529-4916-a69d-a3b3062c06df None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.004861 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc429f-1529-4916-a69d-a3b3062c06df None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.005185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc429f-1529-4916-a69d-a3b3062c06df None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.015118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc429f-1529-4916-a69d-a3b3062c06df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:17.015694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28fb1690-891b-40b9-82d8-c88db8cd57a6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.016631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67dc429f-1529-4916-a69d-a3b3062c06df None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-67dc429f-1529-4916-a69d-a3b3062c06df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:17.030077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:17.031060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 271/563] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 24 14:13:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:17.033184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc429f-1529-4916-a69d-a3b3062c06df None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.061694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32feb07-9074-4fc5-b5ec-153e36eec8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.062320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32feb07-9074-4fc5-b5ec-153e36eec8bd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.062595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32feb07-9074-4fc5-b5ec-153e36eec8bd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.063020 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32feb07-9074-4fc5-b5ec-153e36eec8bd None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.070456 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32feb07-9074-4fc5-b5ec-153e36eec8bd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:17.071983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32feb07-9074-4fc5-b5ec-153e36eec8bd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d32feb07-9074-4fc5-b5ec-153e36eec8bd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:17.084320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:17.085233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:17.087151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:17.087151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:17.087151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:17.087151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:17.087151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:17.087151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:17.087151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:17.087151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:17.087151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 293/564] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:17.087151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32feb07-9074-4fc5-b5ec-153e36eec8bd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.110672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:17.161633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc429f-1529-4916-a69d-a3b3062c06df None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.197127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a5bd6-ed44-4f88-a03a-92da70d1fefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.197675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a5bd6-ed44-4f88-a03a-92da70d1fefd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.197953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a5bd6-ed44-4f88-a03a-92da70d1fefd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.198220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238a5bd6-ed44-4f88-a03a-92da70d1fefd None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.208539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238a5bd6-ed44-4f88-a03a-92da70d1fefd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-238a5bd6-ed44-4f88-a03a-92da70d1fefd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:17.213805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:17.214753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 272/565] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:17.215614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a5bd6-ed44-4f88-a03a-92da70d1fefd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.225307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32feb07-9074-4fc5-b5ec-153e36eec8bd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.229928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:17.260266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1e1b9-a3bf-43ba-ab76-ac9bf1056325 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.260877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1e1b9-a3bf-43ba-ab76-ac9bf1056325 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.261157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1e1b9-a3bf-43ba-ab76-ac9bf1056325 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.261433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1e1b9-a3bf-43ba-ab76-ac9bf1056325 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.262158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1e1b9-a3bf-43ba-ab76-ac9bf1056325 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:17.262466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1e1b9-a3bf-43ba-ab76-ac9bf1056325 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:17.263922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1e1b9-a3bf-43ba-ab76-ac9bf1056325 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:17.282097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 294/566] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:17.282851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1e1b9-a3bf-43ba-ab76-ac9bf1056325 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.331881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238a5bd6-ed44-4f88-a03a-92da70d1fefd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.364286 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:17.367032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3ae5a-810e-49c7-b62b-21f95df26c7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.367980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ae5a-810e-49c7-b62b-21f95df26c7a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.368288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ae5a-810e-49c7-b62b-21f95df26c7a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.368558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b3ae5a-810e-49c7-b62b-21f95df26c7a None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.369242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ae5a-810e-49c7-b62b-21f95df26c7a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:17.369545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ae5a-810e-49c7-b62b-21f95df26c7a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:17.370974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b3ae5a-810e-49c7-b62b-21f95df26c7a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:17.388707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 273/567] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:17.388707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3ae5a-810e-49c7-b62b-21f95df26c7a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.395185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1e1b9-a3bf-43ba-ab76-ac9bf1056325 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.430526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e5827-f8ba-4453-a5b3-4cd4f9ac1bbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.431149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5827-f8ba-4453-a5b3-4cd4f9ac1bbf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.431477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5827-f8ba-4453-a5b3-4cd4f9ac1bbf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.431747 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5e5827-f8ba-4453-a5b3-4cd4f9ac1bbf None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.442876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5e5827-f8ba-4453-a5b3-4cd4f9ac1bbf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ca5e5827-f8ba-4453-a5b3-4cd4f9ac1bbf None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:17.447785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:17.448914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:17.449881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:17.452108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 295/568] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:17.453106 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e5827-f8ba-4453-a5b3-4cd4f9ac1bbf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.461489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:17.498735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b3ae5a-810e-49c7-b62b-21f95df26c7a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.541476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eda44d-a807-4542-a953-ead7dd693c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.542000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eda44d-a807-4542-a953-ead7dd693c7e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.542279 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eda44d-a807-4542-a953-ead7dd693c7e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.542550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87eda44d-a807-4542-a953-ead7dd693c7e None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.543207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eda44d-a807-4542-a953-ead7dd693c7e None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:17.543509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eda44d-a807-4542-a953-ead7dd693c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:17.544926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87eda44d-a807-4542-a953-ead7dd693c7e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:17.557628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 274/569] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:17.557628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eda44d-a807-4542-a953-ead7dd693c7e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.575638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5e5827-f8ba-4453-a5b3-4cd4f9ac1bbf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.613416 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf29fe-0e81-46bc-8c4e-fc399fe8ad59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.614043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf29fe-0e81-46bc-8c4e-fc399fe8ad59 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.614323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf29fe-0e81-46bc-8c4e-fc399fe8ad59 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.614590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf29fe-0e81-46bc-8c4e-fc399fe8ad59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.617532 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:17.626219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf29fe-0e81-46bc-8c4e-fc399fe8ad59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:17.627664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf29fe-0e81-46bc-8c4e-fc399fe8ad59 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-06bf29fe-0e81-46bc-8c4e-fc399fe8ad59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:17.642421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:17.643388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:17.644823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:17.644823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:17.644823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:17.644823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 296/570] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:17.644823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf29fe-0e81-46bc-8c4e-fc399fe8ad59 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.658700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87eda44d-a807-4542-a953-ead7dd693c7e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.687532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:17.694310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8a4a-3feb-405c-93f3-c659374430a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.694907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8a4a-3feb-405c-93f3-c659374430a7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.695186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8a4a-3feb-405c-93f3-c659374430a7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.695459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ea8a4a-3feb-405c-93f3-c659374430a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.696203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea8a4a-3feb-405c-93f3-c659374430a7 None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=100d19cd9f1742b7ae913376eb75bbd9) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:17.696516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea8a4a-3feb-405c-93f3-c659374430a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:17.697955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ea8a4a-3feb-405c-93f3-c659374430a7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:17.703183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 275/571] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/role_assignments?user.id=100d19cd9f1742b7ae913376eb75bbd9&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 259 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:17.703986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8a4a-3feb-405c-93f3-c659374430a7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.754530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf29fe-0e81-46bc-8c4e-fc399fe8ad59 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.793107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee55d84-3096-4d62-8b89-34aadc6de505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.793662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee55d84-3096-4d62-8b89-34aadc6de505 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.793947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee55d84-3096-4d62-8b89-34aadc6de505 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.794222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee55d84-3096-4d62-8b89-34aadc6de505 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.794894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee55d84-3096-4d62-8b89-34aadc6de505 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:17.795207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee55d84-3096-4d62-8b89-34aadc6de505 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:17.796649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee55d84-3096-4d62-8b89-34aadc6de505 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:17.805836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 297/572] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:17.807131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c131460-fb6d-48ff-8970-8b72697ea177 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.807488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c131460-fb6d-48ff-8970-8b72697ea177 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.807767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c131460-fb6d-48ff-8970-8b72697ea177 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.813503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 298/573] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:17.813503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c131460-fb6d-48ff-8970-8b72697ea177 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.827688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ea8a4a-3feb-405c-93f3-c659374430a7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.864444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b378c-d0c2-4dc0-b8b8-90dc4b3fd387 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.865086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b378c-d0c2-4dc0-b8b8-90dc4b3fd387 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.865362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b378c-d0c2-4dc0-b8b8-90dc4b3fd387 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.865632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b378c-d0c2-4dc0-b8b8-90dc4b3fd387 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.871173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:17.878085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b378c-d0c2-4dc0-b8b8-90dc4b3fd387 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:17.879565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b378c-d0c2-4dc0-b8b8-90dc4b3fd387 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-867b378c-d0c2-4dc0-b8b8-90dc4b3fd387 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:17.894541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:17.895532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:17.896533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:17.896533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:17.896533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:17.896533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 276/574] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:17.896533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b378c-d0c2-4dc0-b8b8-90dc4b3fd387 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:17.935181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c131460-fb6d-48ff-8970-8b72697ea177 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:17.947304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:17.977263 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd08759a-8478-4f6c-b38b-ada92db03f07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:17.977867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08759a-8478-4f6c-b38b-ada92db03f07 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.978148 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08759a-8478-4f6c-b38b-ada92db03f07 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.978421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd08759a-8478-4f6c-b38b-ada92db03f07 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:17.979062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08759a-8478-4f6c-b38b-ada92db03f07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:17.979487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08759a-8478-4f6c-b38b-ada92db03f07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:17.981002 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd08759a-8478-4f6c-b38b-ada92db03f07 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:17.997186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 299/575] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:17.997186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72f9f-876a-45bb-9c11-0c2c805b8272 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:17.997186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72f9f-876a-45bb-9c11-0c2c805b8272 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:17.997186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dc72f9f-876a-45bb-9c11-0c2c805b8272 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.012147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b378c-d0c2-4dc0-b8b8-90dc4b3fd387 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.013055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7dc72f9f-876a-45bb-9c11-0c2c805b8272 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:18.014258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7dc72f9f-876a-45bb-9c11-0c2c805b8272 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:18.050514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561a0df-3ec7-4c78-8a1c-343a2c2a571a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.051455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561a0df-3ec7-4c78-8a1c-343a2c2a571a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.052007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561a0df-3ec7-4c78-8a1c-343a2c2a571a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.053295 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1561a0df-3ec7-4c78-8a1c-343a2c2a571a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.065305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561a0df-3ec7-4c78-8a1c-343a2c2a571a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:18.066753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1561a0df-3ec7-4c78-8a1c-343a2c2a571a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1561a0df-3ec7-4c78-8a1c-343a2c2a571a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:18.080942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:18.081917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:18.082818 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:18.082818 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:18.082818 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:18.086612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 277/576] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:18.087215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561a0df-3ec7-4c78-8a1c-343a2c2a571a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.093646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 300/577] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:18.095447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc72f9f-876a-45bb-9c11-0c2c805b8272 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.146337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:18.189880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:18.193930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1561a0df-3ec7-4c78-8a1c-343a2c2a571a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.221927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dc72f9f-876a-45bb-9c11-0c2c805b8272 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.231587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08bab2-3797-4028-aae5-60e6afebe42e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.232218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08bab2-3797-4028-aae5-60e6afebe42e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.232499 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08bab2-3797-4028-aae5-60e6afebe42e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.232770 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f08bab2-3797-4028-aae5-60e6afebe42e None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.233427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08bab2-3797-4028-aae5-60e6afebe42e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:18.233822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08bab2-3797-4028-aae5-60e6afebe42e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:18.235768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f08bab2-3797-4028-aae5-60e6afebe42e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:18.252698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 278/578] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:18.252698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08bab2-3797-4028-aae5-60e6afebe42e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.269976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c684-71f4-44d5-b297-a39601faa553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.271176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c684-71f4-44d5-b297-a39601faa553 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.271755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c684-71f4-44d5-b297-a39601faa553 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.272290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d6c684-71f4-44d5-b297-a39601faa553 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.280648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6c684-71f4-44d5-b297-a39601faa553 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:18.282608 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7d6c684-71f4-44d5-b297-a39601faa553 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a7d6c684-71f4-44d5-b297-a39601faa553 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:18.299124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:18.300025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:18.300999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:18.300999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:18.300999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:18.300999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:18.300999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:18.300999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:18.300999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:18.300999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:18.304119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 301/579] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:18.305191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c684-71f4-44d5-b297-a39601faa553 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.366343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f08bab2-3797-4028-aae5-60e6afebe42e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.405048 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276016ba-57c1-41eb-8285-c52bc2304d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.405900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276016ba-57c1-41eb-8285-c52bc2304d76 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.406352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276016ba-57c1-41eb-8285-c52bc2304d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.406817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276016ba-57c1-41eb-8285-c52bc2304d76 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.407627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276016ba-57c1-41eb-8285-c52bc2304d76 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:18.408076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276016ba-57c1-41eb-8285-c52bc2304d76 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:18.409613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276016ba-57c1-41eb-8285-c52bc2304d76 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:18.419258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:18.426600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d6c684-71f4-44d5-b297-a39601faa553 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.426761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 279/580] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:18.426761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276016ba-57c1-41eb-8285-c52bc2304d76 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.446581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:18.459711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abfd15-37dc-4148-8846-5a73e4a7b291 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.460367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abfd15-37dc-4148-8846-5a73e4a7b291 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.460652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abfd15-37dc-4148-8846-5a73e4a7b291 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.460925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98abfd15-37dc-4148-8846-5a73e4a7b291 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.469363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abfd15-37dc-4148-8846-5a73e4a7b291 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:18.470805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98abfd15-37dc-4148-8846-5a73e4a7b291 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-98abfd15-37dc-4148-8846-5a73e4a7b291 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:18.483125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:18.484082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 302/581] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:18.485718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abfd15-37dc-4148-8846-5a73e4a7b291 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.545244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276016ba-57c1-41eb-8285-c52bc2304d76 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.580864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df949cad-8382-4e35-bdf9-dd0c2154e1c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.581401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df949cad-8382-4e35-bdf9-dd0c2154e1c9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.581685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df949cad-8382-4e35-bdf9-dd0c2154e1c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.581953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df949cad-8382-4e35-bdf9-dd0c2154e1c9 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.582658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df949cad-8382-4e35-bdf9-dd0c2154e1c9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:18.582963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df949cad-8382-4e35-bdf9-dd0c2154e1c9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:18.584471 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df949cad-8382-4e35-bdf9-dd0c2154e1c9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:18.592788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98abfd15-37dc-4148-8846-5a73e4a7b291 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.598882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 280/582] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:18.604466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df949cad-8382-4e35-bdf9-dd0c2154e1c9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.628957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f125da-6237-4e38-a20c-f0e1c0839701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.629939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f125da-6237-4e38-a20c-f0e1c0839701 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.630416 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f125da-6237-4e38-a20c-f0e1c0839701 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.630882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f125da-6237-4e38-a20c-f0e1c0839701 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.641733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f125da-6237-4e38-a20c-f0e1c0839701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-26f125da-6237-4e38-a20c-f0e1c0839701 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:18.646984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:18.647992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:18.648925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:18.650085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 303/583] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:18.652988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f125da-6237-4e38-a20c-f0e1c0839701 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.678715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:18.693470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:18.715560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df949cad-8382-4e35-bdf9-dd0c2154e1c9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.751575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c709af-f27b-49d4-9b1e-91170edc5e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.752229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c709af-f27b-49d4-9b1e-91170edc5e37 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.752508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c709af-f27b-49d4-9b1e-91170edc5e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.752781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c709af-f27b-49d4-9b1e-91170edc5e37 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.759605 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c709af-f27b-49d4-9b1e-91170edc5e37 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:18.761079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c709af-f27b-49d4-9b1e-91170edc5e37 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:18.765036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f125da-6237-4e38-a20c-f0e1c0839701 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-05c709af-f27b-49d4-9b1e-91170edc5e37 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:18.772346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:18.773294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 281/584] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:18 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:18.774273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c709af-f27b-49d4-9b1e-91170edc5e37 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.805836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5a8ee-b553-4125-9a9d-ceb66b09642b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.806708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5a8ee-b553-4125-9a9d-ceb66b09642b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.807305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5a8ee-b553-4125-9a9d-ceb66b09642b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.807774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab5a8ee-b553-4125-9a9d-ceb66b09642b None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.808798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5a8ee-b553-4125-9a9d-ceb66b09642b None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:18.809295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5a8ee-b553-4125-9a9d-ceb66b09642b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:18.811003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab5a8ee-b553-4125-9a9d-ceb66b09642b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:18.830221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 304/585] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 24 14:13:18 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:18.831352 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5a8ee-b553-4125-9a9d-ceb66b09642b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.883159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c709af-f27b-49d4-9b1e-91170edc5e37 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.919324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef278-4173-43f4-81c5-b9d1559363f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.920004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef278-4173-43f4-81c5-b9d1559363f4 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.920315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef278-4173-43f4-81c5-b9d1559363f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.920578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7ef278-4173-43f4-81c5-b9d1559363f4 None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/758be68931aa49e5828bc2c164940571/roles/1020ec02ef4e4735be787d3b7d4a89b5` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.924852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:18.929682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:18.937548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ef278-4173-43f4-81c5-b9d1559363f4 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=758be68931aa49e5828bc2c164940571, role_id=1020ec02ef4e4735be787d3b7d4a89b5)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:18.939400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b7ef278-4173-43f4-81c5-b9d1559363f4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:18.950467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab5a8ee-b553-4125-9a9d-ceb66b09642b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:18.958028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 282/586] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:13:18 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/758be68931aa49e5828bc2c164940571/roles/1020ec02ef4e4735be787d3b7d4a89b5 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:13:18.959509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef278-4173-43f4-81c5-b9d1559363f4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:18.988259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21131987-c742-4a6b-b209-d585914bdfd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:18.988894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21131987-c742-4a6b-b209-d585914bdfd8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:18.989176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21131987-c742-4a6b-b209-d585914bdfd8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:18.989496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21131987-c742-4a6b-b209-d585914bdfd8 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:18.990168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21131987-c742-4a6b-b209-d585914bdfd8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:18.990472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21131987-c742-4a6b-b209-d585914bdfd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:18.991874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21131987-c742-4a6b-b209-d585914bdfd8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.005956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 305/587] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:19.005956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21131987-c742-4a6b-b209-d585914bdfd8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.113831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7ef278-4173-43f4-81c5-b9d1559363f4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:19.114474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21131987-c742-4a6b-b209-d585914bdfd8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:19.150350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42c7dd-f191-448b-b829-795042896d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:19.150984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42c7dd-f191-448b-b829-795042896d62 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.151262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42c7dd-f191-448b-b829-795042896d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.151532 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc42c7dd-f191-448b-b829-795042896d62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.164294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:19.165362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa024cd-544b-47d0-a69f-444b8c2e8353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:19.166163 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa024cd-544b-47d0-a69f-444b8c2e8353 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.167461 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42c7dd-f191-448b-b829-795042896d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:19.167871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa024cd-544b-47d0-a69f-444b8c2e8353 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.168424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aa024cd-544b-47d0-a69f-444b8c2e8353 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.169309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc42c7dd-f191-448b-b829-795042896d62 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.169918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa024cd-544b-47d0-a69f-444b8c2e8353 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:19.170754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa024cd-544b-47d0-a69f-444b8c2e8353 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:19.173642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3aa024cd-544b-47d0-a69f-444b8c2e8353 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-dc42c7dd-f191-448b-b829-795042896d62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:19.187384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:19.188754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:19.189761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:19.189761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:19.189761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:19.189761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 306/588] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:19.189761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42c7dd-f191-448b-b829-795042896d62 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.196571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 283/589] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 24 14:13:18 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:19.197562 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa024cd-544b-47d0-a69f-444b8c2e8353 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.263417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:19.304516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc42c7dd-f191-448b-b829-795042896d62 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:19.324912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aa024cd-544b-47d0-a69f-444b8c2e8353 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:19.340675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c25c91-d5cc-474a-aaa2-a991b13b30e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:19.341580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25c91-d5cc-474a-aaa2-a991b13b30e6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.342145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25c91-d5cc-474a-aaa2-a991b13b30e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.342591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6c25c91-d5cc-474a-aaa2-a991b13b30e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.354747 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c25c91-d5cc-474a-aaa2-a991b13b30e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:19.356569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6c25c91-d5cc-474a-aaa2-a991b13b30e6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.368437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4a8ab-f9e9-43f6-ae25-b1beebc44698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:19.368973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4a8ab-f9e9-43f6-ae25-b1beebc44698 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.369249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4a8ab-f9e9-43f6-ae25-b1beebc44698 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.369519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff4a8ab-f9e9-43f6-ae25-b1beebc44698 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.370156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4a8ab-f9e9-43f6-ae25-b1beebc44698 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:19.370455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4a8ab-f9e9-43f6-ae25-b1beebc44698 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:19.371813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff4a8ab-f9e9-43f6-ae25-b1beebc44698 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f6c25c91-d5cc-474a-aaa2-a991b13b30e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:19.373442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:19.374338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:19.375816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:19.375816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:19.375816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:19.378087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 307/590] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:19.379102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c25c91-d5cc-474a-aaa2-a991b13b30e6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.385256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 284/591] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:19.386284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4a8ab-f9e9-43f6-ae25-b1beebc44698 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.429102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:19.498855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6c25c91-d5cc-474a-aaa2-a991b13b30e6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:19.523804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff4a8ab-f9e9-43f6-ae25-b1beebc44698 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:19.534094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:19.535589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bd9af-da34-4113-bb6f-094e6a75beb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:19.536594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bd9af-da34-4113-bb6f-094e6a75beb8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.537113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bd9af-da34-4113-bb6f-094e6a75beb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.537572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954bd9af-da34-4113-bb6f-094e6a75beb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.550044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bd9af-da34-4113-bb6f-094e6a75beb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:19.551706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954bd9af-da34-4113-bb6f-094e6a75beb8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.567753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca16a0a-5bfb-4e6b-b488-ecfd85d86230 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-954bd9af-da34-4113-bb6f-094e6a75beb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:19.568290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:19.569395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:19.570393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:19.570393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:19.570393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:19.571376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca16a0a-5bfb-4e6b-b488-ecfd85d86230 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.571826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca16a0a-5bfb-4e6b-b488-ecfd85d86230 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.572278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca16a0a-5bfb-4e6b-b488-ecfd85d86230 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.573094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca16a0a-5bfb-4e6b-b488-ecfd85d86230 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:19.573555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca16a0a-5bfb-4e6b-b488-ecfd85d86230 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:19.575076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca16a0a-5bfb-4e6b-b488-ecfd85d86230 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.575604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 308/592] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:19.576660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bd9af-da34-4113-bb6f-094e6a75beb8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.591143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 285/593] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:19.592463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca16a0a-5bfb-4e6b-b488-ecfd85d86230 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.679442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:19.690157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954bd9af-da34-4113-bb6f-094e6a75beb8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:19.728782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca16a0a-5bfb-4e6b-b488-ecfd85d86230 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:19.729519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58762d79-2641-4744-8815-10d34db18c59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:19.730533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58762d79-2641-4744-8815-10d34db18c59 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.731125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58762d79-2641-4744-8815-10d34db18c59 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.731487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58762d79-2641-4744-8815-10d34db18c59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.739429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58762d79-2641-4744-8815-10d34db18c59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:19.741107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58762d79-2641-4744-8815-10d34db18c59 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-58762d79-2641-4744-8815-10d34db18c59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:19.755489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:19.756418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:19.757317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:19.757317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:19.757317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:19.757317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:19.757317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:19.757317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:19.757317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:19.757317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:19.759890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 309/594] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:19.761035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58762d79-2641-4744-8815-10d34db18c59 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.768564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecc1b0-2684-490d-8de3-915825745186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:19.769297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecc1b0-2684-490d-8de3-915825745186 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.769673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecc1b0-2684-490d-8de3-915825745186 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.770041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecc1b0-2684-490d-8de3-915825745186 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.770783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecc1b0-2684-490d-8de3-915825745186 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:19.771184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecc1b0-2684-490d-8de3-915825745186 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:19.772707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecc1b0-2684-490d-8de3-915825745186 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.793416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 286/595] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:19.793416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecc1b0-2684-490d-8de3-915825745186 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.826515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:19.893303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58762d79-2641-4744-8815-10d34db18c59 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:19.909128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecc1b0-2684-490d-8de3-915825745186 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:19.932242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8db7-46ec-4953-abb7-92157130d25c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:19.933302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8db7-46ec-4953-abb7-92157130d25c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.933847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8db7-46ec-4953-abb7-92157130d25c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.934122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e5f8db7-46ec-4953-abb7-92157130d25c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.942994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a8b8e1-d8c2-4779-a457-a498ff866782 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:19.943145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f8db7-46ec-4953-abb7-92157130d25c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:19.943591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8b8e1-d8c2-4779-a457-a498ff866782 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.943865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8b8e1-d8c2-4779-a457-a498ff866782 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.944130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a8b8e1-d8c2-4779-a457-a498ff866782 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.944605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e5f8db7-46ec-4953-abb7-92157130d25c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.944835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8b8e1-d8c2-4779-a457-a498ff866782 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:19.945136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8b8e1-d8c2-4779-a457-a498ff866782 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:19.946832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a8b8e1-d8c2-4779-a457-a498ff866782 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1e5f8db7-46ec-4953-abb7-92157130d25c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:19.956949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:19.957916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 310/596] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/users/neutron => generated 85 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:19.958860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8db7-46ec-4953-abb7-92157130d25c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.970293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 287/597] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:19.970293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6af7d-6ced-4309-9370-6617f460a299 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:19.970293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6af7d-6ced-4309-9370-6617f460a299 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:19.970293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb6af7d-6ced-4309-9370-6617f460a299 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:19.970293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 288/598] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:19 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:19.970293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6af7d-6ced-4309-9370-6617f460a299 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:19.982166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:20.067715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:20.075239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e5f8db7-46ec-4953-abb7-92157130d25c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:20.085881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb6af7d-6ced-4309-9370-6617f460a299 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:20.113886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86813e7-18ce-4766-a5dd-37b602da9a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:20.114786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86813e7-18ce-4766-a5dd-37b602da9a0a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:20.115067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86813e7-18ce-4766-a5dd-37b602da9a0a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:20.115336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86813e7-18ce-4766-a5dd-37b602da9a0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:20.121911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4590ec-2655-4a9b-9604-e82c94bdd7b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:20.122061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86813e7-18ce-4766-a5dd-37b602da9a0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:20.122513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4590ec-2655-4a9b-9604-e82c94bdd7b4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:20.122793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4590ec-2655-4a9b-9604-e82c94bdd7b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:20.123065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4590ec-2655-4a9b-9604-e82c94bdd7b4 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:20.123378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86813e7-18ce-4766-a5dd-37b602da9a0a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:20.123783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4590ec-2655-4a9b-9604-e82c94bdd7b4 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:20.124091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4590ec-2655-4a9b-9604-e82c94bdd7b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:20.126150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4590ec-2655-4a9b-9604-e82c94bdd7b4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e86813e7-18ce-4766-a5dd-37b602da9a0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:20.136616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:20.137523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:20.138404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:20.138404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:20.138404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:20.138404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:20.138404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:20.138404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:20.138404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:20.138404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:20.138404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 311/599] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:20.138897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86813e7-18ce-4766-a5dd-37b602da9a0a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:20.151299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 289/600] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Sep 24 14:13:19 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:20.151299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c7fce-787d-4d23-af30-3b1b51690f3f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:20.151299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c7fce-787d-4d23-af30-3b1b51690f3f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:20.151299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11c7fce-787d-4d23-af30-3b1b51690f3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:20.167899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a11c7fce-787d-4d23-af30-3b1b51690f3f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:20.169140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a11c7fce-787d-4d23-af30-3b1b51690f3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:20.225708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:20.240371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 290/601] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:20.241208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c7fce-787d-4d23-af30-3b1b51690f3f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:20.259554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86813e7-18ce-4766-a5dd-37b602da9a0a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:20.306267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177834a0-74aa-471b-9580-9424db5cd349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:20.307874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177834a0-74aa-471b-9580-9424db5cd349 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:20.308655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177834a0-74aa-471b-9580-9424db5cd349 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:20.309140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177834a0-74aa-471b-9580-9424db5cd349 None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/0ece8645e0954e1d81837cdcaa2ef1e5/roles/1020ec02ef4e4735be787d3b7d4a89b5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:20.332010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:20.333473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177834a0-74aa-471b-9580-9424db5cd349 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=0ece8645e0954e1d81837cdcaa2ef1e5, role_id=1020ec02ef4e4735be787d3b7d4a89b5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:20.336311 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177834a0-74aa-471b-9580-9424db5cd349 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:20.355738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 312/602] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:13:20 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/0ece8645e0954e1d81837cdcaa2ef1e5/roles/1020ec02ef4e4735be787d3b7d4a89b5 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:13:20.357375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177834a0-74aa-471b-9580-9424db5cd349 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:20.361553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11c7fce-787d-4d23-af30-3b1b51690f3f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:20.460861 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6cc99-48ca-458b-b64c-db7e1740fed9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:20.461494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cc99-48ca-458b-b64c-db7e1740fed9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:20.461778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cc99-48ca-458b-b64c-db7e1740fed9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:20.462054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28b6cc99-48ca-458b-b64c-db7e1740fed9 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:20.462758 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6cc99-48ca-458b-b64c-db7e1740fed9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:20.463066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6cc99-48ca-458b-b64c-db7e1740fed9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:20.464535 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28b6cc99-48ca-458b-b64c-db7e1740fed9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:20.488088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177834a0-74aa-471b-9580-9424db5cd349 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:20.498487 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 291/603] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:20.515695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6cc99-48ca-458b-b64c-db7e1740fed9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:20.527724 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:20.539888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bada8-d6a6-4705-b423-add2bb141e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:20.541216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bada8-d6a6-4705-b423-add2bb141e37 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:20.542085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bada8-d6a6-4705-b423-add2bb141e37 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:20.542766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6bada8-d6a6-4705-b423-add2bb141e37 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:20.558379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bada8-d6a6-4705-b423-add2bb141e37 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:20.560317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6bada8-d6a6-4705-b423-add2bb141e37 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6d6bada8-d6a6-4705-b423-add2bb141e37 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:20.581062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:20.582150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:20.583030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:20.583030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:20.583030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:20.584878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 313/604] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:20.588259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bada8-d6a6-4705-b423-add2bb141e37 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:20.654870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28b6cc99-48ca-458b-b64c-db7e1740fed9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:20.689432 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb41fd7-89af-458c-8858-31036a53475c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:20.690091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb41fd7-89af-458c-8858-31036a53475c None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:20.690368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb41fd7-89af-458c-8858-31036a53475c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:20.690638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eb41fd7-89af-458c-8858-31036a53475c None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/c1152b27494941deae022b8a3eb48802/roles/1020ec02ef4e4735be787d3b7d4a89b5` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:20.693310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:20.707182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb41fd7-89af-458c-8858-31036a53475c None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=c1152b27494941deae022b8a3eb48802, role_id=1020ec02ef4e4735be787d3b7d4a89b5)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:20.708704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eb41fd7-89af-458c-8858-31036a53475c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:20.725714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 292/605] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:13:20 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/c1152b27494941deae022b8a3eb48802/roles/1020ec02ef4e4735be787d3b7d4a89b5 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:13:20.726815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb41fd7-89af-458c-8858-31036a53475c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:20.736336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6bada8-d6a6-4705-b423-add2bb141e37 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:20.817290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa586-1020-46f4-b082-27b963a9e06e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:20.817938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa586-1020-46f4-b082-27b963a9e06e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:20.818267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa586-1020-46f4-b082-27b963a9e06e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:20.818540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617fa586-1020-46f4-b082-27b963a9e06e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:20.840499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617fa586-1020-46f4-b082-27b963a9e06e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-617fa586-1020-46f4-b082-27b963a9e06e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:20.855013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:20.856089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:20.856975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:20.858801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 314/606] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:20.863133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa586-1020-46f4-b082-27b963a9e06e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:20.908343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eb41fd7-89af-458c-8858-31036a53475c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:20.941902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:20.963392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f21a2c-19bc-4c9f-a0b5-08742d706be4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:20.963989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f21a2c-19bc-4c9f-a0b5-08742d706be4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:20.964297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f21a2c-19bc-4c9f-a0b5-08742d706be4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:20.964567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f21a2c-19bc-4c9f-a0b5-08742d706be4 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:20.965212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f21a2c-19bc-4c9f-a0b5-08742d706be4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:20.965514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f21a2c-19bc-4c9f-a0b5-08742d706be4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:20.966878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f21a2c-19bc-4c9f-a0b5-08742d706be4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:20.981381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 293/607] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:20.986809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f21a2c-19bc-4c9f-a0b5-08742d706be4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:21.034813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617fa586-1020-46f4-b082-27b963a9e06e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:21.038702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:21.079892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12160079-2550-43c7-a895-e22acec4d5fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:21.080906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12160079-2550-43c7-a895-e22acec4d5fb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:21.081856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12160079-2550-43c7-a895-e22acec4d5fb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:21.082329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12160079-2550-43c7-a895-e22acec4d5fb None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:21.083186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12160079-2550-43c7-a895-e22acec4d5fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:21.083704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12160079-2550-43c7-a895-e22acec4d5fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:21.085360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12160079-2550-43c7-a895-e22acec4d5fb None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:21.096021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 315/608] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:21.102252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12160079-2550-43c7-a895-e22acec4d5fb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:21.136339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f21a2c-19bc-4c9f-a0b5-08742d706be4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:21.214343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:21.220109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12160079-2550-43c7-a895-e22acec4d5fb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:21.232196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b41783-ef9f-4f66-82d5-c4d95aba3395 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:21.233191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b41783-ef9f-4f66-82d5-c4d95aba3395 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:21.233191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b41783-ef9f-4f66-82d5-c4d95aba3395 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:21.233448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b41783-ef9f-4f66-82d5-c4d95aba3395 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:21.253430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b41783-ef9f-4f66-82d5-c4d95aba3395 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:21.254911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b41783-ef9f-4f66-82d5-c4d95aba3395 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:21.263297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea3a34-8edb-4917-88f8-eb2468e3ed30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:21.264273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3a34-8edb-4917-88f8-eb2468e3ed30 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:21.264753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3a34-8edb-4917-88f8-eb2468e3ed30 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:21.265236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edea3a34-8edb-4917-88f8-eb2468e3ed30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:21.276748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea3a34-8edb-4917-88f8-eb2468e3ed30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-71b41783-ef9f-4f66-82d5-c4d95aba3395 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:21.277578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:21.278467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:21.279360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:21.279360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:21.279360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:21.279360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:21.279360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:21.279360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:21.279360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:21.279360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:21.281221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edea3a34-8edb-4917-88f8-eb2468e3ed30 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:21.283782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 294/609] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:21.289694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b41783-ef9f-4f66-82d5-c4d95aba3395 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-edea3a34-8edb-4917-88f8-eb2468e3ed30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:21.299012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:21.299945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:21.300884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:21.300884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:21.300884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:21.303740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 316/610] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:21.309496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea3a34-8edb-4917-88f8-eb2468e3ed30 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:21.424633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edea3a34-8edb-4917-88f8-eb2468e3ed30 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:21.448476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b41783-ef9f-4f66-82d5-c4d95aba3395 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:21.452567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:21.469618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8770dec8-6f35-49bc-8353-04b5abc8fb4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:21.470663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770dec8-6f35-49bc-8353-04b5abc8fb4e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:21.471221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770dec8-6f35-49bc-8353-04b5abc8fb4e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:21.471678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8770dec8-6f35-49bc-8353-04b5abc8fb4e None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:21.472855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770dec8-6f35-49bc-8353-04b5abc8fb4e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:21.473333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770dec8-6f35-49bc-8353-04b5abc8fb4e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:21.475655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8770dec8-6f35-49bc-8353-04b5abc8fb4e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:21.495876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c090b-3676-4d17-8e40-0728d7ca0d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:21.495876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c090b-3676-4d17-8e40-0728d7ca0d70 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:21.495876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c090b-3676-4d17-8e40-0728d7ca0d70 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:21.495876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c090b-3676-4d17-8e40-0728d7ca0d70 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:21.496230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 317/611] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:21.496330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c090b-3676-4d17-8e40-0728d7ca0d70 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:21.496330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c090b-3676-4d17-8e40-0728d7ca0d70 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:21.496469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a288a-d372-4c29-a2f4-7dca43a3d62e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:21.496469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a288a-d372-4c29-a2f4-7dca43a3d62e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:21.496469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02a288a-d372-4c29-a2f4-7dca43a3d62e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:21.501067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 318/612] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:21.501190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c090b-3676-4d17-8e40-0728d7ca0d70 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:21.501277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a288a-d372-4c29-a2f4-7dca43a3d62e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:21.518654 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:21.518867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 295/613] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:21.520226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38609017-e4a6-4eb5-84a7-febb88a16ce9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:21.520745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38609017-e4a6-4eb5-84a7-febb88a16ce9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:21.521112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38609017-e4a6-4eb5-84a7-febb88a16ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:21.539761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-38609017-e4a6-4eb5-84a7-febb88a16ce9 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:21.541304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-38609017-e4a6-4eb5-84a7-febb88a16ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:21.625012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02a288a-d372-4c29-a2f4-7dca43a3d62e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:21.634657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 296/614] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:21.635721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38609017-e4a6-4eb5-84a7-febb88a16ce9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:21.664386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f107a1-a7ee-4f8d-939c-567dee90c993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:21.665137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f107a1-a7ee-4f8d-939c-567dee90c993 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:21.665476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f107a1-a7ee-4f8d-939c-567dee90c993 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:21.665827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f107a1-a7ee-4f8d-939c-567dee90c993 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:21.673596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f107a1-a7ee-4f8d-939c-567dee90c993 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:21.675508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7f107a1-a7ee-4f8d-939c-567dee90c993 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-c7f107a1-a7ee-4f8d-939c-567dee90c993 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:21.687545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:21.689485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:21.690939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 319/615] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:21 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:21.694957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f107a1-a7ee-4f8d-939c-567dee90c993 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:21.776781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:21.794563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:21.810205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38609017-e4a6-4eb5-84a7-febb88a16ce9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:21.817859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f107a1-a7ee-4f8d-939c-567dee90c993 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:21.857379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c1f8c-8c51-4716-b615-7ee54dbe07c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:21.858286 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c1f8c-8c51-4716-b615-7ee54dbe07c7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:21.858883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c1f8c-8c51-4716-b615-7ee54dbe07c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:21.859323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752c1f8c-8c51-4716-b615-7ee54dbe07c7 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:21.860278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c1f8c-8c51-4716-b615-7ee54dbe07c7 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:21.860765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c1f8c-8c51-4716-b615-7ee54dbe07c7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:21.862334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752c1f8c-8c51-4716-b615-7ee54dbe07c7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:21.883641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 320/616] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 24 14:13:21 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:21.889558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c1f8c-8c51-4716-b615-7ee54dbe07c7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:21.894789 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85fb4e-036a-4f8d-bf3d-e6a9ce94bda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:21.895652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85fb4e-036a-4f8d-bf3d-e6a9ce94bda8 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:21.896073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85fb4e-036a-4f8d-bf3d-e6a9ce94bda8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:21.896605 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b85fb4e-036a-4f8d-bf3d-e6a9ce94bda8 None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/7014b2868d4b4acea242d068f247c21f/roles/1020ec02ef4e4735be787d3b7d4a89b5` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:21.924955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85fb4e-036a-4f8d-bf3d-e6a9ce94bda8 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=7014b2868d4b4acea242d068f247c21f, role_id=1020ec02ef4e4735be787d3b7d4a89b5)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:21.928703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b85fb4e-036a-4f8d-bf3d-e6a9ce94bda8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:21.950489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 297/617] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:13:21 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/7014b2868d4b4acea242d068f247c21f/roles/1020ec02ef4e4735be787d3b7d4a89b5 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:13:21.961409 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85fb4e-036a-4f8d-bf3d-e6a9ce94bda8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:22.103251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752c1f8c-8c51-4716-b615-7ee54dbe07c7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:22.116468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b85fb4e-036a-4f8d-bf3d-e6a9ce94bda8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:22.159179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b292-972a-4057-a708-dd844970cf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:22.159863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b292-972a-4057-a708-dd844970cf49 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:22.160162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b292-972a-4057-a708-dd844970cf49 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:22.160819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38c8b292-972a-4057-a708-dd844970cf49 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:22.166133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:22.173428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341441-bf1d-438e-bf88-44dbd3e6f970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:22.173616 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38c8b292-972a-4057-a708-dd844970cf49 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:22.174699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341441-bf1d-438e-bf88-44dbd3e6f970 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:22.175129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341441-bf1d-438e-bf88-44dbd3e6f970 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:22.175605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d341441-bf1d-438e-bf88-44dbd3e6f970 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-38c8b292-972a-4057-a708-dd844970cf49 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:22.178539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:22.179960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:22.181414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 298/618] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:22.186323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b292-972a-4057-a708-dd844970cf49 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:22.191177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:22.194726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d341441-bf1d-438e-bf88-44dbd3e6f970 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:22.196553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d341441-bf1d-438e-bf88-44dbd3e6f970 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8d341441-bf1d-438e-bf88-44dbd3e6f970 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:22.213624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:22.214937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:22.216050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:22.216050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:22.216050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:22.217922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 321/619] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:22.224063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341441-bf1d-438e-bf88-44dbd3e6f970 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:22.329201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d341441-bf1d-438e-bf88-44dbd3e6f970 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:22.345363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38c8b292-972a-4057-a708-dd844970cf49 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:22.391112 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52cc46-eb2b-4120-9061-091fe359a190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:22.392404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52cc46-eb2b-4120-9061-091fe359a190 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:22.393156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d092b9-e179-463b-a0e5-a3e885e3affc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:22.393853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d092b9-e179-463b-a0e5-a3e885e3affc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:22.394228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52cc46-eb2b-4120-9061-091fe359a190 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:22.394609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d092b9-e179-463b-a0e5-a3e885e3affc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:22.394997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd52cc46-eb2b-4120-9061-091fe359a190 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:22.395339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d092b9-e179-463b-a0e5-a3e885e3affc None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:22.396096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52cc46-eb2b-4120-9061-091fe359a190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:22.396882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d092b9-e179-463b-a0e5-a3e885e3affc None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:22.397291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52cc46-eb2b-4120-9061-091fe359a190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:22.397704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d092b9-e179-463b-a0e5-a3e885e3affc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:22.399187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd52cc46-eb2b-4120-9061-091fe359a190 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:22.400717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d092b9-e179-463b-a0e5-a3e885e3affc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:22.418806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 299/620] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:22.423953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 322/621] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:22.425039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d092b9-e179-463b-a0e5-a3e885e3affc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:22.429570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52cc46-eb2b-4120-9061-091fe359a190 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:22.517290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:22.551954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:22.599481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd52cc46-eb2b-4120-9061-091fe359a190 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:22.634916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d092b9-e179-463b-a0e5-a3e885e3affc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:22.636725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e6615-1add-455c-bbac-cccde6847c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:22.637423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e6615-1add-455c-bbac-cccde6847c93 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:22.637764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e6615-1add-455c-bbac-cccde6847c93 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:22.638108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4e6615-1add-455c-bbac-cccde6847c93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:22.646948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e6615-1add-455c-bbac-cccde6847c93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:22.648561 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4e6615-1add-455c-bbac-cccde6847c93 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6b4e6615-1add-455c-bbac-cccde6847c93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:22.660668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:22.661552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:22.662454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:22.662454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:22.662454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:22.662454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:22.662454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:22.662454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:22.662454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:22.662454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:22.662454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 323/622] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:22.673355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e6615-1add-455c-bbac-cccde6847c93 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:22.697760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c18025-0bbd-468c-a63b-1a2e16bcb4ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:22.698407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c18025-0bbd-468c-a63b-1a2e16bcb4ac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:22.698689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c18025-0bbd-468c-a63b-1a2e16bcb4ac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:22.698965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c18025-0bbd-468c-a63b-1a2e16bcb4ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:22.724121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c18025-0bbd-468c-a63b-1a2e16bcb4ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:22.725923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c18025-0bbd-468c-a63b-1a2e16bcb4ac None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-56c18025-0bbd-468c-a63b-1a2e16bcb4ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:22.757315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:22.758329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:22.759233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:22.759233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:22.759233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:22.763949 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 300/623] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 336 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:22.766634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c18025-0bbd-468c-a63b-1a2e16bcb4ac None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:22.804487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4e6615-1add-455c-bbac-cccde6847c93 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:22.808565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:22.887301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae121a-3ed6-4a20-8581-b007f47106d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:22.887915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae121a-3ed6-4a20-8581-b007f47106d2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:22.888213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae121a-3ed6-4a20-8581-b007f47106d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:22.888488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ae121a-3ed6-4a20-8581-b007f47106d2 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:22.889180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae121a-3ed6-4a20-8581-b007f47106d2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:22.889860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae121a-3ed6-4a20-8581-b007f47106d2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:22.893242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ae121a-3ed6-4a20-8581-b007f47106d2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:22.917406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 324/624] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:22.923404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae121a-3ed6-4a20-8581-b007f47106d2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:22.962975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c18025-0bbd-468c-a63b-1a2e16bcb4ac None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:22.988921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:23.013170 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f8425d-c445-456c-80f8-c0bc532802e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:23.013703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8425d-c445-456c-80f8-c0bc532802e0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:23.013986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8425d-c445-456c-80f8-c0bc532802e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:23.014260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f8425d-c445-456c-80f8-c0bc532802e0 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:23.015171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8425d-c445-456c-80f8-c0bc532802e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:23.015481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8425d-c445-456c-80f8-c0bc532802e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:23.017850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f8425d-c445-456c-80f8-c0bc532802e0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:23.040344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 301/625] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:23.042092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4e78e-9484-4be1-acd6-ebbf8681faed None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:23.042628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4e78e-9484-4be1-acd6-ebbf8681faed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:23.043086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b4e78e-9484-4be1-acd6-ebbf8681faed None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:23.044831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 302/626] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:23.045685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4e78e-9484-4be1-acd6-ebbf8681faed None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:23.064379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ae121a-3ed6-4a20-8581-b007f47106d2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:23.101653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398bf905-061d-410e-9df4-00f4dcc26ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:23.102702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bf905-061d-410e-9df4-00f4dcc26ca7 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:23.103045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bf905-061d-410e-9df4-00f4dcc26ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:23.103336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398bf905-061d-410e-9df4-00f4dcc26ca7 None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/100d19cd9f1742b7ae913376eb75bbd9/roles/1020ec02ef4e4735be787d3b7d4a89b5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:23.119301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bf905-061d-410e-9df4-00f4dcc26ca7 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=100d19cd9f1742b7ae913376eb75bbd9, role_id=1020ec02ef4e4735be787d3b7d4a89b5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:23.120790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398bf905-061d-410e-9df4-00f4dcc26ca7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:23.137184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 325/627] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:13:22 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/100d19cd9f1742b7ae913376eb75bbd9/roles/1020ec02ef4e4735be787d3b7d4a89b5 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:13:23.138485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c802ca-85bc-49df-81cc-050aaa1afd98 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:23.138827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c802ca-85bc-49df-81cc-050aaa1afd98 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:23.139110 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51c802ca-85bc-49df-81cc-050aaa1afd98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:23.161854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-51c802ca-85bc-49df-81cc-050aaa1afd98 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:23.163084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-51c802ca-85bc-49df-81cc-050aaa1afd98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:23.171842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:23.175241 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b4e78e-9484-4be1-acd6-ebbf8681faed None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:23.245694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2901705-e111-48ae-b8e2-ebd2949794ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:23.246346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2901705-e111-48ae-b8e2-ebd2949794ed None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:23.246626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2901705-e111-48ae-b8e2-ebd2949794ed None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:23.246899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2901705-e111-48ae-b8e2-ebd2949794ed None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:23.259199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2901705-e111-48ae-b8e2-ebd2949794ed None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:23.260721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2901705-e111-48ae-b8e2-ebd2949794ed None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:23.282999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 326/628] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d2901705-e111-48ae-b8e2-ebd2949794ed None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:23.283884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:23.284991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:23.286003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:23.286003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:23.286003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:23.286003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:23.286003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:23.286003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:23.286003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:23.286003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:23.286003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:23.286003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:23.289624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 303/629] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 24 14:13:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:23.295281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c802ca-85bc-49df-81cc-050aaa1afd98 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:23.418038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51c802ca-85bc-49df-81cc-050aaa1afd98 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:23.461618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023f1497-9560-420c-95b2-43343486ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:23.462231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1497-9560-420c-95b2-43343486ad7e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:23.462510 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1497-9560-420c-95b2-43343486ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:23.462785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023f1497-9560-420c-95b2-43343486ad7e None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:23.463568 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f1497-9560-420c-95b2-43343486ad7e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:23.463875 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f1497-9560-420c-95b2-43343486ad7e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:23.465326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023f1497-9560-420c-95b2-43343486ad7e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:23.491703 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:23.499831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 327/630] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 24 14:13:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:23.502962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2901705-e111-48ae-b8e2-ebd2949794ed None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:23.520081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698cf49-4000-4ce2-baef-ebfb61fd1461 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:23.520641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698cf49-4000-4ce2-baef-ebfb61fd1461 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:23.521067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3698cf49-4000-4ce2-baef-ebfb61fd1461 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:23.522559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 328/631] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:13:23.527633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c684d1-45b8-44ea-979d-d0e4a61ea724 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:23.528110 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c684d1-45b8-44ea-979d-d0e4a61ea724 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:23.528568 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c684d1-45b8-44ea-979d-d0e4a61ea724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:23.547508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c4c684d1-45b8-44ea-979d-d0e4a61ea724 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:23.548979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c4c684d1-45b8-44ea-979d-d0e4a61ea724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:23.569899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:23.617888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 329/632] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:13:23.659381 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c684d1-45b8-44ea-979d-d0e4a61ea724 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:23.752206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2901705-e111-48ae-b8e2-ebd2949794ed None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:23.783359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c684d1-45b8-44ea-979d-d0e4a61ea724 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:23.822975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2321f-286b-4a79-8b8c-d68c4f93077b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:23.823839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2321f-286b-4a79-8b8c-d68c4f93077b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:23.824301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2321f-286b-4a79-8b8c-d68c4f93077b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:23.824730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cb2321f-286b-4a79-8b8c-d68c4f93077b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:23.844631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:23.855029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e7418-63ff-46bf-a4ba-edfb606b864e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:23.855879 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e7418-63ff-46bf-a4ba-edfb606b864e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:23.857478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e7418-63ff-46bf-a4ba-edfb606b864e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:23.857911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9e7418-63ff-46bf-a4ba-edfb606b864e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:23.878388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9e7418-63ff-46bf-a4ba-edfb606b864e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-5d9e7418-63ff-46bf-a4ba-edfb606b864e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:23.883666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:23.884765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:23.885611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:23.889010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 330/633] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:23 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:23.895347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e7418-63ff-46bf-a4ba-edfb606b864e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:23.939253 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2321f-286b-4a79-8b8c-d68c4f93077b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:23.940924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cb2321f-286b-4a79-8b8c-d68c4f93077b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:23.992088 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:24.016785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9e7418-63ff-46bf-a4ba-edfb606b864e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:24.061446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045a3f3-8f37-427c-8020-e6fe6e51803c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:24.062053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045a3f3-8f37-427c-8020-e6fe6e51803c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.062332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045a3f3-8f37-427c-8020-e6fe6e51803c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.062661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6045a3f3-8f37-427c-8020-e6fe6e51803c None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.063424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045a3f3-8f37-427c-8020-e6fe6e51803c None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:24.063733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045a3f3-8f37-427c-8020-e6fe6e51803c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:24.065211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6045a3f3-8f37-427c-8020-e6fe6e51803c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:24.068498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 304/634] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 566 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:24.069570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2321f-286b-4a79-8b8c-d68c4f93077b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:24.083577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 331/635] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:23 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:24.088267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045a3f3-8f37-427c-8020-e6fe6e51803c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:24.147755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:24.184760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cb2321f-286b-4a79-8b8c-d68c4f93077b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:24.198877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6045a3f3-8f37-427c-8020-e6fe6e51803c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:24.220484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566119cb-25d0-4580-b3aa-0f88b27a09fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:24.221461 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566119cb-25d0-4580-b3aa-0f88b27a09fb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.222008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566119cb-25d0-4580-b3aa-0f88b27a09fb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.222475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566119cb-25d0-4580-b3aa-0f88b27a09fb None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.230420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:24.236119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-566119cb-25d0-4580-b3aa-0f88b27a09fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:24.239078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e21d6-cc70-42b5-b4af-c092d461bc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:24.239708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e21d6-cc70-42b5-b4af-c092d461bc3e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.239985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e21d6-cc70-42b5-b4af-c092d461bc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.240284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960e21d6-cc70-42b5-b4af-c092d461bc3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-566119cb-25d0-4580-b3aa-0f88b27a09fb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:24.242167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:24.243079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:24.243931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:24.246525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 305/636] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:24.247656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566119cb-25d0-4580-b3aa-0f88b27a09fb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:24.253341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e21d6-cc70-42b5-b4af-c092d461bc3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:24.254276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960e21d6-cc70-42b5-b4af-c092d461bc3e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-960e21d6-cc70-42b5-b4af-c092d461bc3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:24.272198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:24.273292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:24.274184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:24.274184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:24.274184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:24.274184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 332/637] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:24.274184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e21d6-cc70-42b5-b4af-c092d461bc3e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:24.388813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960e21d6-cc70-42b5-b4af-c092d461bc3e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:24.390423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-566119cb-25d0-4580-b3aa-0f88b27a09fb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:24.404540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:24.427654 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5d693-690b-4d9e-b2f3-0cd8c1d34f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:24.428841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5d693-690b-4d9e-b2f3-0cd8c1d34f16 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.429799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5d693-690b-4d9e-b2f3-0cd8c1d34f16 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.430275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5d693-690b-4d9e-b2f3-0cd8c1d34f16 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.431301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5d693-690b-4d9e-b2f3-0cd8c1d34f16 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:24.431828 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5d693-690b-4d9e-b2f3-0cd8c1d34f16 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:24.433906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5d693-690b-4d9e-b2f3-0cd8c1d34f16 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:24.435795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b4f8f-7650-48d1-8bb6-fa83a5f4a04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:24.438703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b4f8f-7650-48d1-8bb6-fa83a5f4a04a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.439006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b4f8f-7650-48d1-8bb6-fa83a5f4a04a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.439281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6b4f8f-7650-48d1-8bb6-fa83a5f4a04a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.446207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 333/638] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:24.447881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5d693-690b-4d9e-b2f3-0cd8c1d34f16 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:24.453815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b4f8f-7650-48d1-8bb6-fa83a5f4a04a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:24.455284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6b4f8f-7650-48d1-8bb6-fa83a5f4a04a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8e6b4f8f-7650-48d1-8bb6-fa83a5f4a04a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:24.470309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:24.471335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:24.472262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:24.472262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:24.472262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:24.472262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 306/639] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:24.472941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b4f8f-7650-48d1-8bb6-fa83a5f4a04a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:24.527192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:24.568009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5d693-690b-4d9e-b2f3-0cd8c1d34f16 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:24.581519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6b4f8f-7650-48d1-8bb6-fa83a5f4a04a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:24.604058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822874bf-5850-4e1e-ba0b-6bbb4966b753 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:24.604825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822874bf-5850-4e1e-ba0b-6bbb4966b753 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.605105 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822874bf-5850-4e1e-ba0b-6bbb4966b753 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.605496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822874bf-5850-4e1e-ba0b-6bbb4966b753 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.606140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822874bf-5850-4e1e-ba0b-6bbb4966b753 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:24.606447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822874bf-5850-4e1e-ba0b-6bbb4966b753 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:24.607933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-822874bf-5850-4e1e-ba0b-6bbb4966b753 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:24.616370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79e567ab-102e-498b-9727-df9787e8d68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:24.616994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e567ab-102e-498b-9727-df9787e8d68d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.617269 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e567ab-102e-498b-9727-df9787e8d68d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.617536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79e567ab-102e-498b-9727-df9787e8d68d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.625538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 334/640] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:24.625538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822874bf-5850-4e1e-ba0b-6bbb4966b753 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:24.629892 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e567ab-102e-498b-9727-df9787e8d68d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:24.631445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79e567ab-102e-498b-9727-df9787e8d68d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-79e567ab-102e-498b-9727-df9787e8d68d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:24.645563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:24.646767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:24.647791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:24.647791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:24.647791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:24.647791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 307/641] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:24.648802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f24e9-7978-4053-b1c2-b75e8b28c695 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.649080 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f24e9-7978-4053-b1c2-b75e8b28c695 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.649350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7f24e9-7978-4053-b1c2-b75e8b28c695 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.650702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 308/642] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:24 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:24.655207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f24e9-7978-4053-b1c2-b75e8b28c695 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:24.658696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:24.737033 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-822874bf-5850-4e1e-ba0b-6bbb4966b753 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:24.757382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7f24e9-7978-4053-b1c2-b75e8b28c695 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:24.758952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:24.774155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb8735-4b0c-4148-861c-b3a48eaa2353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:24.774751 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb8735-4b0c-4148-861c-b3a48eaa2353 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.775029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb8735-4b0c-4148-861c-b3a48eaa2353 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.775300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aebb8735-4b0c-4148-861c-b3a48eaa2353 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.775930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb8735-4b0c-4148-861c-b3a48eaa2353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:24.776267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb8735-4b0c-4148-861c-b3a48eaa2353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:24.777619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aebb8735-4b0c-4148-861c-b3a48eaa2353 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:24.793933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 335/643] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:24.793933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb8735-4b0c-4148-861c-b3a48eaa2353 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:24.802187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3220f89-b7cf-41c0-9332-9fca9bdba33d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:24.802881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3220f89-b7cf-41c0-9332-9fca9bdba33d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.803222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3220f89-b7cf-41c0-9332-9fca9bdba33d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.803562 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3220f89-b7cf-41c0-9332-9fca9bdba33d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.810652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3220f89-b7cf-41c0-9332-9fca9bdba33d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:24.812074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3220f89-b7cf-41c0-9332-9fca9bdba33d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e3220f89-b7cf-41c0-9332-9fca9bdba33d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:24.824316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:24.825400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:24.826701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:24.826701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:24.826701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:24.826701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:24.826701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:24.826701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:24.826701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:24.826701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:24.832966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 309/644] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:24.832966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aff0ea-ca4e-4ae6-9901-909b2d1d4391 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.832966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aff0ea-ca4e-4ae6-9901-909b2d1d4391 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.832966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20aff0ea-ca4e-4ae6-9901-909b2d1d4391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.848071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-20aff0ea-ca4e-4ae6-9901-909b2d1d4391 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:24.849408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-20aff0ea-ca4e-4ae6-9901-909b2d1d4391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:24.893398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:24.910752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aebb8735-4b0c-4148-861c-b3a48eaa2353 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:24.927413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 310/645] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:24.927413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aff0ea-ca4e-4ae6-9901-909b2d1d4391 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:24.961664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4db17-105f-4d3f-b297-5a17ccc55323 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:24.962538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4db17-105f-4d3f-b297-5a17ccc55323 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:24.962989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4db17-105f-4d3f-b297-5a17ccc55323 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:24.963420 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b4db17-105f-4d3f-b297-5a17ccc55323 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:24.964241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4db17-105f-4d3f-b297-5a17ccc55323 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:24.964694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4db17-105f-4d3f-b297-5a17ccc55323 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:24.966742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b4db17-105f-4d3f-b297-5a17ccc55323 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:24.982183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 336/646] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:24.983275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4db17-105f-4d3f-b297-5a17ccc55323 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:25.024565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:25.036851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20aff0ea-ca4e-4ae6-9901-909b2d1d4391 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:25.074516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7c20c-1223-4cda-8333-0da531f67eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:25.075151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c20c-1223-4cda-8333-0da531f67eab None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.075428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c20c-1223-4cda-8333-0da531f67eab None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.075699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0f7c20c-1223-4cda-8333-0da531f67eab None admin] PATH_INFO: `/v3/users/glance` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:25.083179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7c20c-1223-4cda-8333-0da531f67eab None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:25.084796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0f7c20c-1223-4cda-8333-0da531f67eab None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f0f7c20c-1223-4cda-8333-0da531f67eab None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:25.097271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:25.098246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:25.099205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 311/647] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/users/glance => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:25.100076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7c20c-1223-4cda-8333-0da531f67eab None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:25.111891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b4db17-105f-4d3f-b297-5a17ccc55323 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:25.153742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd896c-7783-49f6-8679-5b8ba4af5127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:25.155161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd896c-7783-49f6-8679-5b8ba4af5127 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.155645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd896c-7783-49f6-8679-5b8ba4af5127 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.156620 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fdd896c-7783-49f6-8679-5b8ba4af5127 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:25.157803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd896c-7783-49f6-8679-5b8ba4af5127 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:25.158314 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd896c-7783-49f6-8679-5b8ba4af5127 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:25.160038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fdd896c-7783-49f6-8679-5b8ba4af5127 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:25.174783 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 337/648] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:25.175890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd896c-7783-49f6-8679-5b8ba4af5127 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:25.189743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:25.216589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0f7c20c-1223-4cda-8333-0da531f67eab None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:25.252009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbaaa-958c-4028-8e41-03869f4d0bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:25.252687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbaaa-958c-4028-8e41-03869f4d0bd4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.253013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbaaa-958c-4028-8e41-03869f4d0bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.253299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9dbaaa-958c-4028-8e41-03869f4d0bd4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:25.261215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dbaaa-958c-4028-8e41-03869f4d0bd4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:25.262665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9dbaaa-958c-4028-8e41-03869f4d0bd4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-0c9dbaaa-958c-4028-8e41-03869f4d0bd4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:25.273995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:25.274969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 312/649] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:25 2022] GET /identity/v3/users/cinder => generated 84 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:25.275937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbaaa-958c-4028-8e41-03869f4d0bd4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:25.292470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:25.303699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fdd896c-7783-49f6-8679-5b8ba4af5127 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:25.340075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdb99b-a82f-4dec-adc4-c78d33918ba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:25.340801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdb99b-a82f-4dec-adc4-c78d33918ba2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.341144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdb99b-a82f-4dec-adc4-c78d33918ba2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.341475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6cdb99b-a82f-4dec-adc4-c78d33918ba2 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:25.342271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdb99b-a82f-4dec-adc4-c78d33918ba2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:25.342656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdb99b-a82f-4dec-adc4-c78d33918ba2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:25.344240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6cdb99b-a82f-4dec-adc4-c78d33918ba2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:25.366422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 338/650] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 24 14:13:25 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:25.366422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdb99b-a82f-4dec-adc4-c78d33918ba2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:25.391508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9dbaaa-958c-4028-8e41-03869f4d0bd4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:25.425802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:25.429008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d345c58-5494-4de6-a780-b0098cdd4f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:25.430212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d345c58-5494-4de6-a780-b0098cdd4f0d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.430491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d345c58-5494-4de6-a780-b0098cdd4f0d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.430769 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d345c58-5494-4de6-a780-b0098cdd4f0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:25.431803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d345c58-5494-4de6-a780-b0098cdd4f0d None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=758be68931aa49e5828bc2c164940571) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:25.432112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d345c58-5494-4de6-a780-b0098cdd4f0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:25.433615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d345c58-5494-4de6-a780-b0098cdd4f0d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:25.445246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 313/651] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:25 2022] GET /identity/v3/role_assignments?user.id=758be68931aa49e5828bc2c164940571&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:25.446095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d345c58-5494-4de6-a780-b0098cdd4f0d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:25.479305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6cdb99b-a82f-4dec-adc4-c78d33918ba2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:25.524247 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cec72b-029d-43d6-8c03-20b4a872aa19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:25.525289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec72b-029d-43d6-8c03-20b4a872aa19 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.525793 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec72b-029d-43d6-8c03-20b4a872aa19 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.526337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cec72b-029d-43d6-8c03-20b4a872aa19 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:25.539413 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25cec72b-029d-43d6-8c03-20b4a872aa19 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:25.541097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-25cec72b-029d-43d6-8c03-20b4a872aa19 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:25.545815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:25.546867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:25.548327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:25.551883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 339/652] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:25.553174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cec72b-029d-43d6-8c03-20b4a872aa19 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:25.575568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d345c58-5494-4de6-a780-b0098cdd4f0d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:25.614400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d201478-f6d0-4eea-b866-db2f75da457f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:25.615303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201478-f6d0-4eea-b866-db2f75da457f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.615303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201478-f6d0-4eea-b866-db2f75da457f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.615542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d201478-f6d0-4eea-b866-db2f75da457f None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:25.616612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d201478-f6d0-4eea-b866-db2f75da457f None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:25.616612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d201478-f6d0-4eea-b866-db2f75da457f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:25.618020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d201478-f6d0-4eea-b866-db2f75da457f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:25.638263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 314/653] 10.222.0.16 () {56 vars in 1137 bytes} [Sat Sep 24 14:13:25 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:25.639027 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d201478-f6d0-4eea-b866-db2f75da457f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:25.678229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cec72b-029d-43d6-8c03-20b4a872aa19 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:25.706822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:25.720005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ff40-864b-4aef-8db5-2cfd7bad4090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:25.721049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ff40-864b-4aef-8db5-2cfd7bad4090 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.721049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ff40-864b-4aef-8db5-2cfd7bad4090 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.721301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b17ff40-864b-4aef-8db5-2cfd7bad4090 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:25.751398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d201478-f6d0-4eea-b866-db2f75da457f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:25.785603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a60aa-a477-46d1-b171-c32fac143906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:25.786207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a60aa-a477-46d1-b171-c32fac143906 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.786480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a60aa-a477-46d1-b171-c32fac143906 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.786747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a60aa-a477-46d1-b171-c32fac143906 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:25.787402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a60aa-a477-46d1-b171-c32fac143906 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:25.787701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a60aa-a477-46d1-b171-c32fac143906 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:25.789131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82a60aa-a477-46d1-b171-c32fac143906 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:25.790462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:25.794868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17ff40-864b-4aef-8db5-2cfd7bad4090 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:25.796289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b17ff40-864b-4aef-8db5-2cfd7bad4090 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:25.798145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 315/654] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:25.802546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df9f4a-5292-4d54-bc3c-d7da91dc3df9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.802546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df9f4a-5292-4d54-bc3c-d7da91dc3df9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.802546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df9f4a-5292-4d54-bc3c-d7da91dc3df9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:25.802546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 316/655] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:25 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:25.802546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df9f4a-5292-4d54-bc3c-d7da91dc3df9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:25.907117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 340/656] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:25.908494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ff40-864b-4aef-8db5-2cfd7bad4090 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:25.913220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df9f4a-5292-4d54-bc3c-d7da91dc3df9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:25.935306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:25.949673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f7d06-4dfd-48ab-b0f0-346a11de6aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:25.950281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f7d06-4dfd-48ab-b0f0-346a11de6aa6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:25.950556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f7d06-4dfd-48ab-b0f0-346a11de6aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:25.950824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-545f7d06-4dfd-48ab-b0f0-346a11de6aa6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.017860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b17ff40-864b-4aef-8db5-2cfd7bad4090 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:26.018180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:26.024910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f7d06-4dfd-48ab-b0f0-346a11de6aa6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:26.026404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-545f7d06-4dfd-48ab-b0f0-346a11de6aa6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:26.056251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890b5689-0f9c-432b-90a5-7738b3ceb3b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:26.057195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b5689-0f9c-432b-90a5-7738b3ceb3b8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:26.057487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b5689-0f9c-432b-90a5-7738b3ceb3b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:26.057848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890b5689-0f9c-432b-90a5-7738b3ceb3b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.069050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b5689-0f9c-432b-90a5-7738b3ceb3b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:26.070813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890b5689-0f9c-432b-90a5-7738b3ceb3b8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-890b5689-0f9c-432b-90a5-7738b3ceb3b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:26.085704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:26.086861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:26.087962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:26.087962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:26.087962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:26.091434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 341/657] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:26.092377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fad48a-5af2-4a31-9eba-3cb8e75bcd27 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:26.092663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fad48a-5af2-4a31-9eba-3cb8e75bcd27 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:26.092938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fad48a-5af2-4a31-9eba-3cb8e75bcd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.113270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a4fad48a-5af2-4a31-9eba-3cb8e75bcd27 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:26.114449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a4fad48a-5af2-4a31-9eba-3cb8e75bcd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:26.135135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 317/658] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:26.135135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f7d06-4dfd-48ab-b0f0-346a11de6aa6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:26.189021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 342/659] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:26.189634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fad48a-5af2-4a31-9eba-3cb8e75bcd27 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:26.211952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:26.249585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:26.256435 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-545f7d06-4dfd-48ab-b0f0-346a11de6aa6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:26.297349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f757c-8097-47bc-98cc-f91089ea77d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:26.297984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f757c-8097-47bc-98cc-f91089ea77d4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:26.298257 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f757c-8097-47bc-98cc-f91089ea77d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:26.298525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8f757c-8097-47bc-98cc-f91089ea77d4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.315547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f757c-8097-47bc-98cc-f91089ea77d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:26.318297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8f757c-8097-47bc-98cc-f91089ea77d4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:26.319550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fad48a-5af2-4a31-9eba-3cb8e75bcd27 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ff8f757c-8097-47bc-98cc-f91089ea77d4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:26.338492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:26.339482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:26.341189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:26.341189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:26.341189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:26.343296 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 318/660] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:26.344860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f757c-8097-47bc-98cc-f91089ea77d4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:26.362509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef970d3-77a2-492a-b0f6-cae66cfaa70d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:26.363120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef970d3-77a2-492a-b0f6-cae66cfaa70d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:26.363398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef970d3-77a2-492a-b0f6-cae66cfaa70d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:26.363668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bef970d3-77a2-492a-b0f6-cae66cfaa70d None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.364344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef970d3-77a2-492a-b0f6-cae66cfaa70d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:26.364636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef970d3-77a2-492a-b0f6-cae66cfaa70d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:26.365998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bef970d3-77a2-492a-b0f6-cae66cfaa70d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:26.380311 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 343/661] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:26.381296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef970d3-77a2-492a-b0f6-cae66cfaa70d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:26.466281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:26.486405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8f757c-8097-47bc-98cc-f91089ea77d4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:26.509347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bef970d3-77a2-492a-b0f6-cae66cfaa70d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:26.522508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc4486-ff2f-4d93-90e3-c47359048f02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:26.523127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc4486-ff2f-4d93-90e3-c47359048f02 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:26.523402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc4486-ff2f-4d93-90e3-c47359048f02 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:26.523673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cc4486-ff2f-4d93-90e3-c47359048f02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.534189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc4486-ff2f-4d93-90e3-c47359048f02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:26.535777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cc4486-ff2f-4d93-90e3-c47359048f02 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:26.543932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:26.547541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3e6f2-2f23-497e-aa57-a3f8ebf675f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:26.548136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e6f2-2f23-497e-aa57-a3f8ebf675f8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:26.548437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e6f2-2f23-497e-aa57-a3f8ebf675f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:26.548706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f3e6f2-2f23-497e-aa57-a3f8ebf675f8 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.549335 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3e6f2-2f23-497e-aa57-a3f8ebf675f8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:26.549636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3e6f2-2f23-497e-aa57-a3f8ebf675f8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-62cc4486-ff2f-4d93-90e3-c47359048f02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:26.550781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:26.551708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:26.553127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:26.553127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:26.553127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:26.553300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f3e6f2-2f23-497e-aa57-a3f8ebf675f8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:26.555500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 319/662] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:26.556382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc4486-ff2f-4d93-90e3-c47359048f02 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:26.569748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 344/663] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:26.569748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3e6f2-2f23-497e-aa57-a3f8ebf675f8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:26.672754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cc4486-ff2f-4d93-90e3-c47359048f02 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:26.673423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f3e6f2-2f23-497e-aa57-a3f8ebf675f8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:26.706666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64016dd3-45be-4d8d-8603-b22686d167a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:26.706899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:26.707651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64016dd3-45be-4d8d-8603-b22686d167a9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:26.707939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64016dd3-45be-4d8d-8603-b22686d167a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:26.708304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64016dd3-45be-4d8d-8603-b22686d167a9 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.716644 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64016dd3-45be-4d8d-8603-b22686d167a9 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:26.718026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64016dd3-45be-4d8d-8603-b22686d167a9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:26.718255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a04f84-408d-4a96-a38a-b28cf1a546d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:26.719625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a04f84-408d-4a96-a38a-b28cf1a546d2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:26.720223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a04f84-408d-4a96-a38a-b28cf1a546d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:26.720680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a04f84-408d-4a96-a38a-b28cf1a546d2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-64016dd3-45be-4d8d-8603-b22686d167a9 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:26.729835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:26.730788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 320/664] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:26 2022] GET /identity/v3/users/neutron => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:26.731754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64016dd3-45be-4d8d-8603-b22686d167a9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:26.734417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a04f84-408d-4a96-a38a-b28cf1a546d2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-34a04f84-408d-4a96-a38a-b28cf1a546d2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:26.739702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:26.745486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 345/665] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:26.746370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a04f84-408d-4a96-a38a-b28cf1a546d2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:26.801111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:26.847830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64016dd3-45be-4d8d-8603-b22686d167a9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:26.848014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a04f84-408d-4a96-a38a-b28cf1a546d2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:26.882054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0ed66-ca37-4d4f-a451-0f70cea53c49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:26.882655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0ed66-ca37-4d4f-a451-0f70cea53c49 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:26.882938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0ed66-ca37-4d4f-a451-0f70cea53c49 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:26.883217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df0ed66-ca37-4d4f-a451-0f70cea53c49 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.883850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0ed66-ca37-4d4f-a451-0f70cea53c49 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:26.884185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0ed66-ca37-4d4f-a451-0f70cea53c49 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:26.884347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7458f-3de0-4b4b-a9d2-cca7a106185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:26.884953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7458f-3de0-4b4b-a9d2-cca7a106185a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:26.885234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7458f-3de0-4b4b-a9d2-cca7a106185a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:26.885508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d7458f-3de0-4b4b-a9d2-cca7a106185a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:26.885614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df0ed66-ca37-4d4f-a451-0f70cea53c49 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:26.893368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7458f-3de0-4b4b-a9d2-cca7a106185a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:26.895266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d7458f-3de0-4b4b-a9d2-cca7a106185a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:26.901570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 321/666] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:26.901570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0ed66-ca37-4d4f-a451-0f70cea53c49 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d0d7458f-3de0-4b4b-a9d2-cca7a106185a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:26.912000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:26.913099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:26.913998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:26.913998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:26.913998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:26.913998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:26.913998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:26.913998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:26.913998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:26.913998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:26.913998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 346/667] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:26.913998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7458f-3de0-4b4b-a9d2-cca7a106185a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:26.963168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:27.008090 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df0ed66-ca37-4d4f-a451-0f70cea53c49 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.022143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d7458f-3de0-4b4b-a9d2-cca7a106185a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.028395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:27.046209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805c99-7b1f-4926-a4b9-42a83292ea82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.046858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805c99-7b1f-4926-a4b9-42a83292ea82 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.047137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805c99-7b1f-4926-a4b9-42a83292ea82 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.047404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8805c99-7b1f-4926-a4b9-42a83292ea82 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.048173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8805c99-7b1f-4926-a4b9-42a83292ea82 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:27.048480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8805c99-7b1f-4926-a4b9-42a83292ea82 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.049916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8805c99-7b1f-4926-a4b9-42a83292ea82 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.060952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082d44b-b7a0-449e-8063-2e305cbc1813 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.061562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d44b-b7a0-449e-8063-2e305cbc1813 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.061846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d44b-b7a0-449e-8063-2e305cbc1813 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.062121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a082d44b-b7a0-449e-8063-2e305cbc1813 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.063331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082d44b-b7a0-449e-8063-2e305cbc1813 None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:27.063639 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082d44b-b7a0-449e-8063-2e305cbc1813 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.065757 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a082d44b-b7a0-449e-8063-2e305cbc1813 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.068685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 322/668] 10.222.0.16 () {56 vars in 1139 bytes} [Sat Sep 24 14:13:26 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:27.069511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805c99-7b1f-4926-a4b9-42a83292ea82 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.079461 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 347/669] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:27.080373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082d44b-b7a0-449e-8063-2e305cbc1813 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.179036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8805c99-7b1f-4926-a4b9-42a83292ea82 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.189255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a082d44b-b7a0-449e-8063-2e305cbc1813 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.198701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:27.216009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5013c-4cef-4c57-a9f7-27600458bc48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.216673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5013c-4cef-4c57-a9f7-27600458bc48 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.216950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5013c-4cef-4c57-a9f7-27600458bc48 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.217221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed5013c-4cef-4c57-a9f7-27600458bc48 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.224328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5013c-4cef-4c57-a9f7-27600458bc48 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.226125 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed5013c-4cef-4c57-a9f7-27600458bc48 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.229351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadb21f-0a23-4f38-bd6e-3c739930e7a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.230141 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb21f-0a23-4f38-bd6e-3c739930e7a4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.230575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb21f-0a23-4f38-bd6e-3c739930e7a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.231070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadb21f-0a23-4f38-bd6e-3c739930e7a4 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.231906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadb21f-0a23-4f38-bd6e-3c739930e7a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:27.232393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadb21f-0a23-4f38-bd6e-3c739930e7a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.233955 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadb21f-0a23-4f38-bd6e-3c739930e7a4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6ed5013c-4cef-4c57-a9f7-27600458bc48 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:27.237688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:27.238790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:27.239962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:27.239962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:27.239962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:27.239962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:27.239962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:27.239962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:27.239962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:27.239962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:27.239962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 323/670] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:27.239962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5013c-4cef-4c57-a9f7-27600458bc48 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.255595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 348/671] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:27.255595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadb21f-0a23-4f38-bd6e-3c739930e7a4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.300854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:27.365485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed5013c-4cef-4c57-a9f7-27600458bc48 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.365963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadb21f-0a23-4f38-bd6e-3c739930e7a4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.400649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9c781-350f-4db7-aa2a-bf558199e4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.401248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9c781-350f-4db7-aa2a-bf558199e4e6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.401522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9c781-350f-4db7-aa2a-bf558199e4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.401792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e9c781-350f-4db7-aa2a-bf558199e4e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.401905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14369-9a20-4007-bde5-2caebe27e4fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.402649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14369-9a20-4007-bde5-2caebe27e4fc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.402999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14369-9a20-4007-bde5-2caebe27e4fc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.403372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aa14369-9a20-4007-bde5-2caebe27e4fc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.415021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14369-9a20-4007-bde5-2caebe27e4fc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.416570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aa14369-9a20-4007-bde5-2caebe27e4fc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8aa14369-9a20-4007-bde5-2caebe27e4fc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:27.431480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:27.432482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:27.433399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:27.433399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:27.433399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:27.433399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 349/672] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:27.433399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14369-9a20-4007-bde5-2caebe27e4fc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.460792 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:27.485566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9c781-350f-4db7-aa2a-bf558199e4e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.487182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e9c781-350f-4db7-aa2a-bf558199e4e6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.528026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:27.555937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aa14369-9a20-4007-bde5-2caebe27e4fc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.597892 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 324/673] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:27.599391 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08355828-2e86-426e-bc22-ac5b2f734b81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.600364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08355828-2e86-426e-bc22-ac5b2f734b81 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.600709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08355828-2e86-426e-bc22-ac5b2f734b81 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.601047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08355828-2e86-426e-bc22-ac5b2f734b81 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.601808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08355828-2e86-426e-bc22-ac5b2f734b81 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:27.602182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08355828-2e86-426e-bc22-ac5b2f734b81 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.603664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08355828-2e86-426e-bc22-ac5b2f734b81 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.604682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9c781-350f-4db7-aa2a-bf558199e4e6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.617541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 350/674] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:27.623109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08355828-2e86-426e-bc22-ac5b2f734b81 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.705771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e9c781-350f-4db7-aa2a-bf558199e4e6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.706528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:27.726014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08355828-2e86-426e-bc22-ac5b2f734b81 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.739218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea689b-f3b9-4f8f-ad42-118ce0f4d0c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.739820 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea689b-f3b9-4f8f-ad42-118ce0f4d0c3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.740097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea689b-f3b9-4f8f-ad42-118ce0f4d0c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.740404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6ea689b-f3b9-4f8f-ad42-118ce0f4d0c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.741119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea689b-f3b9-4f8f-ad42-118ce0f4d0c3 None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=0ece8645e0954e1d81837cdcaa2ef1e5) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:27.741426 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea689b-f3b9-4f8f-ad42-118ce0f4d0c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.742849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6ea689b-f3b9-4f8f-ad42-118ce0f4d0c3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.748489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 325/675] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/role_assignments?user.id=0ece8645e0954e1d81837cdcaa2ef1e5&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:27.749265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea689b-f3b9-4f8f-ad42-118ce0f4d0c3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.752550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:27.761065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586feb8d-f7f9-4c8a-bde0-1ca2ff44bbad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.761694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586feb8d-f7f9-4c8a-bde0-1ca2ff44bbad None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.761973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586feb8d-f7f9-4c8a-bde0-1ca2ff44bbad None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.762247 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586feb8d-f7f9-4c8a-bde0-1ca2ff44bbad None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.762910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586feb8d-f7f9-4c8a-bde0-1ca2ff44bbad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:27.763215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586feb8d-f7f9-4c8a-bde0-1ca2ff44bbad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.764664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586feb8d-f7f9-4c8a-bde0-1ca2ff44bbad None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.777643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 351/676] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:27.778581 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586feb8d-f7f9-4c8a-bde0-1ca2ff44bbad None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.868223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6ea689b-f3b9-4f8f-ad42-118ce0f4d0c3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.898296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586feb8d-f7f9-4c8a-bde0-1ca2ff44bbad None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:27.910429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223dc2a1-5543-4f1b-91f4-d63fd54c2c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.911474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc2a1-5543-4f1b-91f4-d63fd54c2c9f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.911994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc2a1-5543-4f1b-91f4-d63fd54c2c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.912617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223dc2a1-5543-4f1b-91f4-d63fd54c2c9f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.925250 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dc2a1-5543-4f1b-91f4-d63fd54c2c9f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.927346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223dc2a1-5543-4f1b-91f4-d63fd54c2c9f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.936740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3ed9-6cac-4da7-babb-de1e17f72005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:27.936918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3ed9-6cac-4da7-babb-de1e17f72005 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.937111 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3ed9-6cac-4da7-babb-de1e17f72005 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.937410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fdd3ed9-6cac-4da7-babb-de1e17f72005 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.938137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd3ed9-6cac-4da7-babb-de1e17f72005 None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=c1152b27494941deae022b8a3eb48802) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:27.938502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd3ed9-6cac-4da7-babb-de1e17f72005 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:27.939923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fdd3ed9-6cac-4da7-babb-de1e17f72005 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-223dc2a1-5543-4f1b-91f4-d63fd54c2c9f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:27.942998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:27.943934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:27.944875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:27.944875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:27.944875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:27.944875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 326/677] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:27.945489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4ab46-81fd-482e-84be-1322b8fecac1 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:27.945770 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4ab46-81fd-482e-84be-1322b8fecac1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:27.946049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f4ab46-81fd-482e-84be-1322b8fecac1 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:27.947276 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 327/678] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:27 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:27.947959 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4ab46-81fd-482e-84be-1322b8fecac1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.955415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 352/679] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/role_assignments?user.id=c1152b27494941deae022b8a3eb48802&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:27.956491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3ed9-6cac-4da7-babb-de1e17f72005 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:27.960075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:28.032259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:28.091673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f4ab46-81fd-482e-84be-1322b8fecac1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:28.092406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fdd3ed9-6cac-4da7-babb-de1e17f72005 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:28.138501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a45bfd-ae59-4d97-8ad5-5928eaa549ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:28.139077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a45bfd-ae59-4d97-8ad5-5928eaa549ef None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:28.139355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a45bfd-ae59-4d97-8ad5-5928eaa549ef None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:28.140036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a45bfd-ae59-4d97-8ad5-5928eaa549ef None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:28.151285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21182f61-3717-4715-a37a-fa6a24e95e47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:28.151471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182f61-3717-4715-a37a-fa6a24e95e47 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:28.151611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182f61-3717-4715-a37a-fa6a24e95e47 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:28.152191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21182f61-3717-4715-a37a-fa6a24e95e47 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:28.152653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21182f61-3717-4715-a37a-fa6a24e95e47 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:28.152890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21182f61-3717-4715-a37a-fa6a24e95e47 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:28.153645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a45bfd-ae59-4d97-8ad5-5928eaa549ef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:28.154245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21182f61-3717-4715-a37a-fa6a24e95e47 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:28.155137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a45bfd-ae59-4d97-8ad5-5928eaa549ef None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:28.168098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 353/680] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:28.169358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ee6a7-5737-4442-877e-85ac17262e43 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:28.169648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ee6a7-5737-4442-877e-85ac17262e43 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:28.169929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a2ee6a7-5737-4442-877e-85ac17262e43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-45a45bfd-ae59-4d97-8ad5-5928eaa549ef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:28.173204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:28.174344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:28.175610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:28.175610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:28.175610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:28.175610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:28.175610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:28.175610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:28.175610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:28.175610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:28.175610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:28.175610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:28.177663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 328/681] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:27 2022] GET /identity/v3/users/swift => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:28.179092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a45bfd-ae59-4d97-8ad5-5928eaa549ef None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:28.194802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2a2ee6a7-5737-4442-877e-85ac17262e43 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:28.196004 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2a2ee6a7-5737-4442-877e-85ac17262e43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:28.278054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:28.296181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 354/682] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:28.296181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ee6a7-5737-4442-877e-85ac17262e43 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:28.309220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a45bfd-ae59-4d97-8ad5-5928eaa549ef None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:28.334998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:28.374329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283740de-5159-4fa2-920e-925fb7405efb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:28.375935 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283740de-5159-4fa2-920e-925fb7405efb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:28.376382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283740de-5159-4fa2-920e-925fb7405efb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:28.376803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283740de-5159-4fa2-920e-925fb7405efb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:28.393383 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283740de-5159-4fa2-920e-925fb7405efb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:28.394880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283740de-5159-4fa2-920e-925fb7405efb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:28.407555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a2ee6a7-5737-4442-877e-85ac17262e43 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-283740de-5159-4fa2-920e-925fb7405efb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:28.421415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:28.422436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:28.423366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:28.423366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:28.423366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:28.423366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:28.423366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:28.423366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:28.423366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:28.423366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:28.423366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 329/683] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:28.433136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283740de-5159-4fa2-920e-925fb7405efb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:28.449723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f24b82-1e51-4457-b6f2-2a9208d1c34e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:28.450462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24b82-1e51-4457-b6f2-2a9208d1c34e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:28.450858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24b82-1e51-4457-b6f2-2a9208d1c34e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:28.451187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f24b82-1e51-4457-b6f2-2a9208d1c34e None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:28.451992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f24b82-1e51-4457-b6f2-2a9208d1c34e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:28.452395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f24b82-1e51-4457-b6f2-2a9208d1c34e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:28.454014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f24b82-1e51-4457-b6f2-2a9208d1c34e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:28.479224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 355/684] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 24 14:13:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:28.490327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f24b82-1e51-4457-b6f2-2a9208d1c34e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:28.604142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:28.617480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283740de-5159-4fa2-920e-925fb7405efb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:28.681004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb053d-c0f4-46ab-8bf2-a31a5d88f18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:28.681519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb053d-c0f4-46ab-8bf2-a31a5d88f18f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:28.681796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb053d-c0f4-46ab-8bf2-a31a5d88f18f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:28.682064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82eb053d-c0f4-46ab-8bf2-a31a5d88f18f None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:28.682759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb053d-c0f4-46ab-8bf2-a31a5d88f18f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:28.683068 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb053d-c0f4-46ab-8bf2-a31a5d88f18f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:28.684569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82eb053d-c0f4-46ab-8bf2-a31a5d88f18f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:28.689227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f24b82-1e51-4457-b6f2-2a9208d1c34e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:28.697504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 330/685] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:28.703555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb053d-c0f4-46ab-8bf2-a31a5d88f18f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:28.739012 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:28.745916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63826209-e59e-428a-9525-4f551354efa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:28.747788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63826209-e59e-428a-9525-4f551354efa3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:28.748350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63826209-e59e-428a-9525-4f551354efa3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:28.748836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63826209-e59e-428a-9525-4f551354efa3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:28.810548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82eb053d-c0f4-46ab-8bf2-a31a5d88f18f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:28.847721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63826209-e59e-428a-9525-4f551354efa3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:28.848290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5e69e-9930-40f9-84aa-0299656fa7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:28.848985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5e69e-9930-40f9-84aa-0299656fa7d7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:28.849267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5e69e-9930-40f9-84aa-0299656fa7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:28.849799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b5e69e-9930-40f9-84aa-0299656fa7d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:28.850995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63826209-e59e-428a-9525-4f551354efa3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:28.862317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b5e69e-9930-40f9-84aa-0299656fa7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-79b5e69e-9930-40f9-84aa-0299656fa7d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:28.867217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:28.868184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:28.869071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:28.872438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 331/686] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:28.873265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5e69e-9930-40f9-84aa-0299656fa7d7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:28.927536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:28.986425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 356/687] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 492 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:28.986425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63826209-e59e-428a-9525-4f551354efa3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:28.994422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:29.005111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b5e69e-9930-40f9-84aa-0299656fa7d7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:29.049309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7475fe-fa35-486e-88f0-90ffe4a1ce30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:29.051061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7475fe-fa35-486e-88f0-90ffe4a1ce30 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:29.051615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7475fe-fa35-486e-88f0-90ffe4a1ce30 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:29.052040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7475fe-fa35-486e-88f0-90ffe4a1ce30 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:29.053100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7475fe-fa35-486e-88f0-90ffe4a1ce30 None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=7014b2868d4b4acea242d068f247c21f) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:29.053878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7475fe-fa35-486e-88f0-90ffe4a1ce30 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:29.055765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7475fe-fa35-486e-88f0-90ffe4a1ce30 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:29.068908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 332/688] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:28 2022] GET /identity/v3/role_assignments?user.id=7014b2868d4b4acea242d068f247c21f&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 608 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:29.069183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7475fe-fa35-486e-88f0-90ffe4a1ce30 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:29.123525 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63826209-e59e-428a-9525-4f551354efa3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:29.198230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2d19e-0b44-4ca4-8e9a-ea8a114c2ced None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:29.199572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2d19e-0b44-4ca4-8e9a-ea8a114c2ced None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:29.199857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2d19e-0b44-4ca4-8e9a-ea8a114c2ced None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:29.200130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc2d19e-0b44-4ca4-8e9a-ea8a114c2ced None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:29.200832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2d19e-0b44-4ca4-8e9a-ea8a114c2ced None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:29.201139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2d19e-0b44-4ca4-8e9a-ea8a114c2ced None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:29.204690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fc2d19e-0b44-4ca4-8e9a-ea8a114c2ced None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:29.221774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 357/689] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:29.233194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2d19e-0b44-4ca4-8e9a-ea8a114c2ced None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:29.263156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:29.304937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7475fe-fa35-486e-88f0-90ffe4a1ce30 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:29.366123 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358c258-995d-4bb9-8559-4a284030bd45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:29.367325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c258-995d-4bb9-8559-4a284030bd45 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:29.368114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c258-995d-4bb9-8559-4a284030bd45 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:29.368664 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c358c258-995d-4bb9-8559-4a284030bd45 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:29.386108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358c258-995d-4bb9-8559-4a284030bd45 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:29.387209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fc2d19e-0b44-4ca4-8e9a-ea8a114c2ced None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:29.388126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c358c258-995d-4bb9-8559-4a284030bd45 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-c358c258-995d-4bb9-8559-4a284030bd45 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:29.404026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:29.405040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:29.405948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:29.405948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:29.405948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:29.408020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 333/690] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:29.413785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358c258-995d-4bb9-8559-4a284030bd45 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:29.423660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58989e-3a70-4e3e-a828-15888f83c689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:29.424339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58989e-3a70-4e3e-a828-15888f83c689 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:29.424900 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58989e-3a70-4e3e-a828-15888f83c689 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:29.424900 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d58989e-3a70-4e3e-a828-15888f83c689 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:29.428876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:29.437803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58989e-3a70-4e3e-a828-15888f83c689 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:29.439264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d58989e-3a70-4e3e-a828-15888f83c689 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8d58989e-3a70-4e3e-a828-15888f83c689 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:29.454397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:29.455386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:29.456414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:29.456414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:29.456414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:29.456414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 358/691] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:29.462608 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58989e-3a70-4e3e-a828-15888f83c689 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:29.529927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c358c258-995d-4bb9-8559-4a284030bd45 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:29.542647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:29.574320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9d75-f0fa-4a67-b047-f3e95081b1eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:29.575347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9d75-f0fa-4a67-b047-f3e95081b1eb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:29.575880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9d75-f0fa-4a67-b047-f3e95081b1eb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:29.576383 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73f9d75-f0fa-4a67-b047-f3e95081b1eb None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:29.577232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f9d75-f0fa-4a67-b047-f3e95081b1eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:29.577761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f9d75-f0fa-4a67-b047-f3e95081b1eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:29.579963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73f9d75-f0fa-4a67-b047-f3e95081b1eb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:29.583648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d58989e-3a70-4e3e-a828-15888f83c689 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:29.593451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 334/692] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:29.600027 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9d75-f0fa-4a67-b047-f3e95081b1eb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:29.619961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970a281-60a4-4adf-8b82-9542d594663f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:29.620905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970a281-60a4-4adf-8b82-9542d594663f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:29.621197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970a281-60a4-4adf-8b82-9542d594663f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:29.621479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970a281-60a4-4adf-8b82-9542d594663f None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:29.622125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970a281-60a4-4adf-8b82-9542d594663f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:29.622433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970a281-60a4-4adf-8b82-9542d594663f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:29.623813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970a281-60a4-4adf-8b82-9542d594663f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:29.637334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 359/693] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:29.643257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970a281-60a4-4adf-8b82-9542d594663f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:29.678411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:29.719807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73f9d75-f0fa-4a67-b047-f3e95081b1eb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:29.748010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970a281-60a4-4adf-8b82-9542d594663f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:29.758050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cdcdf-4a92-42d2-90f9-214570a2ca86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:29.759004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cdcdf-4a92-42d2-90f9-214570a2ca86 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:29.759585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cdcdf-4a92-42d2-90f9-214570a2ca86 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:29.760080 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184cdcdf-4a92-42d2-90f9-214570a2ca86 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:29.768260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cdcdf-4a92-42d2-90f9-214570a2ca86 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:29.770091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-184cdcdf-4a92-42d2-90f9-214570a2ca86 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:29.775615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-184cdcdf-4a92-42d2-90f9-214570a2ca86 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:29.784055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:29.785045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:29.785944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:29.785944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:29.785944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:29.785944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:29.785944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:29.785944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:29.785944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:29.785944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:29.787841 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 335/694] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:29.795102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc35a6-dc18-4888-a1f5-436fcd2b300a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:29.795102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc35a6-dc18-4888-a1f5-436fcd2b300a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:29.795102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc35a6-dc18-4888-a1f5-436fcd2b300a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:29.795102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54dc35a6-dc18-4888-a1f5-436fcd2b300a None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:29.797273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cdcdf-4a92-42d2-90f9-214570a2ca86 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:29.802915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc35a6-dc18-4888-a1f5-436fcd2b300a None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:29.804447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54dc35a6-dc18-4888-a1f5-436fcd2b300a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-54dc35a6-dc18-4888-a1f5-436fcd2b300a None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:29.817559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:29.818565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:29.819554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 360/695] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 24 14:13:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:29.824545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc35a6-dc18-4888-a1f5-436fcd2b300a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:29.916928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184cdcdf-4a92-42d2-90f9-214570a2ca86 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:29.949419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:29.957971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e776485-4b56-4b71-a4fe-d9f1c3284381 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:29.958903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e776485-4b56-4b71-a4fe-d9f1c3284381 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:29.959401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e776485-4b56-4b71-a4fe-d9f1c3284381 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:29.959890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e776485-4b56-4b71-a4fe-d9f1c3284381 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:29.960797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e776485-4b56-4b71-a4fe-d9f1c3284381 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:29.961341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e776485-4b56-4b71-a4fe-d9f1c3284381 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:29.962965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e776485-4b56-4b71-a4fe-d9f1c3284381 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:29.973498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54dc35a6-dc18-4888-a1f5-436fcd2b300a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:29.976125 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 336/696] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:29.986060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e776485-4b56-4b71-a4fe-d9f1c3284381 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:30.024960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391249a-a207-4b2d-8758-4753e5b26f8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:30.025627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391249a-a207-4b2d-8758-4753e5b26f8d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:30.025909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391249a-a207-4b2d-8758-4753e5b26f8d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:30.026181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6391249a-a207-4b2d-8758-4753e5b26f8d None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:30.026970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391249a-a207-4b2d-8758-4753e5b26f8d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:30.027281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391249a-a207-4b2d-8758-4753e5b26f8d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:30.028810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6391249a-a207-4b2d-8758-4753e5b26f8d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:30.065232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 361/697] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 24 14:13:29 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:30.072030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391249a-a207-4b2d-8758-4753e5b26f8d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:30.189173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e776485-4b56-4b71-a4fe-d9f1c3284381 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:30.191911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:30.267082 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d5e56d-f7b6-4880-bdcb-f67efa30b385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:30.268212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5e56d-f7b6-4880-bdcb-f67efa30b385 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:30.268803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5e56d-f7b6-4880-bdcb-f67efa30b385 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:30.269300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d5e56d-f7b6-4880-bdcb-f67efa30b385 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:30.270232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5e56d-f7b6-4880-bdcb-f67efa30b385 None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=100d19cd9f1742b7ae913376eb75bbd9) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:30.270835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5e56d-f7b6-4880-bdcb-f67efa30b385 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:30.272640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d5e56d-f7b6-4880-bdcb-f67efa30b385 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:30.274626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6391249a-a207-4b2d-8758-4753e5b26f8d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:30.279858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 337/698] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:29 2022] GET /identity/v3/role_assignments?user.id=100d19cd9f1742b7ae913376eb75bbd9&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 608 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:30.281357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb4df-3fba-42cd-9c25-b02385eabde0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:30.281888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb4df-3fba-42cd-9c25-b02385eabde0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:30.282367 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0fb4df-3fba-42cd-9c25-b02385eabde0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:30.284084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 338/699] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:30.289589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c621444-fe8e-4375-b29f-df11c3571fcb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:30.290170 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c621444-fe8e-4375-b29f-df11c3571fcb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:30.290650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c621444-fe8e-4375-b29f-df11c3571fcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:30.310920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7c621444-fe8e-4375-b29f-df11c3571fcb None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:30.313548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7c621444-fe8e-4375-b29f-df11c3571fcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:30.350378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb58ff6-e9b4-4b1a-8250-db5da7d877ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:30.350922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58ff6-e9b4-4b1a-8250-db5da7d877ae None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:30.351206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58ff6-e9b4-4b1a-8250-db5da7d877ae None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:30.351501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb58ff6-e9b4-4b1a-8250-db5da7d877ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:30.384734 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:30.412020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 339/700] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:30.464009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb58ff6-e9b4-4b1a-8250-db5da7d877ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:30.465517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb58ff6-e9b4-4b1a-8250-db5da7d877ae None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:30.521922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:30.592069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 362/701] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:30.597980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c621444-fe8e-4375-b29f-df11c3571fcb None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:30.698851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd34715-f219-4745-bc6c-57cb8d7418bb None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:30.699462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd34715-f219-4745-bc6c-57cb8d7418bb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:30.700094 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd34715-f219-4745-bc6c-57cb8d7418bb None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:30.702570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 363/702] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:30 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:13:30.706784 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c621444-fe8e-4375-b29f-df11c3571fcb None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:30.708861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc75b-1168-4c5e-83ea-b00053cf51d5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:30.709551 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc75b-1168-4c5e-83ea-b00053cf51d5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:30.710855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433bc75b-1168-4c5e-83ea-b00053cf51d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:30.740268 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-433bc75b-1168-4c5e-83ea-b00053cf51d5 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:30.741959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-433bc75b-1168-4c5e-83ea-b00053cf51d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:30.747647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c8f55-386a-4926-905d-93e018dbc127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:30.748320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c8f55-386a-4926-905d-93e018dbc127 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:30.748601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c8f55-386a-4926-905d-93e018dbc127 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:30.748876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa8c8f55-386a-4926-905d-93e018dbc127 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:30.760377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c8f55-386a-4926-905d-93e018dbc127 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:30.761863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa8c8f55-386a-4926-905d-93e018dbc127 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-aa8c8f55-386a-4926-905d-93e018dbc127 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:30.777360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:30.778436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:30.779339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:30.779339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:30.779339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:30.779339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 340/703] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:30.780113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c8f55-386a-4926-905d-93e018dbc127 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:30.822927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:30.839835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 364/704] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:13:30.841035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bc75b-1168-4c5e-83ea-b00053cf51d5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:30.898106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa8c8f55-386a-4926-905d-93e018dbc127 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:30.933317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a263b-a239-4ff2-b536-11865e3677bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:30.934151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a263b-a239-4ff2-b536-11865e3677bd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:30.934273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a263b-a239-4ff2-b536-11865e3677bd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:30.934472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682a263b-a239-4ff2-b536-11865e3677bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:30.947442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:30.950327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a263b-a239-4ff2-b536-11865e3677bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:30.953029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682a263b-a239-4ff2-b536-11865e3677bd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-682a263b-a239-4ff2-b536-11865e3677bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:30.974875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:30.975898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:30.976871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:30.976871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:30.976871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:30.977055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433bc75b-1168-4c5e-83ea-b00053cf51d5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:30.980242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 341/705] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:30.986438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a263b-a239-4ff2-b536-11865e3677bd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:31.021920 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aebc4-1f44-4376-b066-24bf9cae31bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:31.022943 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aebc4-1f44-4376-b066-24bf9cae31bc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:31.023593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aebc4-1f44-4376-b066-24bf9cae31bc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:31.024934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0aebc4-1f44-4376-b066-24bf9cae31bc None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:31.025765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0aebc4-1f44-4376-b066-24bf9cae31bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:31.026330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0aebc4-1f44-4376-b066-24bf9cae31bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:31.027868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0aebc4-1f44-4376-b066-24bf9cae31bc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:31.043573 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 365/706] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:31.049226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aebc4-1f44-4376-b066-24bf9cae31bc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:31.091297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:31.112589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682a263b-a239-4ff2-b536-11865e3677bd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:31.160320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b969fe-f795-4441-be36-f0ad2d63e334 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:31.160923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b969fe-f795-4441-be36-f0ad2d63e334 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:31.161200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b969fe-f795-4441-be36-f0ad2d63e334 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:31.161470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b969fe-f795-4441-be36-f0ad2d63e334 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:31.162250 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b969fe-f795-4441-be36-f0ad2d63e334 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:31.162548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b969fe-f795-4441-be36-f0ad2d63e334 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:31.164181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b969fe-f795-4441-be36-f0ad2d63e334 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:31.182520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 342/707] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:31.183775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b969fe-f795-4441-be36-f0ad2d63e334 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:31.254177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0aebc4-1f44-4376-b066-24bf9cae31bc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:31.288716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca637374-d66d-4c59-b1e9-98ebec57b4cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:31.290134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca637374-d66d-4c59-b1e9-98ebec57b4cc None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:31.290612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca637374-d66d-4c59-b1e9-98ebec57b4cc None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:31.291081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca637374-d66d-4c59-b1e9-98ebec57b4cc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:31.293253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:31.300394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca637374-d66d-4c59-b1e9-98ebec57b4cc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:31.302115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca637374-d66d-4c59-b1e9-98ebec57b4cc None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ca637374-d66d-4c59-b1e9-98ebec57b4cc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:31.314191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:31.315093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:31.315990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:31.315990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:31.315990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:31.315990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:31.315990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:31.315990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:31.315990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:31.315990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:31.316457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b969fe-f795-4441-be36-f0ad2d63e334 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:31.323152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 366/708] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:31.324291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca637374-d66d-4c59-b1e9-98ebec57b4cc None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:31.356469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbfd93-b1c6-482e-9236-5373aee97aaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:31.357207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbfd93-b1c6-482e-9236-5373aee97aaa None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:31.357698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbfd93-b1c6-482e-9236-5373aee97aaa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:31.357977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cbfd93-b1c6-482e-9236-5373aee97aaa None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:31.358631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbfd93-b1c6-482e-9236-5373aee97aaa None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:31.360865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8cbfd93-b1c6-482e-9236-5373aee97aaa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:31.389461 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 343/709] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:13:31 2022] POST /identity/v3/users => generated 254 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:31.391444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbfd93-b1c6-482e-9236-5373aee97aaa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:31.403791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:31.495523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca637374-d66d-4c59-b1e9-98ebec57b4cc None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:31.564935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26b329-6a26-45bc-a84a-71ebfe675679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:31.565662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b329-6a26-45bc-a84a-71ebfe675679 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:31.566232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b329-6a26-45bc-a84a-71ebfe675679 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:31.567273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d26b329-6a26-45bc-a84a-71ebfe675679 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:31.568171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26b329-6a26-45bc-a84a-71ebfe675679 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:31.571141 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d26b329-6a26-45bc-a84a-71ebfe675679 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6d26b329-6a26-45bc-a84a-71ebfe675679 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:31.594884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:31.596208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 14:13:31.597245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:31.604062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 367/710] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Sep 24 14:13:31 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:31.611712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26b329-6a26-45bc-a84a-71ebfe675679 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:31.628209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8cbfd93-b1c6-482e-9236-5373aee97aaa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:31.670994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f14ea-9322-4c47-bd36-d6ce8af22b9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:31.672344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f14ea-9322-4c47-bd36-d6ce8af22b9d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:31.672721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f14ea-9322-4c47-bd36-d6ce8af22b9d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:31.673109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b81f14ea-9322-4c47-bd36-d6ce8af22b9d None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:31.673904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f14ea-9322-4c47-bd36-d6ce8af22b9d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:31.674323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f14ea-9322-4c47-bd36-d6ce8af22b9d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:31.675878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b81f14ea-9322-4c47-bd36-d6ce8af22b9d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:31.693160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 344/711] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:31.699271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f14ea-9322-4c47-bd36-d6ce8af22b9d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:31.800690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:31.816628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:31.855492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b81f14ea-9322-4c47-bd36-d6ce8af22b9d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:31.867371 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d26b329-6a26-45bc-a84a-71ebfe675679 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:31.896997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c38941a-b085-4273-9729-c8a479c18d8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:31.897601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38941a-b085-4273-9729-c8a479c18d8f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:31.897879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38941a-b085-4273-9729-c8a479c18d8f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:31.898150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c38941a-b085-4273-9729-c8a479c18d8f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:31.898866 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38941a-b085-4273-9729-c8a479c18d8f None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=758be68931aa49e5828bc2c164940571) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:31.899171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38941a-b085-4273-9729-c8a479c18d8f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:31.900680 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c38941a-b085-4273-9729-c8a479c18d8f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:31.909078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4deedc-79d2-4e5f-8530-c893e9563208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:31.909939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4deedc-79d2-4e5f-8530-c893e9563208 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:31.910391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 345/712] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:31 2022] GET /identity/v3/role_assignments?user.id=758be68931aa49e5828bc2c164940571&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 259 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:31.910504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4deedc-79d2-4e5f-8530-c893e9563208 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:31.910934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4deedc-79d2-4e5f-8530-c893e9563208 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:31.911655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad658-eaeb-41c2-ae2b-268c38f6a1e9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:31.911938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad658-eaeb-41c2-ae2b-268c38f6a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:31.912118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4deedc-79d2-4e5f-8530-c893e9563208 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:31.912239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-badad658-eaeb-41c2-ae2b-268c38f6a1e9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:31.912714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4deedc-79d2-4e5f-8530-c893e9563208 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:31.913696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 346/713] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:31.914481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4deedc-79d2-4e5f-8530-c893e9563208 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:31.919925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 368/714] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 24 14:13:31 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:31.922520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8c666-9bb4-453d-9d3d-1e24f6b1aca7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:31.922520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8c666-9bb4-453d-9d3d-1e24f6b1aca7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:31.922520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e8c666-9bb4-453d-9d3d-1e24f6b1aca7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:31.926075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4deedc-79d2-4e5f-8530-c893e9563208 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:31.943963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-45e8c666-9bb4-453d-9d3d-1e24f6b1aca7 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:31.945038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-45e8c666-9bb4-453d-9d3d-1e24f6b1aca7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:32.026283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 347/715] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:32.058417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4deedc-79d2-4e5f-8530-c893e9563208 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:32.096859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:32.113501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa1ce5-e58f-4685-a8f3-70bc325ff56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:32.114137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa1ce5-e58f-4685-a8f3-70bc325ff56c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:32.114486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa1ce5-e58f-4685-a8f3-70bc325ff56c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:32.114766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72aa1ce5-e58f-4685-a8f3-70bc325ff56c None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:32.115420 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa1ce5-e58f-4685-a8f3-70bc325ff56c None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:32.115729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa1ce5-e58f-4685-a8f3-70bc325ff56c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:32.117160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72aa1ce5-e58f-4685-a8f3-70bc325ff56c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:32.129880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 369/716] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 24 14:13:31 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:32.388297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8c666-9bb4-453d-9d3d-1e24f6b1aca7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:32.478174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:32.551326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e8c666-9bb4-453d-9d3d-1e24f6b1aca7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:32.610767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c50bae-d10b-4c88-8313-a218d38c1a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:32.611783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50bae-d10b-4c88-8313-a218d38c1a09 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:32.616501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50bae-d10b-4c88-8313-a218d38c1a09 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:32.617046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c50bae-d10b-4c88-8313-a218d38c1a09 None admin] PATH_INFO: `/v3/services/network` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:32.617867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c50bae-d10b-4c88-8313-a218d38c1a09 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:32.619476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c50bae-d10b-4c88-8313-a218d38c1a09 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e4c50bae-d10b-4c88-8313-a218d38c1a09 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:32.639970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:32.641596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 14:13:32.642456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:32.645853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 348/717] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:32 2022] GET /identity/v3/services/network => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:32.655205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa1ce5-e58f-4685-a8f3-70bc325ff56c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:32.820866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72aa1ce5-e58f-4685-a8f3-70bc325ff56c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:32.866844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ac127-79fc-4741-92f7-cba6c32b48d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:32.867467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ac127-79fc-4741-92f7-cba6c32b48d2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:32.867745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ac127-79fc-4741-92f7-cba6c32b48d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:32.868015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ac127-79fc-4741-92f7-cba6c32b48d2 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:32.868680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ac127-79fc-4741-92f7-cba6c32b48d2 None admin] RBAC: Adding query filter params (name=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:32.868984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ac127-79fc-4741-92f7-cba6c32b48d2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:32.870346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ac127-79fc-4741-92f7-cba6c32b48d2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:32.875557 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 370/718] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:13:32 2022] GET /identity/v3/services?name=network => generated 124 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:32.885251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c50bae-d10b-4c88-8313-a218d38c1a09 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:33.061251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c50bae-d10b-4c88-8313-a218d38c1a09 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:33.087796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:33.107749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-939cb0e0-0133-4dbc-b788-3014f4e1775f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:33.108908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cb0e0-0133-4dbc-b788-3014f4e1775f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:33.109470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cb0e0-0133-4dbc-b788-3014f4e1775f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:33.109947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-939cb0e0-0133-4dbc-b788-3014f4e1775f None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:33.110795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cb0e0-0133-4dbc-b788-3014f4e1775f None admin] RBAC: Adding query filter params (type=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:33.111302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cb0e0-0133-4dbc-b788-3014f4e1775f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:33.112963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-939cb0e0-0133-4dbc-b788-3014f4e1775f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:33.124442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 349/719] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:13:32 2022] GET /identity/v3/services?type=network => generated 124 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:33.295277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7f6a-eecb-4e7f-9233-1d601831f622 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:33.296003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7f6a-eecb-4e7f-9233-1d601831f622 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:33.297062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24f7f6a-eecb-4e7f-9233-1d601831f622 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:33.298999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 371/720] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:33 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:33.304455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e3c98-1d56-4573-9b6f-13a29ee49680 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:33.304744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e3c98-1d56-4573-9b6f-13a29ee49680 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:33.305025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517e3c98-1d56-4573-9b6f-13a29ee49680 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:33.332830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-517e3c98-1d56-4573-9b6f-13a29ee49680 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:33.333991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-517e3c98-1d56-4573-9b6f-13a29ee49680 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:33.427636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 350/721] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:13:33.740918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f7f6a-eecb-4e7f-9233-1d601831f622 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:33.799743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:33.854674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24f7f6a-eecb-4e7f-9233-1d601831f622 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:33.891630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20614dd-22f7-4b0e-ae89-73ac2237ade0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:33.892648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20614dd-22f7-4b0e-ae89-73ac2237ade0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:33.893152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20614dd-22f7-4b0e-ae89-73ac2237ade0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:33.893639 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20614dd-22f7-4b0e-ae89-73ac2237ade0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:33.904744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20614dd-22f7-4b0e-ae89-73ac2237ade0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a20614dd-22f7-4b0e-ae89-73ac2237ade0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:33.909891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:33.910869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:33.911721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:33.914312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 372/722] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:33.920872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e3c98-1d56-4573-9b6f-13a29ee49680 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:34.068832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517e3c98-1d56-4573-9b6f-13a29ee49680 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:34.085858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:34.111996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949985f3-0b0e-4d4e-aef0-80ae9ba2e716 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:34.112634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949985f3-0b0e-4d4e-aef0-80ae9ba2e716 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:34.112911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949985f3-0b0e-4d4e-aef0-80ae9ba2e716 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:34.113181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-949985f3-0b0e-4d4e-aef0-80ae9ba2e716 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:34.113842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949985f3-0b0e-4d4e-aef0-80ae9ba2e716 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:34.114142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949985f3-0b0e-4d4e-aef0-80ae9ba2e716 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:34.115506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-949985f3-0b0e-4d4e-aef0-80ae9ba2e716 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:34.128460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 351/723] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:34.134233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20614dd-22f7-4b0e-ae89-73ac2237ade0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:34.258657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20614dd-22f7-4b0e-ae89-73ac2237ade0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:34.270842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:34.296332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f9db61-087b-42a1-8530-d40a3b5dd2f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:34.297372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9db61-087b-42a1-8530-d40a3b5dd2f9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:34.297871 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9db61-087b-42a1-8530-d40a3b5dd2f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:34.298345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f9db61-087b-42a1-8530-d40a3b5dd2f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:34.308969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9db61-087b-42a1-8530-d40a3b5dd2f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:34.310685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f9db61-087b-42a1-8530-d40a3b5dd2f9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-21f9db61-087b-42a1-8530-d40a3b5dd2f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:34.326467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:34.327544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:34.329155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:34.329155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:34.329155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:34.330836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 373/724] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:34.341237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949985f3-0b0e-4d4e-aef0-80ae9ba2e716 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:34.357494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaf96b-3433-4879-8b1f-e8276e12ef73 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:34.358075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaf96b-3433-4879-8b1f-e8276e12ef73 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:34.358509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdaf96b-3433-4879-8b1f-e8276e12ef73 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:34.360250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 374/725] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:34.365389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4fed9-b027-4ea9-9815-c0cf896d1c86 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:34.365825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4fed9-b027-4ea9-9815-c0cf896d1c86 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:34.366268 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc4fed9-b027-4ea9-9815-c0cf896d1c86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:34.395005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0fc4fed9-b027-4ea9-9815-c0cf896d1c86 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:34.396447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0fc4fed9-b027-4ea9-9815-c0cf896d1c86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:34.458851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-949985f3-0b0e-4d4e-aef0-80ae9ba2e716 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:34.499260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7e3de-89f1-40ce-bcc6-c5b942400892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:34.500663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e3de-89f1-40ce-bcc6-c5b942400892 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:34.501084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e3de-89f1-40ce-bcc6-c5b942400892 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:34.501670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d7e3de-89f1-40ce-bcc6-c5b942400892 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:34.502748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7e3de-89f1-40ce-bcc6-c5b942400892 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:34.503221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7e3de-89f1-40ce-bcc6-c5b942400892 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:34.504809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d7e3de-89f1-40ce-bcc6-c5b942400892 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:34.521471 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 352/726] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:34.526800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7e3de-89f1-40ce-bcc6-c5b942400892 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:34.541836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 375/727] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:34.596647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:34.641982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d7e3de-89f1-40ce-bcc6-c5b942400892 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:34.684914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33825e88-29e4-45ef-973b-963bf2420123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:34.685831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33825e88-29e4-45ef-973b-963bf2420123 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:34.686279 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33825e88-29e4-45ef-973b-963bf2420123 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:34.686690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33825e88-29e4-45ef-973b-963bf2420123 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:34.696585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33825e88-29e4-45ef-973b-963bf2420123 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:34.698199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33825e88-29e4-45ef-973b-963bf2420123 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-33825e88-29e4-45ef-973b-963bf2420123 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:34.714551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:34.715694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:34.716883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:34.716883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:34.716883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:34.716883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:34.716883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:34.716883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:34.716883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:34.716883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:34.716883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:34.716883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:34.719660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 353/728] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:34.725123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4fed9-b027-4ea9-9815-c0cf896d1c86 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:34.757856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4a7f0-bc20-4eb5-bb09-142be6fc1ced None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:34.758160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4a7f0-bc20-4eb5-bb09-142be6fc1ced None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:34.758395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa4a7f0-bc20-4eb5-bb09-142be6fc1ced None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:34.759832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 354/729] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:34.764851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe551d0-526c-4ece-b238-371033e18e09 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:34.765906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe551d0-526c-4ece-b238-371033e18e09 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:34.766382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe551d0-526c-4ece-b238-371033e18e09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:34.785189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dfe551d0-526c-4ece-b238-371033e18e09 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:34.786720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dfe551d0-526c-4ece-b238-371033e18e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:34.832983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:34.844667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc4fed9-b027-4ea9-9815-c0cf896d1c86 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:34.889677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 355/730] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Sep 24 14:13:34.896446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe551d0-526c-4ece-b238-371033e18e09 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:34.911590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213663e8-7c8e-445f-9ef9-d44104277f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:34.912334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213663e8-7c8e-445f-9ef9-d44104277f04 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:34.912613 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213663e8-7c8e-445f-9ef9-d44104277f04 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:34.912895 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-213663e8-7c8e-445f-9ef9-d44104277f04 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:34.913645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213663e8-7c8e-445f-9ef9-d44104277f04 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:34.913961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213663e8-7c8e-445f-9ef9-d44104277f04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:34.915399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-213663e8-7c8e-445f-9ef9-d44104277f04 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:34.945939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 376/731] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 24 14:13:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:34.954102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213663e8-7c8e-445f-9ef9-d44104277f04 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:34.959149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:35.068169 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe551d0-526c-4ece-b238-371033e18e09 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:35.106066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-213663e8-7c8e-445f-9ef9-d44104277f04 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:35.134052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c448c2-a8b1-450f-b246-ea4644db7655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:35.134657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c448c2-a8b1-450f-b246-ea4644db7655 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.134940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c448c2-a8b1-450f-b246-ea4644db7655 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.135218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c448c2-a8b1-450f-b246-ea4644db7655 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.152147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15e23e-c18e-49ba-8d29-1b513a949461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:35.155502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15e23e-c18e-49ba-8d29-1b513a949461 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.156549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15e23e-c18e-49ba-8d29-1b513a949461 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.157145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a15e23e-c18e-49ba-8d29-1b513a949461 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.157333 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42c448c2-a8b1-450f-b246-ea4644db7655 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-42c448c2-a8b1-450f-b246-ea4644db7655 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:35.162602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:35.163564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:35.164458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:35.168508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 356/732] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:35.169339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c448c2-a8b1-450f-b246-ea4644db7655 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:35.188740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:35.241760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15e23e-c18e-49ba-8d29-1b513a949461 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:35.243699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a15e23e-c18e-49ba-8d29-1b513a949461 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:35.296047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:35.309953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c448c2-a8b1-450f-b246-ea4644db7655 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:35.348842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b53f75-ed01-4879-ab4e-fe2c5b2cc0ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:35.349702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53f75-ed01-4879-ab4e-fe2c5b2cc0ec None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.349992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53f75-ed01-4879-ab4e-fe2c5b2cc0ec None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.350265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b53f75-ed01-4879-ab4e-fe2c5b2cc0ec None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.351035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b53f75-ed01-4879-ab4e-fe2c5b2cc0ec None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:35.351341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b53f75-ed01-4879-ab4e-fe2c5b2cc0ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:35.352882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b53f75-ed01-4879-ab4e-fe2c5b2cc0ec None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:35.362045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 357/733] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:35.367724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b53f75-ed01-4879-ab4e-fe2c5b2cc0ec None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:35.369537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 377/734] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:35.381740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15e23e-c18e-49ba-8d29-1b513a949461 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:35.443340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:35.490431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b53f75-ed01-4879-ab4e-fe2c5b2cc0ec None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:35.498684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a15e23e-c18e-49ba-8d29-1b513a949461 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:35.527693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7383b85-a956-47a9-9de2-cab655f6fbdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:35.528560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7383b85-a956-47a9-9de2-cab655f6fbdc None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.528674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7383b85-a956-47a9-9de2-cab655f6fbdc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.528898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7383b85-a956-47a9-9de2-cab655f6fbdc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.537305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170b291e-13e2-4610-8f65-9bdc76fbe851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:35.537913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b291e-13e2-4610-8f65-9bdc76fbe851 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.538582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b291e-13e2-4610-8f65-9bdc76fbe851 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.538855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170b291e-13e2-4610-8f65-9bdc76fbe851 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.539938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7383b85-a956-47a9-9de2-cab655f6fbdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:35.541445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7383b85-a956-47a9-9de2-cab655f6fbdc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:35.549290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b291e-13e2-4610-8f65-9bdc76fbe851 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:35.550696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170b291e-13e2-4610-8f65-9bdc76fbe851 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a7383b85-a956-47a9-9de2-cab655f6fbdc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:35.555795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:35.562149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:35.563116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:35.563116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:35.563116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:35.563116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 358/735] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:35.563116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7383b85-a956-47a9-9de2-cab655f6fbdc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:35.563688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-170b291e-13e2-4610-8f65-9bdc76fbe851 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:35.571739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:35.572916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:35.574037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:35.574037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:35.574037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:35.576276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 378/736] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:35.578230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7da1-25e8-494f-b96c-13f0979fb90a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.578741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7da1-25e8-494f-b96c-13f0979fb90a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.579168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fa7da1-25e8-494f-b96c-13f0979fb90a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.580665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 379/737] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:35.581699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7da1-25e8-494f-b96c-13f0979fb90a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:35.679827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7383b85-a956-47a9-9de2-cab655f6fbdc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:35.697279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fa7da1-25e8-494f-b96c-13f0979fb90a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:35.698902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:35.721973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80a7a0-678e-4625-894f-2b2de97e4a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:35.722603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80a7a0-678e-4625-894f-2b2de97e4a51 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.722881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80a7a0-678e-4625-894f-2b2de97e4a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.723153 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80a7a0-678e-4625-894f-2b2de97e4a51 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.733417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80a7a0-678e-4625-894f-2b2de97e4a51 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:35.735750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15f2a98-d429-4f6c-af09-8fa557437591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:35.736387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f2a98-d429-4f6c-af09-8fa557437591 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.736671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f2a98-d429-4f6c-af09-8fa557437591 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.736945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15f2a98-d429-4f6c-af09-8fa557437591 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.737602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f2a98-d429-4f6c-af09-8fa557437591 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:35.737894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f2a98-d429-4f6c-af09-8fa557437591 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-cd80a7a0-678e-4625-894f-2b2de97e4a51 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:35.738625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:35.739551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:35.745347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:35.746165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15f2a98-d429-4f6c-af09-8fa557437591 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:35.746252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 359/738] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:35.746252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80a7a0-678e-4625-894f-2b2de97e4a51 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:35.757866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 380/739] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:35.759491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b1795-abb9-430b-8a7e-a22b4ad71377 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.759781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b1795-abb9-430b-8a7e-a22b4ad71377 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.760405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3b1795-abb9-430b-8a7e-a22b4ad71377 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.780081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6c3b1795-abb9-430b-8a7e-a22b4ad71377 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:35.781845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6c3b1795-abb9-430b-8a7e-a22b4ad71377 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:35.808170 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:35.846373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80a7a0-678e-4625-894f-2b2de97e4a51 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:35.847146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 381/740] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:35.847965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b1795-abb9-430b-8a7e-a22b4ad71377 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:35.898311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab44035-a70c-4b4d-bffe-41e790975975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:35.898921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44035-a70c-4b4d-bffe-41e790975975 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.899204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44035-a70c-4b4d-bffe-41e790975975 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.899483 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ab44035-a70c-4b4d-bffe-41e790975975 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.900121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab44035-a70c-4b4d-bffe-41e790975975 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:35.900517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab44035-a70c-4b4d-bffe-41e790975975 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:35.901895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ab44035-a70c-4b4d-bffe-41e790975975 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:35.914334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 360/741] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:35.915197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab44035-a70c-4b4d-bffe-41e790975975 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:35.947636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:35.959053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3b1795-abb9-430b-8a7e-a22b4ad71377 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:35.994581 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c13a2e-eaca-4cce-b7a6-06a49d73f688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:35.995192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13a2e-eaca-4cce-b7a6-06a49d73f688 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:35.995476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13a2e-eaca-4cce-b7a6-06a49d73f688 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:35.995755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c13a2e-eaca-4cce-b7a6-06a49d73f688 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:35.996453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13a2e-eaca-4cce-b7a6-06a49d73f688 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:35.996780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13a2e-eaca-4cce-b7a6-06a49d73f688 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:35.998147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c13a2e-eaca-4cce-b7a6-06a49d73f688 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:36.007136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 382/742] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:36.008124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a74a8-b329-4b29-92f2-724051962482 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.008437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a74a8-b329-4b29-92f2-724051962482 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.008713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b7a74a8-b329-4b29-92f2-724051962482 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.012389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 383/743] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:36 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:36.012389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a74a8-b329-4b29-92f2-724051962482 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:36.033241 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ab44035-a70c-4b4d-bffe-41e790975975 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:36.057272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:36.070974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eb364-52a2-49fc-a16a-9343c323e41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:36.071451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eb364-52a2-49fc-a16a-9343c323e41b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.071737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eb364-52a2-49fc-a16a-9343c323e41b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.072014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5eb364-52a2-49fc-a16a-9343c323e41b None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.080297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5eb364-52a2-49fc-a16a-9343c323e41b None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:36.081735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe5eb364-52a2-49fc-a16a-9343c323e41b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fe5eb364-52a2-49fc-a16a-9343c323e41b None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:36.093176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:36.094131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:36.095079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 361/744] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 24 14:13:35 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:36.100048 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eb364-52a2-49fc-a16a-9343c323e41b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:36.126421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b7a74a8-b329-4b29-92f2-724051962482 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:36.162887 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b275ed08-ef71-4826-952c-4142c897dee7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:36.163510 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275ed08-ef71-4826-952c-4142c897dee7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.163789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275ed08-ef71-4826-952c-4142c897dee7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.164061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b275ed08-ef71-4826-952c-4142c897dee7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.171149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275ed08-ef71-4826-952c-4142c897dee7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:36.173133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b275ed08-ef71-4826-952c-4142c897dee7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b275ed08-ef71-4826-952c-4142c897dee7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:36.184633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:36.191003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 384/745] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e5291-b15b-497b-b261-5972d5731e9b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.192260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e5291-b15b-497b-b261-5972d5731e9b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.193047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e5291-b15b-497b-b261-5972d5731e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.201625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5eb364-52a2-49fc-a16a-9343c323e41b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:36.208028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-116e5291-b15b-497b-b261-5972d5731e9b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:36.209237 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-116e5291-b15b-497b-b261-5972d5731e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:36.218495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:36.235223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906bb3-ee1f-4f2a-9c21-3c0f3a6e34f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:36.235849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906bb3-ee1f-4f2a-9c21-3c0f3a6e34f2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.236133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906bb3-ee1f-4f2a-9c21-3c0f3a6e34f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.236436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08906bb3-ee1f-4f2a-9c21-3c0f3a6e34f2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.246678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906bb3-ee1f-4f2a-9c21-3c0f3a6e34f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:36.248138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08906bb3-ee1f-4f2a-9c21-3c0f3a6e34f2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-08906bb3-ee1f-4f2a-9c21-3c0f3a6e34f2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:36.261997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:36.263147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:36.264394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:36.264394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:36.264394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:36.264394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 362/746] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:36.264394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906bb3-ee1f-4f2a-9c21-3c0f3a6e34f2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:36.277695 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 385/747] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Sep 24 14:13:36.278506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e5291-b15b-497b-b261-5972d5731e9b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:36.299190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:36.378185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08906bb3-ee1f-4f2a-9c21-3c0f3a6e34f2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:36.382430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e5291-b15b-497b-b261-5972d5731e9b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:36.416617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6dda5-f2e3-469a-94ce-4d0643e78cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:36.417218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6dda5-f2e3-469a-94ce-4d0643e78cd3 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.417564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6dda5-f2e3-469a-94ce-4d0643e78cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.417758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c6dda5-f2e3-469a-94ce-4d0643e78cd3 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.418397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6dda5-f2e3-469a-94ce-4d0643e78cd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:36.419755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c6dda5-f2e3-469a-94ce-4d0643e78cd3 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:36.421214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b6970-7eb3-4909-8353-4d22814c72de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:36.421870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b6970-7eb3-4909-8353-4d22814c72de None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.422151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b6970-7eb3-4909-8353-4d22814c72de None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.422423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157b6970-7eb3-4909-8353-4d22814c72de None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.423141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b6970-7eb3-4909-8353-4d22814c72de None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:36.423446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b6970-7eb3-4909-8353-4d22814c72de None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:36.424897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157b6970-7eb3-4909-8353-4d22814c72de None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:36.440228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 386/748] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:13:36 2022] POST /identity/v3/services => generated 251 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:36.440228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6dda5-f2e3-469a-94ce-4d0643e78cd3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:36.443748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 363/749] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 24 14:13:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:36.449163 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b6970-7eb3-4909-8353-4d22814c72de None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:36.454349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:36.565145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:36.574847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157b6970-7eb3-4909-8353-4d22814c72de None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:36.599408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c6dda5-f2e3-469a-94ce-4d0643e78cd3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:36.614067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c184c-83e1-469a-8d28-17787c9fef94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:36.614777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c184c-83e1-469a-8d28-17787c9fef94 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.615122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c184c-83e1-469a-8d28-17787c9fef94 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.615465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9c184c-83e1-469a-8d28-17787c9fef94 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.616217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c184c-83e1-469a-8d28-17787c9fef94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:36.616590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c184c-83e1-469a-8d28-17787c9fef94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:36.618050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9c184c-83e1-469a-8d28-17787c9fef94 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:36.630487 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 364/750] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:36.631393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c184c-83e1-469a-8d28-17787c9fef94 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:36.645183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb39b4a-fab9-48ee-9f5b-324588c483f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:36.645790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39b4a-fab9-48ee-9f5b-324588c483f4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.646069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39b4a-fab9-48ee-9f5b-324588c483f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.646340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adb39b4a-fab9-48ee-9f5b-324588c483f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.647037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb39b4a-fab9-48ee-9f5b-324588c483f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:36.647342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb39b4a-fab9-48ee-9f5b-324588c483f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:36.648826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adb39b4a-fab9-48ee-9f5b-324588c483f4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:36.663448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 387/751] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:36.665234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb39b4a-fab9-48ee-9f5b-324588c483f4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:36.733341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:36.739914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9c184c-83e1-469a-8d28-17787c9fef94 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:36.775049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429cb11-0b9e-463a-9c63-8a2ab3686609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:36.775802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429cb11-0b9e-463a-9c63-8a2ab3686609 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.776218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429cb11-0b9e-463a-9c63-8a2ab3686609 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.776441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adb39b4a-fab9-48ee-9f5b-324588c483f4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:36.776703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7429cb11-0b9e-463a-9c63-8a2ab3686609 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.800768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:36.813123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c703-a62d-42a7-a519-d5cce21c395f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:36.813846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c703-a62d-42a7-a519-d5cce21c395f None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:36.814227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c703-a62d-42a7-a519-d5cce21c395f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:36.814598 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c5c703-a62d-42a7-a519-d5cce21c395f None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:36.815345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5c703-a62d-42a7-a519-d5cce21c395f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:36.816852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c5c703-a62d-42a7-a519-d5cce21c395f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:36.831469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 388/752] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:13:36 2022] POST /identity/v3/services => generated 240 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:36.832516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c703-a62d-42a7-a519-d5cce21c395f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:36.860335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429cb11-0b9e-463a-9c63-8a2ab3686609 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:36.862294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7429cb11-0b9e-463a-9c63-8a2ab3686609 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:36.981433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c5c703-a62d-42a7-a519-d5cce21c395f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:36.990143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 365/753] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:36 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Sep 24 14:13:36.991091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429cb11-0b9e-463a-9c63-8a2ab3686609 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:37.016534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:37.035850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9eca37-ec9b-4869-9dd2-50c655154044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:37.035850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eca37-ec9b-4869-9dd2-50c655154044 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:37.035850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eca37-ec9b-4869-9dd2-50c655154044 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:37.035850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9eca37-ec9b-4869-9dd2-50c655154044 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:37.050183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9eca37-ec9b-4869-9dd2-50c655154044 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:37.051681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9eca37-ec9b-4869-9dd2-50c655154044 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:37.057901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8b9eca37-ec9b-4869-9dd2-50c655154044 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:37.067643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:37.069099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 389/754] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 24 14:13:36 2022] GET /identity/v3/users/nova => generated 82 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:37.070246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9eca37-ec9b-4869-9dd2-50c655154044 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:37.115732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7429cb11-0b9e-463a-9c63-8a2ab3686609 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:37.152963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b960c52-285e-43f9-ba15-0c0a8fe22c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:37.153777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960c52-285e-43f9-ba15-0c0a8fe22c4c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:37.154131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960c52-285e-43f9-ba15-0c0a8fe22c4c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:37.154474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b960c52-285e-43f9-ba15-0c0a8fe22c4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:37.155437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b960c52-285e-43f9-ba15-0c0a8fe22c4c None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=100d19cd9f1742b7ae913376eb75bbd9) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:37.155971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b960c52-285e-43f9-ba15-0c0a8fe22c4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:37.157580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b960c52-285e-43f9-ba15-0c0a8fe22c4c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:37.163347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 366/755] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:36 2022] GET /identity/v3/role_assignments?user.id=100d19cd9f1742b7ae913376eb75bbd9&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:37.164318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b960c52-285e-43f9-ba15-0c0a8fe22c4c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:37.196423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9eca37-ec9b-4869-9dd2-50c655154044 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:37.267276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15d2e0-b0e9-4ed9-8c21-a390339a7f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:37.267942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15d2e0-b0e9-4ed9-8c21-a390339a7f89 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:37.269823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15d2e0-b0e9-4ed9-8c21-a390339a7f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:37.270097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f15d2e0-b0e9-4ed9-8c21-a390339a7f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:37.292924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15d2e0-b0e9-4ed9-8c21-a390339a7f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:37.294400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f15d2e0-b0e9-4ed9-8c21-a390339a7f89 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6f15d2e0-b0e9-4ed9-8c21-a390339a7f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:37.327212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:37.328522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:37.329434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:37.329434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:37.329434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:37.336198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 390/756] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:37.341244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15d2e0-b0e9-4ed9-8c21-a390339a7f89 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:37.355226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b960c52-285e-43f9-ba15-0c0a8fe22c4c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:37.373983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:37.397773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:37.408547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04dc46-d8a0-4ee3-beee-af10ba67cfb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:37.410543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04dc46-d8a0-4ee3-beee-af10ba67cfb6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:37.410996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04dc46-d8a0-4ee3-beee-af10ba67cfb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:37.411424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a04dc46-d8a0-4ee3-beee-af10ba67cfb6 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:37.413720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04dc46-d8a0-4ee3-beee-af10ba67cfb6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:37.414212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04dc46-d8a0-4ee3-beee-af10ba67cfb6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:37.416673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a04dc46-d8a0-4ee3-beee-af10ba67cfb6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:37.441788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 367/757] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 24 14:13:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:37.447648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04dc46-d8a0-4ee3-beee-af10ba67cfb6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:37.517694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f15d2e0-b0e9-4ed9-8c21-a390339a7f89 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:37.569275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a04dc46-d8a0-4ee3-beee-af10ba67cfb6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:37.595878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d6eb9-8717-4f50-ab3a-ccaf1206850c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:37.596589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d6eb9-8717-4f50-ab3a-ccaf1206850c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:37.596871 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d6eb9-8717-4f50-ab3a-ccaf1206850c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:37.597142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91d6eb9-8717-4f50-ab3a-ccaf1206850c None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:37.597831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d6eb9-8717-4f50-ab3a-ccaf1206850c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:37.598138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d6eb9-8717-4f50-ab3a-ccaf1206850c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:37.599753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91d6eb9-8717-4f50-ab3a-ccaf1206850c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:37.611328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925bcf2-911a-4e4c-b2ee-a92d93e8b90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:37.612247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925bcf2-911a-4e4c-b2ee-a92d93e8b90b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:37.612688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 391/758] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:37.612856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925bcf2-911a-4e4c-b2ee-a92d93e8b90b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:37.613270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e925bcf2-911a-4e4c-b2ee-a92d93e8b90b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:37.621181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d6eb9-8717-4f50-ab3a-ccaf1206850c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:37.642585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925bcf2-911a-4e4c-b2ee-a92d93e8b90b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:37.646582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e925bcf2-911a-4e4c-b2ee-a92d93e8b90b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e925bcf2-911a-4e4c-b2ee-a92d93e8b90b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:37.677393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:37.678669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:37.679799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:37.679799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:37.679799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:37.688469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 368/759] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:37.691572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925bcf2-911a-4e4c-b2ee-a92d93e8b90b None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:37.752269 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:37.822729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:37.849797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91d6eb9-8717-4f50-ab3a-ccaf1206850c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:37.888997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e925bcf2-911a-4e4c-b2ee-a92d93e8b90b None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:37.928288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079aa516-a1c8-4764-8e93-adeb3a10c6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:37.929346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aa516-a1c8-4764-8e93-adeb3a10c6ff None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:37.929813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aa516-a1c8-4764-8e93-adeb3a10c6ff None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:37.930290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079aa516-a1c8-4764-8e93-adeb3a10c6ff None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:37.931121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079aa516-a1c8-4764-8e93-adeb3a10c6ff None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:37.931607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079aa516-a1c8-4764-8e93-adeb3a10c6ff None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:37.933596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079aa516-a1c8-4764-8e93-adeb3a10c6ff None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:37.946543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 369/760] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:37.947271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10624-cb34-46a9-8f7c-0568e407ad38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:37.948022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10624-cb34-46a9-8f7c-0568e407ad38 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:37.948380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10624-cb34-46a9-8f7c-0568e407ad38 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:37.948662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f10624-cb34-46a9-8f7c-0568e407ad38 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:37.951579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079aa516-a1c8-4764-8e93-adeb3a10c6ff None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:37.968756 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10624-cb34-46a9-8f7c-0568e407ad38 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:37.970096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f10624-cb34-46a9-8f7c-0568e407ad38 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-08f10624-cb34-46a9-8f7c-0568e407ad38 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:37.989784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:37.991162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:37.992072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:37.992072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:37.992072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:37.992072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:37.992072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:37.992072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:37.992072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:37.992072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:37.992072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 392/761] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 370 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:38.013155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10624-cb34-46a9-8f7c-0568e407ad38 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:38.055277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:38.079513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079aa516-a1c8-4764-8e93-adeb3a10c6ff None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:38.121526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cebfe9-cd26-4234-a920-be44d6c27f4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:38.122511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cebfe9-cd26-4234-a920-be44d6c27f4c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:38.123343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cebfe9-cd26-4234-a920-be44d6c27f4c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:38.123823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38cebfe9-cd26-4234-a920-be44d6c27f4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:38.133458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cebfe9-cd26-4234-a920-be44d6c27f4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:38.135283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38cebfe9-cd26-4234-a920-be44d6c27f4c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-38cebfe9-cd26-4234-a920-be44d6c27f4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:38.148660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:38.149592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:38.150515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:38.150515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:38.150515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:38.150515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:38.150515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:38.150515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:38.150515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:38.150515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:38.153091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 370/762] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:38.158996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cebfe9-cd26-4234-a920-be44d6c27f4c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:38.266220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f10624-cb34-46a9-8f7c-0568e407ad38 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:38.305668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38cebfe9-cd26-4234-a920-be44d6c27f4c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:38.342730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43b23d-13c5-4a2a-927f-46711a68e36c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:38.344270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43b23d-13c5-4a2a-927f-46711a68e36c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:38.344923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43b23d-13c5-4a2a-927f-46711a68e36c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:38.345512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a43b23d-13c5-4a2a-927f-46711a68e36c None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:38.346395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43b23d-13c5-4a2a-927f-46711a68e36c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:38.346873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43b23d-13c5-4a2a-927f-46711a68e36c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:38.348513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a43b23d-13c5-4a2a-927f-46711a68e36c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:38.360881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e5ea-691e-4b69-af5c-b4caba3ce7a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:38.361948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e5ea-691e-4b69-af5c-b4caba3ce7a2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:38.361948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e5ea-691e-4b69-af5c-b4caba3ce7a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:38.362211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a706e5ea-691e-4b69-af5c-b4caba3ce7a2 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:38.362912 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706e5ea-691e-4b69-af5c-b4caba3ce7a2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:38.363219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706e5ea-691e-4b69-af5c-b4caba3ce7a2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:38.367586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a706e5ea-691e-4b69-af5c-b4caba3ce7a2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:38.371261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 371/763] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:38.382705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43b23d-13c5-4a2a-927f-46711a68e36c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:38.387577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 393/764] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 375 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:38.397933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:38.398766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e5ea-691e-4b69-af5c-b4caba3ce7a2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:38.418253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:38.512003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a43b23d-13c5-4a2a-927f-46711a68e36c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:38.552939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1640fb4-9175-4f64-bcf8-c1a51bb19850 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:38.553590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1640fb4-9175-4f64-bcf8-c1a51bb19850 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:38.553868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1640fb4-9175-4f64-bcf8-c1a51bb19850 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:38.554135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1640fb4-9175-4f64-bcf8-c1a51bb19850 None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/758be68931aa49e5828bc2c164940571/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:38.560047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1640fb4-9175-4f64-bcf8-c1a51bb19850 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=758be68931aa49e5828bc2c164940571, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:38.561510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1640fb4-9175-4f64-bcf8-c1a51bb19850 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:38.586478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 372/765] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:13:38 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/758be68931aa49e5828bc2c164940571/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:13:38.604372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a706e5ea-691e-4b69-af5c-b4caba3ce7a2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:38.650463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b30eb68-04c8-4629-aa03-84f7275d5461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:38.651063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30eb68-04c8-4629-aa03-84f7275d5461 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:38.651341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30eb68-04c8-4629-aa03-84f7275d5461 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:38.651612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b30eb68-04c8-4629-aa03-84f7275d5461 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:38.652468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30eb68-04c8-4629-aa03-84f7275d5461 None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=8af010ec8f3841a4b74907b13961e2b3) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:38.652726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30eb68-04c8-4629-aa03-84f7275d5461 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:38.654147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b30eb68-04c8-4629-aa03-84f7275d5461 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:38.660507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 394/766] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:38 2022] GET /identity/v3/role_assignments?user.id=8af010ec8f3841a4b74907b13961e2b3&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 259 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:38.899272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec41ca6-8776-4906-9a3d-97f946de8eeb None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:38.899611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec41ca6-8776-4906-9a3d-97f946de8eeb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:38.899785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec41ca6-8776-4906-9a3d-97f946de8eeb None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:38.901307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 373/767] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:38.909477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395a93-b30c-46ea-a4ee-55ea07a55044 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:38.909761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395a93-b30c-46ea-a4ee-55ea07a55044 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:38.910037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395a93-b30c-46ea-a4ee-55ea07a55044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:38.928328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bd395a93-b30c-46ea-a4ee-55ea07a55044 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:38.929510 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bd395a93-b30c-46ea-a4ee-55ea07a55044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:39.004042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 395/768] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:13:39.296232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2e83-af1f-4a11-b80b-f969f70fdc2d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:39.297136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2e83-af1f-4a11-b80b-f969f70fdc2d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:39.297310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae2e83-af1f-4a11-b80b-f969f70fdc2d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:39.298913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 374/769] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:39.304342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba770987-955e-4b8b-906c-a91bd08c0ce8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:39.304632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba770987-955e-4b8b-906c-a91bd08c0ce8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:39.304911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba770987-955e-4b8b-906c-a91bd08c0ce8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:39.307762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae2e83-af1f-4a11-b80b-f969f70fdc2d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:39.315479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:39.328385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ba770987-955e-4b8b-906c-a91bd08c0ce8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:39.329578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ba770987-955e-4b8b-906c-a91bd08c0ce8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:39.399649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 396/770] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:39 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:39.421002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:39.475859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ae2e83-af1f-4a11-b80b-f969f70fdc2d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:39.520561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b38a5-8f77-42ba-8e17-635b6a815f95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:39.521199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b38a5-8f77-42ba-8e17-635b6a815f95 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:39.521478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b38a5-8f77-42ba-8e17-635b6a815f95 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:39.521754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9b38a5-8f77-42ba-8e17-635b6a815f95 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:39.522334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b38a5-8f77-42ba-8e17-635b6a815f95 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:39.523702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9b38a5-8f77-42ba-8e17-635b6a815f95 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6a9b38a5-8f77-42ba-8e17-635b6a815f95 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:39.533270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:39.534294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:39.535160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 375/771] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Sep 24 14:13:39 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:39.541859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba770987-955e-4b8b-906c-a91bd08c0ce8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:39.695159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba770987-955e-4b8b-906c-a91bd08c0ce8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:39.737497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:39.744825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e452ac-8dfd-4597-ad71-9505003fd8e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:39.745442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e452ac-8dfd-4597-ad71-9505003fd8e9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:39.745722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e452ac-8dfd-4597-ad71-9505003fd8e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:39.745994 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e452ac-8dfd-4597-ad71-9505003fd8e9 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:39.746636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e452ac-8dfd-4597-ad71-9505003fd8e9 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:39.746941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e452ac-8dfd-4597-ad71-9505003fd8e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:39.748344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e452ac-8dfd-4597-ad71-9505003fd8e9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:39.754385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 397/772] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 24 14:13:39 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:39.759841 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b38a5-8f77-42ba-8e17-635b6a815f95 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:39.836669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e452ac-8dfd-4597-ad71-9505003fd8e9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:39.944574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9b38a5-8f77-42ba-8e17-635b6a815f95 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:39.970971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e452ac-8dfd-4597-ad71-9505003fd8e9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:39.980801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:39.992350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1a2bcf-9c2c-409b-ae1c-9b113b64b1d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:39.992958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a2bcf-9c2c-409b-ae1c-9b113b64b1d0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:39.993239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a2bcf-9c2c-409b-ae1c-9b113b64b1d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:39.993510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1a2bcf-9c2c-409b-ae1c-9b113b64b1d0 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:39.994137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a2bcf-9c2c-409b-ae1c-9b113b64b1d0 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:39.994441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a2bcf-9c2c-409b-ae1c-9b113b64b1d0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:39.995808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1a2bcf-9c2c-409b-ae1c-9b113b64b1d0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:40.001700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 376/773] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 24 14:13:39 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:40.002966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9c4df-7dc2-41d4-a83d-5c82b4a88a1d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:40.003233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9c4df-7dc2-41d4-a83d-5c82b4a88a1d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:40.003510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff9c4df-7dc2-41d4-a83d-5c82b4a88a1d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:40.008739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 377/774] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:40.008739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9c4df-7dc2-41d4-a83d-5c82b4a88a1d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:40.022997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf85243-6192-4015-971c-51f032ac17b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:40.023617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85243-6192-4015-971c-51f032ac17b0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:40.023901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85243-6192-4015-971c-51f032ac17b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:40.024203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf85243-6192-4015-971c-51f032ac17b0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:40.025169 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf85243-6192-4015-971c-51f032ac17b0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:40.027048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf85243-6192-4015-971c-51f032ac17b0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-adf85243-6192-4015-971c-51f032ac17b0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:40.036634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:40.037622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:40.038479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 398/775] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:39 2022] GET /identity/v3/services/network => generated 88 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:40.039268 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c4448-215d-431b-8eab-90832d96cafd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:40.039344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c4448-215d-431b-8eab-90832d96cafd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:40.039924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982c4448-215d-431b-8eab-90832d96cafd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:40.065984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-982c4448-215d-431b-8eab-90832d96cafd None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:40.067469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-982c4448-215d-431b-8eab-90832d96cafd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:40.127074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:40.135792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff9c4df-7dc2-41d4-a83d-5c82b4a88a1d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:40.148417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 399/776] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:40 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:40.149612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c4448-215d-431b-8eab-90832d96cafd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:40.191377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4188a25-cee3-49ef-9b47-b325eba62624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:40.192739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4188a25-cee3-49ef-9b47-b325eba62624 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:40.193019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4188a25-cee3-49ef-9b47-b325eba62624 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:40.193293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4188a25-cee3-49ef-9b47-b325eba62624 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:40.194001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4188a25-cee3-49ef-9b47-b325eba62624 None admin] RBAC: Adding query filter params (interface=public, service_id=b4a58a95c85e44a7aee6e52a02c9fcd7, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:40.194314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4188a25-cee3-49ef-9b47-b325eba62624 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:40.195689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4188a25-cee3-49ef-9b47-b325eba62624 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:40.214179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 378/777] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 24 14:13:40 2022] GET /identity/v3/endpoints?service_id=b4a58a95c85e44a7aee6e52a02c9fcd7&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:40.220019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4188a25-cee3-49ef-9b47-b325eba62624 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:40.324768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:40.347837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982c4448-215d-431b-8eab-90832d96cafd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:40.370615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4188a25-cee3-49ef-9b47-b325eba62624 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:40.405337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831b1a2-9d80-4a11-920c-ee8ff2bdb47a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:40.406480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b1a2-9d80-4a11-920c-ee8ff2bdb47a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:40.406763 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b1a2-9d80-4a11-920c-ee8ff2bdb47a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:40.407039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d831b1a2-9d80-4a11-920c-ee8ff2bdb47a None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:40.407656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831b1a2-9d80-4a11-920c-ee8ff2bdb47a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:40.409300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d831b1a2-9d80-4a11-920c-ee8ff2bdb47a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:40.415050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 379/778] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 24 14:13:40 2022] GET /identity/v3/services => generated 772 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:40.429587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493f2fd-304e-4b6c-9fc0-79d7d81e9f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:40.430230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493f2fd-304e-4b6c-9fc0-79d7d81e9f06 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:40.430509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493f2fd-304e-4b6c-9fc0-79d7d81e9f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:40.430778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8493f2fd-304e-4b6c-9fc0-79d7d81e9f06 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:40.431428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493f2fd-304e-4b6c-9fc0-79d7d81e9f06 None admin] RBAC: Adding query filter params (name=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:40.431731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493f2fd-304e-4b6c-9fc0-79d7d81e9f06 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:40.433173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8493f2fd-304e-4b6c-9fc0-79d7d81e9f06 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:40.438924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 400/779] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:13:40 2022] GET /identity/v3/services?name=network => generated 124 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:40.444143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831b1a2-9d80-4a11-920c-ee8ff2bdb47a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:40.474898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493f2fd-304e-4b6c-9fc0-79d7d81e9f06 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:40.546889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:40.598075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8493f2fd-304e-4b6c-9fc0-79d7d81e9f06 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:40.635642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699f10a-2570-4270-a664-d3222ef5fa4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:40.636712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699f10a-2570-4270-a664-d3222ef5fa4e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:40.637202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699f10a-2570-4270-a664-d3222ef5fa4e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:40.637677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699f10a-2570-4270-a664-d3222ef5fa4e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:40.649203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d831b1a2-9d80-4a11-920c-ee8ff2bdb47a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:40.649729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7699f10a-2570-4270-a664-d3222ef5fa4e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7699f10a-2570-4270-a664-d3222ef5fa4e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:40.656209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:40.657175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:40.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:40.660658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 401/780] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:40 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:40.666550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699f10a-2570-4270-a664-d3222ef5fa4e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:40.675285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:40.690342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa261e-8d89-4861-9745-c84d283b7c50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:40.691003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa261e-8d89-4861-9745-c84d283b7c50 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:40.691325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa261e-8d89-4861-9745-c84d283b7c50 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:40.691601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0fa261e-8d89-4861-9745-c84d283b7c50 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:40.692250 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa261e-8d89-4861-9745-c84d283b7c50 None admin] RBAC: Adding query filter params (type=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:40.692552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa261e-8d89-4861-9745-c84d283b7c50 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:40.693915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0fa261e-8d89-4861-9745-c84d283b7c50 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:40.699460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 380/781] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:13:40 2022] GET /identity/v3/services?type=network => generated 350 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:40.705866 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa261e-8d89-4861-9745-c84d283b7c50 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:40.798754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699f10a-2570-4270-a664-d3222ef5fa4e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:40.826996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:40.854285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7f93-3bd9-4fe8-912c-2e937c0fb5b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:40.854813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7f93-3bd9-4fe8-912c-2e937c0fb5b4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:40.855092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7f93-3bd9-4fe8-912c-2e937c0fb5b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:40.855365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999e7f93-3bd9-4fe8-912c-2e937c0fb5b4 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:40.856033 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e7f93-3bd9-4fe8-912c-2e937c0fb5b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:40.856367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e7f93-3bd9-4fe8-912c-2e937c0fb5b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:40.857744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999e7f93-3bd9-4fe8-912c-2e937c0fb5b4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:40.870681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0fa261e-8d89-4861-9745-c84d283b7c50 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:40.876400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 402/782] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:40 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:40.883520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7f93-3bd9-4fe8-912c-2e937c0fb5b4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:40.931285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dac66a-4b8c-479e-aacf-6a41d57a9dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:40.931906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac66a-4b8c-479e-aacf-6a41d57a9dd0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:40.932207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac66a-4b8c-479e-aacf-6a41d57a9dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:40.932486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6dac66a-4b8c-479e-aacf-6a41d57a9dd0 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:40.933192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dac66a-4b8c-479e-aacf-6a41d57a9dd0 None admin] RBAC: Adding query filter params (interface=public, service_id=547e07be14a040699a052ecc1e7e6125, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:40.933505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dac66a-4b8c-479e-aacf-6a41d57a9dd0 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:40.934894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6dac66a-4b8c-479e-aacf-6a41d57a9dd0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:40.944010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 381/783] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 24 14:13:40 2022] GET /identity/v3/endpoints?service_id=547e07be14a040699a052ecc1e7e6125&interface=public®ion_id=RegionOne => generated 194 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:40.953833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dac66a-4b8c-479e-aacf-6a41d57a9dd0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:41.046701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:41.063540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999e7f93-3bd9-4fe8-912c-2e937c0fb5b4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:41.111559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ee8f1-97cf-45e7-a91a-87cf297c546f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:41.112132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ee8f1-97cf-45e7-a91a-87cf297c546f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:41.112436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ee8f1-97cf-45e7-a91a-87cf297c546f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:41.112705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ee8f1-97cf-45e7-a91a-87cf297c546f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:41.132144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ee8f1-97cf-45e7-a91a-87cf297c546f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:41.133655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be9ee8f1-97cf-45e7-a91a-87cf297c546f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:41.152641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6dac66a-4b8c-479e-aacf-6a41d57a9dd0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-be9ee8f1-97cf-45e7-a91a-87cf297c546f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:41.157074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:41.158193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:41.159325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:41.159325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:41.159325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:41.166623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 403/784] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:41.167690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ee8f1-97cf-45e7-a91a-87cf297c546f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:41.189819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46b0941-c19c-40c2-a9a2-87fe083ced78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:41.190436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b0941-c19c-40c2-a9a2-87fe083ced78 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:41.190718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b0941-c19c-40c2-a9a2-87fe083ced78 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:41.190995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46b0941-c19c-40c2-a9a2-87fe083ced78 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:41.191613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b0941-c19c-40c2-a9a2-87fe083ced78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:41.193017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46b0941-c19c-40c2-a9a2-87fe083ced78 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:41.206757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 382/785] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 24 14:13:40 2022] GET /identity/v3/services => generated 772 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:41.220322 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0915d-bcd0-490f-8e15-2f8ba5fdbdb9 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:41.220720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0915d-bcd0-490f-8e15-2f8ba5fdbdb9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:41.220992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac0915d-bcd0-490f-8e15-2f8ba5fdbdb9 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:41.221410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:41.223049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 383/786] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:41 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:41.232146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec71b-3678-4003-a62b-d48038757827 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:41.232497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec71b-3678-4003-a62b-d48038757827 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:41.232796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929ec71b-3678-4003-a62b-d48038757827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:41.269237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-929ec71b-3678-4003-a62b-d48038757827 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:41.270453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-929ec71b-3678-4003-a62b-d48038757827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:41.357806 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9ee8f1-97cf-45e7-a91a-87cf297c546f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:41.409772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 384/787] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:41.435327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4d547-6aa2-4151-99d1-9db66d8d597e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:41.435939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d547-6aa2-4151-99d1-9db66d8d597e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:41.436304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d547-6aa2-4151-99d1-9db66d8d597e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:41.436581 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c4d547-6aa2-4151-99d1-9db66d8d597e None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:41.437801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4d547-6aa2-4151-99d1-9db66d8d597e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:41.438108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4d547-6aa2-4151-99d1-9db66d8d597e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:41.439482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5c4d547-6aa2-4151-99d1-9db66d8d597e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:41.454076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 404/788] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:41.459530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4d547-6aa2-4151-99d1-9db66d8d597e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:41.459969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d3eb-db6c-4758-93bd-1a7601b24482 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:41.460280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d3eb-db6c-4758-93bd-1a7601b24482 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:41.460579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb59d3eb-db6c-4758-93bd-1a7601b24482 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:41.461902 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 385/789] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:41.467240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65380a4a-872a-4fe9-89fe-a87538b1338e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:41.467586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65380a4a-872a-4fe9-89fe-a87538b1338e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:41.467870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65380a4a-872a-4fe9-89fe-a87538b1338e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:41.498169 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-65380a4a-872a-4fe9-89fe-a87538b1338e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:41.499937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-65380a4a-872a-4fe9-89fe-a87538b1338e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:41.545413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:41.576862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:41.577129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 386/790] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:41 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:13:41.591533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c4d547-6aa2-4151-99d1-9db66d8d597e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:41.633909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa15dfb-ab03-4955-a966-23715ff140c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:41.634566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa15dfb-ab03-4955-a966-23715ff140c0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:41.634846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa15dfb-ab03-4955-a966-23715ff140c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:41.635121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa15dfb-ab03-4955-a966-23715ff140c0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:41.644194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa15dfb-ab03-4955-a966-23715ff140c0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:41.645671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa15dfb-ab03-4955-a966-23715ff140c0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-caa15dfb-ab03-4955-a966-23715ff140c0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:41.665682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:41.666662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:41.667629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 405/791] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:41 2022] GET /identity/v3/users/swift => generated 83 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:41.674725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65380a4a-872a-4fe9-89fe-a87538b1338e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:41.757102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa15dfb-ab03-4955-a966-23715ff140c0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:41.837084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65380a4a-872a-4fe9-89fe-a87538b1338e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:41.897223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf8ddd-e4f8-4c77-addd-b15c30751bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:41.897849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf8ddd-e4f8-4c77-addd-b15c30751bbe None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:41.898102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf8ddd-e4f8-4c77-addd-b15c30751bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:41.898686 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cf8ddd-e4f8-4c77-addd-b15c30751bbe None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:41.899414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf8ddd-e4f8-4c77-addd-b15c30751bbe None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:41.899718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf8ddd-e4f8-4c77-addd-b15c30751bbe None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:41.901679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cf8ddd-e4f8-4c77-addd-b15c30751bbe None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:41.933735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 387/792] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 24 14:13:41 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:41.934513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf8ddd-e4f8-4c77-addd-b15c30751bbe None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:41.944789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa15dfb-ab03-4955-a966-23715ff140c0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:41.977775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:41.985389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9459f0-f242-48ac-8e11-99436d1c4d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:41.986044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9459f0-f242-48ac-8e11-99436d1c4d74 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:41.986322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9459f0-f242-48ac-8e11-99436d1c4d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:41.986590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9459f0-f242-48ac-8e11-99436d1c4d74 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.001305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9459f0-f242-48ac-8e11-99436d1c4d74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-af9459f0-f242-48ac-8e11-99436d1c4d74 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:42.008521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:42.009504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:42.010354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:42.017705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 406/793] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:42.017705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9459f0-f242-48ac-8e11-99436d1c4d74 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:42.054951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cf8ddd-e4f8-4c77-addd-b15c30751bbe None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:42.056538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:42.090693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06323c0-ede4-4c93-bea5-97e28d63ec72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:42.091238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06323c0-ede4-4c93-bea5-97e28d63ec72 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:42.091508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06323c0-ede4-4c93-bea5-97e28d63ec72 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:42.091782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06323c0-ede4-4c93-bea5-97e28d63ec72 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.102959 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06323c0-ede4-4c93-bea5-97e28d63ec72 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a06323c0-ede4-4c93-bea5-97e28d63ec72 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:42.107812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:42.108870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:42.109731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:42.113938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 388/794] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:42.114852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06323c0-ede4-4c93-bea5-97e28d63ec72 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:42.140120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9459f0-f242-48ac-8e11-99436d1c4d74 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:42.182674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343589-ebfc-4239-bb3c-cbd2740ec42b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:42.183647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343589-ebfc-4239-bb3c-cbd2740ec42b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:42.184524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343589-ebfc-4239-bb3c-cbd2740ec42b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:42.185441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3343589-ebfc-4239-bb3c-cbd2740ec42b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.198755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343589-ebfc-4239-bb3c-cbd2740ec42b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:42.202209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3343589-ebfc-4239-bb3c-cbd2740ec42b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:42.218018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e3343589-ebfc-4239-bb3c-cbd2740ec42b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:42.224242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:42.225502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:42.226410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:42.226410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:42.226410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:42.228571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06323c0-ede4-4c93-bea5-97e28d63ec72 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:42.228821 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 407/795] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:42.229890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343589-ebfc-4239-bb3c-cbd2740ec42b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:42.264186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8060-976f-4318-980e-97a71c35195a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:42.265467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8060-976f-4318-980e-97a71c35195a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:42.265817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8060-976f-4318-980e-97a71c35195a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:42.266157 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11db8060-976f-4318-980e-97a71c35195a None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.266874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8060-976f-4318-980e-97a71c35195a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:42.267296 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8060-976f-4318-980e-97a71c35195a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:42.268804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11db8060-976f-4318-980e-97a71c35195a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:42.281970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 389/796] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:42.281970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8060-976f-4318-980e-97a71c35195a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:42.316607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:42.351461 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3343589-ebfc-4239-bb3c-cbd2740ec42b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:42.394085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11db8060-976f-4318-980e-97a71c35195a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:42.395126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ab07e-3be5-4e5f-9a95-3f54fbfe890c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:42.396190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ab07e-3be5-4e5f-9a95-3f54fbfe890c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:42.396626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ab07e-3be5-4e5f-9a95-3f54fbfe890c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:42.397954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88ab07e-3be5-4e5f-9a95-3f54fbfe890c None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.398788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ab07e-3be5-4e5f-9a95-3f54fbfe890c None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:42.399254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ab07e-3be5-4e5f-9a95-3f54fbfe890c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:42.400825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b88ab07e-3be5-4e5f-9a95-3f54fbfe890c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:42.411966 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 408/797] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:42.413184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ab07e-3be5-4e5f-9a95-3f54fbfe890c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:42.436659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a47a88-f2f3-404a-a761-51b89ae7a7ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:42.437356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a47a88-f2f3-404a-a761-51b89ae7a7ae None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:42.437703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a47a88-f2f3-404a-a761-51b89ae7a7ae None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:42.438070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a47a88-f2f3-404a-a761-51b89ae7a7ae None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.438730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a47a88-f2f3-404a-a761-51b89ae7a7ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:42.439100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a47a88-f2f3-404a-a761-51b89ae7a7ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:42.440650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a47a88-f2f3-404a-a761-51b89ae7a7ae None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:42.458126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 390/798] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:42.459080 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a47a88-f2f3-404a-a761-51b89ae7a7ae None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:42.487339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:42.540426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88ab07e-3be5-4e5f-9a95-3f54fbfe890c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:42.568403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:42.580615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a47a88-f2f3-404a-a761-51b89ae7a7ae None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:42.584852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585b858-41d6-4398-8ea9-1add98c10697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:42.586724 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b858-41d6-4398-8ea9-1add98c10697 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:42.587259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b858-41d6-4398-8ea9-1add98c10697 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:42.587733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1585b858-41d6-4398-8ea9-1add98c10697 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.602117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585b858-41d6-4398-8ea9-1add98c10697 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:42.603842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1585b858-41d6-4398-8ea9-1add98c10697 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:42.620651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371a8bc-56bc-4e9a-aed2-cbcb3dfe42f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:42.621285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371a8bc-56bc-4e9a-aed2-cbcb3dfe42f6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:42.621566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371a8bc-56bc-4e9a-aed2-cbcb3dfe42f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:42.621841 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371a8bc-56bc-4e9a-aed2-cbcb3dfe42f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1585b858-41d6-4398-8ea9-1add98c10697 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:42.622177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:42.623095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:42.624063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:42.624063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:42.624063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:42.630722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 409/799] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:42.630722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585b858-41d6-4398-8ea9-1add98c10697 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:42.639867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371a8bc-56bc-4e9a-aed2-cbcb3dfe42f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:42.641907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371a8bc-56bc-4e9a-aed2-cbcb3dfe42f6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2371a8bc-56bc-4e9a-aed2-cbcb3dfe42f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:42.662886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:42.663897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:42.665472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:42.665472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:42.665472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:42.665472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 391/800] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:42.665472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371a8bc-56bc-4e9a-aed2-cbcb3dfe42f6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:42.755111 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1585b858-41d6-4398-8ea9-1add98c10697 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:42.755904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:42.804546 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcb340-a741-430b-82d7-2a6406f65eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:42.805566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb340-a741-430b-82d7-2a6406f65eca None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:42.805986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371a8bc-56bc-4e9a-aed2-cbcb3dfe42f6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:42.806271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb340-a741-430b-82d7-2a6406f65eca None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:42.806774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dadcb340-a741-430b-82d7-2a6406f65eca None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.819468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcb340-a741-430b-82d7-2a6406f65eca None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:42.824043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dadcb340-a741-430b-82d7-2a6406f65eca None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-dadcb340-a741-430b-82d7-2a6406f65eca None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:42.840465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:42.841474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:42.842390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:42.842390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:42.842390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:42.842390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:42.842390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:42.842390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:42.842390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:42.842390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:42.846749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 410/801] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:42.847707 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcb340-a741-430b-82d7-2a6406f65eca None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:42.862844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798125e-f133-42dc-989d-8ade5cc74aab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:42.863950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798125e-f133-42dc-989d-8ade5cc74aab None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:42.864766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798125e-f133-42dc-989d-8ade5cc74aab None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:42.865310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5798125e-f133-42dc-989d-8ade5cc74aab None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.866243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798125e-f133-42dc-989d-8ade5cc74aab None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:42.866841 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798125e-f133-42dc-989d-8ade5cc74aab None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:42.868695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5798125e-f133-42dc-989d-8ade5cc74aab None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:42.891008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 392/802] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:42.892099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798125e-f133-42dc-989d-8ade5cc74aab None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:42.900573 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:42.957442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dadcb340-a741-430b-82d7-2a6406f65eca None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:42.993067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6a3e9-7a25-445a-9336-8f11537e305e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:42.993740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6a3e9-7a25-445a-9336-8f11537e305e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:42.993937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6a3e9-7a25-445a-9336-8f11537e305e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:42.994207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde6a3e9-7a25-445a-9336-8f11537e305e None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:42.994836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6a3e9-7a25-445a-9336-8f11537e305e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:42.995245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6a3e9-7a25-445a-9336-8f11537e305e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:42.996538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde6a3e9-7a25-445a-9336-8f11537e305e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:43.009343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 411/803] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:43.009570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5798125e-f133-42dc-989d-8ade5cc74aab None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:43.014207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6a3e9-7a25-445a-9336-8f11537e305e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:43.037993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:43.048243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e4f127-15fc-43da-b3de-7451742eb588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:43.048853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4f127-15fc-43da-b3de-7451742eb588 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:43.049134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4f127-15fc-43da-b3de-7451742eb588 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:43.049404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e4f127-15fc-43da-b3de-7451742eb588 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:43.050096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4f127-15fc-43da-b3de-7451742eb588 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:43.050400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4f127-15fc-43da-b3de-7451742eb588 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:43.051837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e4f127-15fc-43da-b3de-7451742eb588 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:43.064185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 393/804] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:43.065230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d7fd1-af3d-4bd0-8b92-49a13120ef63 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:43.065519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d7fd1-af3d-4bd0-8b92-49a13120ef63 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:43.065794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d7fd1-af3d-4bd0-8b92-49a13120ef63 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:43.067137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 394/805] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:43.067722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d7fd1-af3d-4bd0-8b92-49a13120ef63 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:43.128315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:43.135623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde6a3e9-7a25-445a-9336-8f11537e305e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:43.174958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872d598-81d8-49cb-ba01-3a406ad6dd02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:43.175583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872d598-81d8-49cb-ba01-3a406ad6dd02 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:43.175868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872d598-81d8-49cb-ba01-3a406ad6dd02 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:43.176205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872d598-81d8-49cb-ba01-3a406ad6dd02 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:43.183115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d7fd1-af3d-4bd0-8b92-49a13120ef63 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:43.184505 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872d598-81d8-49cb-ba01-3a406ad6dd02 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:43.185981 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872d598-81d8-49cb-ba01-3a406ad6dd02 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e872d598-81d8-49cb-ba01-3a406ad6dd02 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:43.199466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:43.200771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 412/806] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 24 14:13:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:43.207241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872d598-81d8-49cb-ba01-3a406ad6dd02 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:43.227136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475ec25d-bcd4-4a99-a054-ae2b3ec7bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:43.227750 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec25d-bcd4-4a99-a054-ae2b3ec7bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:43.228030 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec25d-bcd4-4a99-a054-ae2b3ec7bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:43.228335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475ec25d-bcd4-4a99-a054-ae2b3ec7bcb3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:43.236133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ec25d-bcd4-4a99-a054-ae2b3ec7bcb3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:43.237600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475ec25d-bcd4-4a99-a054-ae2b3ec7bcb3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-475ec25d-bcd4-4a99-a054-ae2b3ec7bcb3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:43.248653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:43.249894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 395/807] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 24 14:13:43 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:43.251202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29c5d-3f46-4a09-8ba6-669e017175cc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:43.251855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29c5d-3f46-4a09-8ba6-669e017175cc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:43.251855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b29c5d-3f46-4a09-8ba6-669e017175cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:43.275049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-17b29c5d-3f46-4a09-8ba6-669e017175cc None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:43.276863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-17b29c5d-3f46-4a09-8ba6-669e017175cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:43.316766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872d598-81d8-49cb-ba01-3a406ad6dd02 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:43.328557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:43.353624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b85fe7-368d-46cc-9881-1e51a3373d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:43.354276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b85fe7-368d-46cc-9881-1e51a3373d39 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:43.354558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b85fe7-368d-46cc-9881-1e51a3373d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:43.354826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b85fe7-368d-46cc-9881-1e51a3373d39 None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/100d19cd9f1742b7ae913376eb75bbd9/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:43.364401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 396/808] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:43 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:43.364576 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b85fe7-368d-46cc-9881-1e51a3373d39 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=100d19cd9f1742b7ae913376eb75bbd9, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:43.364696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b29c5d-3f46-4a09-8ba6-669e017175cc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:43.364801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b85fe7-368d-46cc-9881-1e51a3373d39 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:43.373173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 413/809] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:13:43 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/100d19cd9f1742b7ae913376eb75bbd9/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:13:43.374064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b85fe7-368d-46cc-9881-1e51a3373d39 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:43.397414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:43.566136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b29c5d-3f46-4a09-8ba6-669e017175cc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:43.589392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b85fe7-368d-46cc-9881-1e51a3373d39 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:43.623628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9ed8d-2e02-43b3-a87b-51aa8505778e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:43.624974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9ed8d-2e02-43b3-a87b-51aa8505778e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:43.625327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9ed8d-2e02-43b3-a87b-51aa8505778e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:43.625673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d9ed8d-2e02-43b3-a87b-51aa8505778e None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:43.626569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9ed8d-2e02-43b3-a87b-51aa8505778e None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:43.627112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9ed8d-2e02-43b3-a87b-51aa8505778e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:43.628528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d9ed8d-2e02-43b3-a87b-51aa8505778e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:43.639390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83421547-9cd9-4bce-a0be-b317609a3b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:43.640215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83421547-9cd9-4bce-a0be-b317609a3b8c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:43.640591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83421547-9cd9-4bce-a0be-b317609a3b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:43.641842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83421547-9cd9-4bce-a0be-b317609a3b8c None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:43.642596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83421547-9cd9-4bce-a0be-b317609a3b8c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:43.642909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83421547-9cd9-4bce-a0be-b317609a3b8c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:43.644379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83421547-9cd9-4bce-a0be-b317609a3b8c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:43.658692 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 397/810] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 24 14:13:43 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:43.664574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9ed8d-2e02-43b3-a87b-51aa8505778e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:43.668035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 414/811] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 24 14:13:43 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:43.675546 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83421547-9cd9-4bce-a0be-b317609a3b8c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:43.714616 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:43.758294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:43.793532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d9ed8d-2e02-43b3-a87b-51aa8505778e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:43.797275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83421547-9cd9-4bce-a0be-b317609a3b8c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:43.830679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9fc085-5ad4-4198-8d9b-3dbfb1ef4294 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:43.831336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fc085-5ad4-4198-8d9b-3dbfb1ef4294 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:43.831509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fc085-5ad4-4198-8d9b-3dbfb1ef4294 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:43.831782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9fc085-5ad4-4198-8d9b-3dbfb1ef4294 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:43.837159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a1a53-3675-4e81-a7a0-03265d72ba6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:43.837787 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a1a53-3675-4e81-a7a0-03265d72ba6b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:43.838064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a1a53-3675-4e81-a7a0-03265d72ba6b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:43.838336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06a1a53-3675-4e81-a7a0-03265d72ba6b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:43.850270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a1a53-3675-4e81-a7a0-03265d72ba6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:43.851706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06a1a53-3675-4e81-a7a0-03265d72ba6b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d06a1a53-3675-4e81-a7a0-03265d72ba6b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:43.866421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:43.867577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:43.873390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:43.873390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:43.873390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:43.873390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 415/812] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:43.873390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a1a53-3675-4e81-a7a0-03265d72ba6b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:43.909795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fc085-5ad4-4198-8d9b-3dbfb1ef4294 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:43.911478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9fc085-5ad4-4198-8d9b-3dbfb1ef4294 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:43.950832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:43.978162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06a1a53-3675-4e81-a7a0-03265d72ba6b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.002283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:44.016526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8fe9-79c5-413d-afe5-33c34b7358e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.017161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8fe9-79c5-413d-afe5-33c34b7358e8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.017437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8fe9-79c5-413d-afe5-33c34b7358e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.017713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5bb8fe9-79c5-413d-afe5-33c34b7358e8 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.018297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb8fe9-79c5-413d-afe5-33c34b7358e8 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.019654 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5bb8fe9-79c5-413d-afe5-33c34b7358e8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f5bb8fe9-79c5-413d-afe5-33c34b7358e8 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:44.028615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:44.029823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Sep 24 14:13:44.030916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:44.034307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 398/813] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:43 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:13:44.034896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 416/814] 10.222.0.16 () {56 vars in 1129 bytes} [Sat Sep 24 14:13:43 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:44.035764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8fe9-79c5-413d-afe5-33c34b7358e8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.036434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1848a-d310-46bc-b3bc-782fb21473b2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.036718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1848a-d310-46bc-b3bc-782fb21473b2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.036991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70c1848a-d310-46bc-b3bc-782fb21473b2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.038374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 399/815] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:44.040930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1848a-d310-46bc-b3bc-782fb21473b2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.146342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70c1848a-d310-46bc-b3bc-782fb21473b2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.147780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5bb8fe9-79c5-413d-afe5-33c34b7358e8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.182270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b10025-f3f6-41fe-96a3-d6df794a4a26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.182985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b10025-f3f6-41fe-96a3-d6df794a4a26 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.183331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b10025-f3f6-41fe-96a3-d6df794a4a26 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.183656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b10025-f3f6-41fe-96a3-d6df794a4a26 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.184278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b10025-f3f6-41fe-96a3-d6df794a4a26 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:44.184582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b10025-f3f6-41fe-96a3-d6df794a4a26 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.185786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd6e036-00a3-4e59-8104-46cfc1002f2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.186267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b10025-f3f6-41fe-96a3-d6df794a4a26 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:44.186464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e036-00a3-4e59-8104-46cfc1002f2c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.187203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e036-00a3-4e59-8104-46cfc1002f2c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.187535 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:44.188669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd6e036-00a3-4e59-8104-46cfc1002f2c None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.189255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6e036-00a3-4e59-8104-46cfc1002f2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:44.189596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6e036-00a3-4e59-8104-46cfc1002f2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.190980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd6e036-00a3-4e59-8104-46cfc1002f2c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:44.196582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 400/816] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 24 14:13:44 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:44.197434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b10025-f3f6-41fe-96a3-d6df794a4a26 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.208186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 417/817] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:44.209351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bddc84-5ea0-4649-beee-f314333d338c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.209634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bddc84-5ea0-4649-beee-f314333d338c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.209899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bddc84-5ea0-4649-beee-f314333d338c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.228430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-28bddc84-5ea0-4649-beee-f314333d338c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:44.229603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-28bddc84-5ea0-4649-beee-f314333d338c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:44.276397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:44.301208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b10025-f3f6-41fe-96a3-d6df794a4a26 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.312327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 418/818] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:44 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:44.312327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bddc84-5ea0-4649-beee-f314333d338c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.358621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4235-3914-404f-bbab-9dd7e0d1788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.360094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4235-3914-404f-bbab-9dd7e0d1788c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.360404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4235-3914-404f-bbab-9dd7e0d1788c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.360731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9e4235-3914-404f-bbab-9dd7e0d1788c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.374585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4235-3914-404f-bbab-9dd7e0d1788c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.376719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9e4235-3914-404f-bbab-9dd7e0d1788c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ed9e4235-3914-404f-bbab-9dd7e0d1788c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:44.399222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:44.400246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:44.401242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:44.401242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:44.401242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:44.401242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 401/819] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:44.401896 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4235-3914-404f-bbab-9dd7e0d1788c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.428674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bddc84-5ea0-4649-beee-f314333d338c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.461825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:44.465294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91758b5-6fa8-45ba-b9d3-f1275e1423d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.466066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91758b5-6fa8-45ba-b9d3-f1275e1423d8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.466490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91758b5-6fa8-45ba-b9d3-f1275e1423d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.466905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91758b5-6fa8-45ba-b9d3-f1275e1423d8 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.467673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91758b5-6fa8-45ba-b9d3-f1275e1423d8 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:44.468871 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91758b5-6fa8-45ba-b9d3-f1275e1423d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.470383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91758b5-6fa8-45ba-b9d3-f1275e1423d8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:44.481361 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 419/820] 10.222.0.16 () {56 vars in 1124 bytes} [Sat Sep 24 14:13:44 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:44.482405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91758b5-6fa8-45ba-b9d3-f1275e1423d8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.525975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9e4235-3914-404f-bbab-9dd7e0d1788c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.529430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:44.562664 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68047b9-2514-40c2-8d79-f47be5c62532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.563504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68047b9-2514-40c2-8d79-f47be5c62532 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.563998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68047b9-2514-40c2-8d79-f47be5c62532 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.564442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68047b9-2514-40c2-8d79-f47be5c62532 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.571756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68047b9-2514-40c2-8d79-f47be5c62532 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.573505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68047b9-2514-40c2-8d79-f47be5c62532 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a68047b9-2514-40c2-8d79-f47be5c62532 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:44.585952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:44.587044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:44.588100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:44.588100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:44.588100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:44.588100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:44.588100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:44.588100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:44.588100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:44.588100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:44.589763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91758b5-6fa8-45ba-b9d3-f1275e1423d8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.594613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 402/821] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:44.595580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68047b9-2514-40c2-8d79-f47be5c62532 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.628457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813c0af-6fdf-4d02-9b83-65a6fcc2d87e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.629067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813c0af-6fdf-4d02-9b83-65a6fcc2d87e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.629340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813c0af-6fdf-4d02-9b83-65a6fcc2d87e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.629616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d813c0af-6fdf-4d02-9b83-65a6fcc2d87e None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.630258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813c0af-6fdf-4d02-9b83-65a6fcc2d87e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:44.630565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813c0af-6fdf-4d02-9b83-65a6fcc2d87e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.631929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d813c0af-6fdf-4d02-9b83-65a6fcc2d87e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:44.645838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 420/822] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:44.647500 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813c0af-6fdf-4d02-9b83-65a6fcc2d87e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.704623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68047b9-2514-40c2-8d79-f47be5c62532 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.715164 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:44.739880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622496b-6e0b-4d41-8973-d627eb16b3bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.740744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622496b-6e0b-4d41-8973-d627eb16b3bc None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.741166 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622496b-6e0b-4d41-8973-d627eb16b3bc None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.741579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5622496b-6e0b-4d41-8973-d627eb16b3bc None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.742409 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622496b-6e0b-4d41-8973-d627eb16b3bc None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.743909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5622496b-6e0b-4d41-8973-d627eb16b3bc None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:44.757341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d813c0af-6fdf-4d02-9b83-65a6fcc2d87e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.759173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:44.769447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 403/823] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:13:44 2022] POST /identity/v3/endpoints => generated 346 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:44.770756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622496b-6e0b-4d41-8973-d627eb16b3bc None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.801678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789d377-e958-49c7-812e-0b37ffd12e12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.802483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d377-e958-49c7-812e-0b37ffd12e12 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.802868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d377-e958-49c7-812e-0b37ffd12e12 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.803245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789d377-e958-49c7-812e-0b37ffd12e12 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.804074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789d377-e958-49c7-812e-0b37ffd12e12 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:44.804522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789d377-e958-49c7-812e-0b37ffd12e12 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.806146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789d377-e958-49c7-812e-0b37ffd12e12 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:44.824919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 421/824] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:44 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:44.824919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789d377-e958-49c7-812e-0b37ffd12e12 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.907242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5622496b-6e0b-4d41-8973-d627eb16b3bc None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.934708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789d377-e958-49c7-812e-0b37ffd12e12 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:44.946446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622f35-b290-4bd1-be99-28ccb74a74a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.947098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622f35-b290-4bd1-be99-28ccb74a74a0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.947380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622f35-b290-4bd1-be99-28ccb74a74a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.947684 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e622f35-b290-4bd1-be99-28ccb74a74a0 None admin] PATH_INFO: `/v3/services/network` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.948413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e622f35-b290-4bd1-be99-28ccb74a74a0 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.949916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e622f35-b290-4bd1-be99-28ccb74a74a0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6e622f35-b290-4bd1-be99-28ccb74a74a0 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:44.960881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:44.961926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Sep 24 14:13:44.962778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:44.967378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 404/825] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:44 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:44.968394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622f35-b290-4bd1-be99-28ccb74a74a0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:44.979255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44299484-a7a4-4508-acd5-dd62572f0236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:44.980359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44299484-a7a4-4508-acd5-dd62572f0236 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:44.980838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44299484-a7a4-4508-acd5-dd62572f0236 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:44.981334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44299484-a7a4-4508-acd5-dd62572f0236 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:44.988683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44299484-a7a4-4508-acd5-dd62572f0236 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:44.990380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44299484-a7a4-4508-acd5-dd62572f0236 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-44299484-a7a4-4508-acd5-dd62572f0236 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:45.002488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:45.003411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:45.004595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:45.004595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:45.004595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:45.004595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:45.004595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:45.004595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:45.004595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:45.004595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:45.006322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 422/826] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:45.006851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44299484-a7a4-4508-acd5-dd62572f0236 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:45.010319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:45.032243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:45.107824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e622f35-b290-4bd1-be99-28ccb74a74a0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:45.135884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44299484-a7a4-4508-acd5-dd62572f0236 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:45.156677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06513c-dc63-421f-8caf-9d57eb2ce896 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:45.157484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06513c-dc63-421f-8caf-9d57eb2ce896 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:45.157859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06513c-dc63-421f-8caf-9d57eb2ce896 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:45.158229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe06513c-dc63-421f-8caf-9d57eb2ce896 None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/8af010ec8f3841a4b74907b13961e2b3/roles/1020ec02ef4e4735be787d3b7d4a89b5` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:45.174484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c3b36-02e7-4024-93be-a4edc7a5007b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:45.175646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3b36-02e7-4024-93be-a4edc7a5007b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:45.176798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3b36-02e7-4024-93be-a4edc7a5007b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:45.177310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-344c3b36-02e7-4024-93be-a4edc7a5007b None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:45.178187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c3b36-02e7-4024-93be-a4edc7a5007b None admin] RBAC: Adding query filter params (name=network) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:45.178697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c3b36-02e7-4024-93be-a4edc7a5007b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:45.179158 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06513c-dc63-421f-8caf-9d57eb2ce896 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=8af010ec8f3841a4b74907b13961e2b3, role_id=1020ec02ef4e4735be787d3b7d4a89b5)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:45.180578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-344c3b36-02e7-4024-93be-a4edc7a5007b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:45.180829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe06513c-dc63-421f-8caf-9d57eb2ce896 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:45.188715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 423/827] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:13:45 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:45.190249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c3b36-02e7-4024-93be-a4edc7a5007b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:45.198883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 405/828] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:13:44 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/8af010ec8f3841a4b74907b13961e2b3/roles/1020ec02ef4e4735be787d3b7d4a89b5 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:13:45.206193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06513c-dc63-421f-8caf-9d57eb2ce896 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:45.319207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:45.342371 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-344c3b36-02e7-4024-93be-a4edc7a5007b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:45.373805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:45.384552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76658d0-215f-4438-8643-48fcd0fb113f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:45.385240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76658d0-215f-4438-8643-48fcd0fb113f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:45.385663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76658d0-215f-4438-8643-48fcd0fb113f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:45.385941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76658d0-215f-4438-8643-48fcd0fb113f None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:45.386745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76658d0-215f-4438-8643-48fcd0fb113f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:45.386941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76658d0-215f-4438-8643-48fcd0fb113f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:45.388501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76658d0-215f-4438-8643-48fcd0fb113f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:45.404401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe06513c-dc63-421f-8caf-9d57eb2ce896 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:45.411877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 424/829] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:45.418069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76658d0-215f-4438-8643-48fcd0fb113f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:45.504865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135e5cf-339c-4c1f-a520-25323b139fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:45.505493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135e5cf-339c-4c1f-a520-25323b139fae None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:45.505774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135e5cf-339c-4c1f-a520-25323b139fae None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:45.506101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9135e5cf-339c-4c1f-a520-25323b139fae None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:45.506747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135e5cf-339c-4c1f-a520-25323b139fae None admin] RBAC: Adding query filter params (type=network) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:45.507052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135e5cf-339c-4c1f-a520-25323b139fae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:45.508469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9135e5cf-339c-4c1f-a520-25323b139fae None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:45.515849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 406/830] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:13:45 2022] GET /identity/v3/services?type=network => generated 350 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:45.524387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135e5cf-339c-4c1f-a520-25323b139fae None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:45.567150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76658d0-215f-4438-8643-48fcd0fb113f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:45.610786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362b1ea1-57df-46f6-91c5-09d9479f2214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:45.611770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1ea1-57df-46f6-91c5-09d9479f2214 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:45.612295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1ea1-57df-46f6-91c5-09d9479f2214 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:45.612786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362b1ea1-57df-46f6-91c5-09d9479f2214 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:45.613754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1ea1-57df-46f6-91c5-09d9479f2214 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=758be68931aa49e5828bc2c164940571) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:45.614273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1ea1-57df-46f6-91c5-09d9479f2214 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:45.615940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362b1ea1-57df-46f6-91c5-09d9479f2214 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:45.623797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 425/831] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:45 2022] GET /identity/v3/role_assignments?user.id=758be68931aa49e5828bc2c164940571&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 608 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:45.713918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274dfa3-e251-45cb-9f05-31577568191e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:45.714251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274dfa3-e251-45cb-9f05-31577568191e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:45.714469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8274dfa3-e251-45cb-9f05-31577568191e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:45.715973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 426/832] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:13:45.722580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62a190-1e18-4c1e-8159-120cd8eddb6d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:45.723229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62a190-1e18-4c1e-8159-120cd8eddb6d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:45.723721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a62a190-1e18-4c1e-8159-120cd8eddb6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:45.751167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:45.765700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9a62a190-1e18-4c1e-8159-120cd8eddb6d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:45.766919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9a62a190-1e18-4c1e-8159-120cd8eddb6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:45.802988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9135e5cf-339c-4c1f-a520-25323b139fae None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:45.869209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3b8d9-7af1-4afa-a3e0-bd44a63c4197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:45.869749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3b8d9-7af1-4afa-a3e0-bd44a63c4197 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:45.870028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3b8d9-7af1-4afa-a3e0-bd44a63c4197 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:45.870301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82b3b8d9-7af1-4afa-a3e0-bd44a63c4197 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:45.870976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3b8d9-7af1-4afa-a3e0-bd44a63c4197 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:45.872496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82b3b8d9-7af1-4afa-a3e0-bd44a63c4197 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:45.888842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:45.895183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 407/833] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:13:45 2022] POST /identity/v3/endpoints => generated 337 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:13:45.916315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 427/834] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:45 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:13:46.190365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3b8d9-7af1-4afa-a3e0-bd44a63c4197 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:46.296964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82b3b8d9-7af1-4afa-a3e0-bd44a63c4197 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:46.332606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244d251-218b-4742-8461-110a76e8b7b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:46.333244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244d251-218b-4742-8461-110a76e8b7b7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:46.333525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244d251-218b-4742-8461-110a76e8b7b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:46.333799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1244d251-218b-4742-8461-110a76e8b7b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:46.345515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1244d251-218b-4742-8461-110a76e8b7b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1244d251-218b-4742-8461-110a76e8b7b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:46.350648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:46.351595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:46.352777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 408/835] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:46.359916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62a190-1e18-4c1e-8159-120cd8eddb6d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:46.476098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a62a190-1e18-4c1e-8159-120cd8eddb6d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:46.509961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:46.516059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d768c5c-79e0-4869-bc69-2174a519c68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:46.516731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d768c5c-79e0-4869-bc69-2174a519c68a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:46.517013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d768c5c-79e0-4869-bc69-2174a519c68a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:46.517284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d768c5c-79e0-4869-bc69-2174a519c68a None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:46.517950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d768c5c-79e0-4869-bc69-2174a519c68a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:46.518255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d768c5c-79e0-4869-bc69-2174a519c68a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:46.519677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d768c5c-79e0-4869-bc69-2174a519c68a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:46.532257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 428/836] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:13:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:46.535011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244d251-218b-4742-8461-110a76e8b7b7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:46.598760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:46.641547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1244d251-218b-4742-8461-110a76e8b7b7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:46.675939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e112876-7bb7-4ac7-a356-b47314e766aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:46.676609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112876-7bb7-4ac7-a356-b47314e766aa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:46.676888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112876-7bb7-4ac7-a356-b47314e766aa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:46.677163 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e112876-7bb7-4ac7-a356-b47314e766aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:46.688731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e112876-7bb7-4ac7-a356-b47314e766aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:46.690186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e112876-7bb7-4ac7-a356-b47314e766aa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1e112876-7bb7-4ac7-a356-b47314e766aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:46.704851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:46.705830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:46.706730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:46.706730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:46.706730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:46.706730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 409/837] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:46.712343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d768c5c-79e0-4869-bc69-2174a519c68a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:46.825045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d768c5c-79e0-4869-bc69-2174a519c68a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:46.860528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc291bd-ab36-4594-8ac5-c3ffb24c28f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:46.861136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc291bd-ab36-4594-8ac5-c3ffb24c28f7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:46.861410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc291bd-ab36-4594-8ac5-c3ffb24c28f7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:46.861681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcc291bd-ab36-4594-8ac5-c3ffb24c28f7 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:46.862321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc291bd-ab36-4594-8ac5-c3ffb24c28f7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:46.862622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc291bd-ab36-4594-8ac5-c3ffb24c28f7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:46.863977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcc291bd-ab36-4594-8ac5-c3ffb24c28f7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:46.880032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 429/838] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:46.882525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e112876-7bb7-4ac7-a356-b47314e766aa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:46.988701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e112876-7bb7-4ac7-a356-b47314e766aa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:47.001967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:47.025089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a235c9-ca70-4b34-976a-cc1377b7f960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:47.025988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a235c9-ca70-4b34-976a-cc1377b7f960 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.026446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a235c9-ca70-4b34-976a-cc1377b7f960 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.026909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a235c9-ca70-4b34-976a-cc1377b7f960 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:47.034618 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a235c9-ca70-4b34-976a-cc1377b7f960 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:47.036397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a235c9-ca70-4b34-976a-cc1377b7f960 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a9a235c9-ca70-4b34-976a-cc1377b7f960 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:47.048808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:47.050000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:47.051323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:47.051323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:47.051323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:47.051323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:47.051323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:47.051323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:47.051323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:47.051323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:47.051323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Sep 24 14:13:47.051323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:47.058799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 410/839] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:13:46 2022] GET /identity/v3/users/swift => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:47.060389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc291bd-ab36-4594-8ac5-c3ffb24c28f7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:47.118484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:47.169206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcc291bd-ab36-4594-8ac5-c3ffb24c28f7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:47.205000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3670a512-bae9-47c7-a592-2cc768e318ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:47.205608 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670a512-bae9-47c7-a592-2cc768e318ad None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.205885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670a512-bae9-47c7-a592-2cc768e318ad None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.206153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3670a512-bae9-47c7-a592-2cc768e318ad None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:47.206871 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670a512-bae9-47c7-a592-2cc768e318ad None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:47.207176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670a512-bae9-47c7-a592-2cc768e318ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:47.208617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3670a512-bae9-47c7-a592-2cc768e318ad None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:47.226802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 430/840] 10.222.0.16 () {56 vars in 1135 bytes} [Sat Sep 24 14:13:47 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:47.232425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a235c9-ca70-4b34-976a-cc1377b7f960 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:47.261424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd3ab-7bdd-4f8b-b462-24e8a1038f56 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.261732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd3ab-7bdd-4f8b-b462-24e8a1038f56 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.261976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffbd3ab-7bdd-4f8b-b462-24e8a1038f56 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:47.263576 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 431/841] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:13:47.269080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04bd14-c4d0-422e-8648-170dc6d74e80 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.269469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04bd14-c4d0-422e-8648-170dc6d74e80 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.269840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca04bd14-c4d0-422e-8648-170dc6d74e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:47.296729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ca04bd14-c4d0-422e-8648-170dc6d74e80 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:47.297935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ca04bd14-c4d0-422e-8648-170dc6d74e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:47.353236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a235c9-ca70-4b34-976a-cc1377b7f960 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:47.369032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 432/842] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:13:47.394133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda8d21-0ce9-40b2-a7be-36925b65bc97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:47.394744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda8d21-0ce9-40b2-a7be-36925b65bc97 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.395024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda8d21-0ce9-40b2-a7be-36925b65bc97 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.395296 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bda8d21-0ce9-40b2-a7be-36925b65bc97 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:47.439868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:47.469646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda8d21-0ce9-40b2-a7be-36925b65bc97 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:47.471114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bda8d21-0ce9-40b2-a7be-36925b65bc97 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:47.574945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 411/843] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:47 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:13:47.581175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04bd14-c4d0-422e-8648-170dc6d74e80 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:47.632374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:47.646036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda8d21-0ce9-40b2-a7be-36925b65bc97 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:47.698218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca04bd14-c4d0-422e-8648-170dc6d74e80 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:47.719951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:47.751255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42d9bd-78a7-4dd0-b7c1-e633b60a805f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:47.752496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42d9bd-78a7-4dd0-b7c1-e633b60a805f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.752785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42d9bd-78a7-4dd0-b7c1-e633b60a805f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.753064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d42d9bd-78a7-4dd0-b7c1-e633b60a805f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:47.759383 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bda8d21-0ce9-40b2-a7be-36925b65bc97 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:47.767452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42d9bd-78a7-4dd0-b7c1-e633b60a805f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:47.769487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d42d9bd-78a7-4dd0-b7c1-e633b60a805f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4d42d9bd-78a7-4dd0-b7c1-e633b60a805f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:47.788183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:47.789161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:47.790080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:47.790080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:47.790080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:47.792118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 433/844] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:47.798454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42d9bd-78a7-4dd0-b7c1-e633b60a805f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:47.805356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073236-9900-4de2-ba62-e5474c40007e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:47.806014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073236-9900-4de2-ba62-e5474c40007e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.806287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073236-9900-4de2-ba62-e5474c40007e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.806557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf073236-9900-4de2-ba62-e5474c40007e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:47.807137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf073236-9900-4de2-ba62-e5474c40007e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:47.808532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf073236-9900-4de2-ba62-e5474c40007e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-bf073236-9900-4de2-ba62-e5474c40007e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:47.818100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:47.820060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 14:13:47.821573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:47.824251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 412/845] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:47 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:47.825584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073236-9900-4de2-ba62-e5474c40007e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:47.910121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:47.917475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d42d9bd-78a7-4dd0-b7c1-e633b60a805f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:47.932944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf073236-9900-4de2-ba62-e5474c40007e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:47.953455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ab2ed1-a981-4cae-83b4-164fb5440972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:47.954054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab2ed1-a981-4cae-83b4-164fb5440972 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.954327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab2ed1-a981-4cae-83b4-164fb5440972 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.954593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ab2ed1-a981-4cae-83b4-164fb5440972 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:47.955227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab2ed1-a981-4cae-83b4-164fb5440972 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:47.955520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab2ed1-a981-4cae-83b4-164fb5440972 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:47.956889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ab2ed1-a981-4cae-83b4-164fb5440972 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:47.966433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738da0af-b83c-41e1-8724-3a4c2bf2160e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:47.967041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da0af-b83c-41e1-8724-3a4c2bf2160e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.967319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da0af-b83c-41e1-8724-3a4c2bf2160e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.967595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738da0af-b83c-41e1-8724-3a4c2bf2160e None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:47.968789 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da0af-b83c-41e1-8724-3a4c2bf2160e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:47.969094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da0af-b83c-41e1-8724-3a4c2bf2160e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:47.970455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738da0af-b83c-41e1-8724-3a4c2bf2160e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:47.971610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 434/846] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:47.972999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9bffe-5cf2-434e-b5b3-3df7951b831c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.973448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9bffe-5cf2-434e-b5b3-3df7951b831c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.973862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9bffe-5cf2-434e-b5b3-3df7951b831c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:47.975444 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 435/847] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:47.976872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:47.978026 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9bffe-5cf2-434e-b5b3-3df7951b831c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:47.988349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 413/848] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:47 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:47.989586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0e959-3d3b-4e5a-b35f-7ea1b3bfb8b5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:47.989871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0e959-3d3b-4e5a-b35f-7ea1b3bfb8b5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:47.990143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c0e959-3d3b-4e5a-b35f-7ea1b3bfb8b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.010149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-19c0e959-3d3b-4e5a-b35f-7ea1b3bfb8b5 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:48.011802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-19c0e959-3d3b-4e5a-b35f-7ea1b3bfb8b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:48.085998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 414/849] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:47 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:48.086867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0e959-3d3b-4e5a-b35f-7ea1b3bfb8b5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:48.102662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9bffe-5cf2-434e-b5b3-3df7951b831c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:48.149880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8209c290-e38b-453b-8774-c35569486702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:48.151137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209c290-e38b-453b-8774-c35569486702 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:48.152043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209c290-e38b-453b-8774-c35569486702 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:48.152710 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8209c290-e38b-453b-8774-c35569486702 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.162570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209c290-e38b-453b-8774-c35569486702 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:48.165145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8209c290-e38b-453b-8774-c35569486702 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8209c290-e38b-453b-8774-c35569486702 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:48.183336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:48.184329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:48.185262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:48.185262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:48.185262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:48.185262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:48.185262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:48.185262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:48.185262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:48.185262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:48.185262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 436/850] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:48.188189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92282e4c-5a92-4435-85c2-40dfd8740c5f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:48.188189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92282e4c-5a92-4435-85c2-40dfd8740c5f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:48.188189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92282e4c-5a92-4435-85c2-40dfd8740c5f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.189917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 437/851] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:48.190906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92282e4c-5a92-4435-85c2-40dfd8740c5f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:48.200619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c0e959-3d3b-4e5a-b35f-7ea1b3bfb8b5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:48.209921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:48.233976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:48.241681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38182f6-e8a9-4f82-b028-2163517b9623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:48.242289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38182f6-e8a9-4f82-b028-2163517b9623 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:48.242576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38182f6-e8a9-4f82-b028-2163517b9623 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:48.242850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38182f6-e8a9-4f82-b028-2163517b9623 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.243478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38182f6-e8a9-4f82-b028-2163517b9623 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:48.243778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38182f6-e8a9-4f82-b028-2163517b9623 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:48.245186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38182f6-e8a9-4f82-b028-2163517b9623 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:48.250591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 415/852] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:48 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:48.253748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432204-9ecf-44c5-9fff-123f88ccbf1f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:48.254539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432204-9ecf-44c5-9fff-123f88ccbf1f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:48.255519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd432204-9ecf-44c5-9fff-123f88ccbf1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.283022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fd432204-9ecf-44c5-9fff-123f88ccbf1f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:48.285562 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fd432204-9ecf-44c5-9fff-123f88ccbf1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:48.310079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92282e4c-5a92-4435-85c2-40dfd8740c5f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:48.354086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc95a55-9d08-43b4-8c5a-3fb04bf75a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:48.354754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc95a55-9d08-43b4-8c5a-3fb04bf75a9c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:48.355040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc95a55-9d08-43b4-8c5a-3fb04bf75a9c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:48.355316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc95a55-9d08-43b4-8c5a-3fb04bf75a9c None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.356022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc95a55-9d08-43b4-8c5a-3fb04bf75a9c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:48.356457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc95a55-9d08-43b4-8c5a-3fb04bf75a9c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:48.357920 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cc95a55-9d08-43b4-8c5a-3fb04bf75a9c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:48.372094 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 438/853] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:48.373111 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc95a55-9d08-43b4-8c5a-3fb04bf75a9c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:48.387897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 416/854] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:48 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:48.389144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432204-9ecf-44c5-9fff-123f88ccbf1f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:48.480376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:48.508345 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd432204-9ecf-44c5-9fff-123f88ccbf1f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:48.516125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc95a55-9d08-43b4-8c5a-3fb04bf75a9c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:48.534650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:48.548024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e7a7-3528-4b02-9d02-61e0658318f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:48.548785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e7a7-3528-4b02-9d02-61e0658318f4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:48.549159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e7a7-3528-4b02-9d02-61e0658318f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:48.549444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4275e7a7-3528-4b02-9d02-61e0658318f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.550266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275e7a7-3528-4b02-9d02-61e0658318f4 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=100d19cd9f1742b7ae913376eb75bbd9) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:48.550658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275e7a7-3528-4b02-9d02-61e0658318f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:48.552441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4275e7a7-3528-4b02-9d02-61e0658318f4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:48.558451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 417/855] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:48 2022] GET /identity/v3/role_assignments?user.id=100d19cd9f1742b7ae913376eb75bbd9&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:48.565435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485905a4-3517-49d1-a221-e51c64d201e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:48.566370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485905a4-3517-49d1-a221-e51c64d201e0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:48.566840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485905a4-3517-49d1-a221-e51c64d201e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:48.567291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485905a4-3517-49d1-a221-e51c64d201e0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.580377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485905a4-3517-49d1-a221-e51c64d201e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-485905a4-3517-49d1-a221-e51c64d201e0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:48.586270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:48.587305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:13:48.588203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:48.589700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 439/856] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:13:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:48.596456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e7a7-3528-4b02-9d02-61e0658318f4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:48.674797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485905a4-3517-49d1-a221-e51c64d201e0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:48.712690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4275e7a7-3528-4b02-9d02-61e0658318f4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:48.761642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0b75d-e98d-4b63-ac20-e30f2b684927 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:48.762271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0b75d-e98d-4b63-ac20-e30f2b684927 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:48.762550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0b75d-e98d-4b63-ac20-e30f2b684927 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:48.762835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c0b75d-e98d-4b63-ac20-e30f2b684927 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.764227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0b75d-e98d-4b63-ac20-e30f2b684927 None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:48.764638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0b75d-e98d-4b63-ac20-e30f2b684927 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:48.766540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3c0b75d-e98d-4b63-ac20-e30f2b684927 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:48.779491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 418/857] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:13:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:48.785791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0b75d-e98d-4b63-ac20-e30f2b684927 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:48.792895 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485905a4-3517-49d1-a221-e51c64d201e0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:48.836269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c9918-ef8b-4976-a961-255d6b36e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:48.837684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c9918-ef8b-4976-a961-255d6b36e4bf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:48.837976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c9918-ef8b-4976-a961-255d6b36e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:48.838256 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37c9918-ef8b-4976-a961-255d6b36e4bf None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.838908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c9918-ef8b-4976-a961-255d6b36e4bf None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:48.840635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37c9918-ef8b-4976-a961-255d6b36e4bf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:48.843424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:48.850529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a37c9918-ef8b-4976-a961-255d6b36e4bf None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:48.851341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:48.852566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 14:13:48.853592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:48.857122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 440/858] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Sep 24 14:13:48 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:48.862829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c9918-ef8b-4976-a961-255d6b36e4bf None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:48.918264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3c0b75d-e98d-4b63-ac20-e30f2b684927 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:48.959011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4747243-c896-46e7-89f7-4d86067e37c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:48.959683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4747243-c896-46e7-89f7-4d86067e37c4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:48.959964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4747243-c896-46e7-89f7-4d86067e37c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:48.960289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4747243-c896-46e7-89f7-4d86067e37c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:48.971932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4747243-c896-46e7-89f7-4d86067e37c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:48.973406 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4747243-c896-46e7-89f7-4d86067e37c4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:48.986071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37c9918-ef8b-4976-a961-255d6b36e4bf None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a4747243-c896-46e7-89f7-4d86067e37c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:48.988617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:48.989577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:48.990464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:48.990464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:48.990464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:48.990464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 419/859] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:48.995178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4747243-c896-46e7-89f7-4d86067e37c4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:49.027478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fd959-742b-4e00-8ee1-473f6778b6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:49.028455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd959-742b-4e00-8ee1-473f6778b6ba None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:49.028935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd959-742b-4e00-8ee1-473f6778b6ba None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:49.029476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890fd959-742b-4e00-8ee1-473f6778b6ba None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:49.030386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fd959-742b-4e00-8ee1-473f6778b6ba None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:49.030884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fd959-742b-4e00-8ee1-473f6778b6ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:49.032690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890fd959-742b-4e00-8ee1-473f6778b6ba None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:49.038539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 441/860] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:13:48 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:49.047126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fd959-742b-4e00-8ee1-473f6778b6ba None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:49.112393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4747243-c896-46e7-89f7-4d86067e37c4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:49.114615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:49.119736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:49.154187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8f5b8-5257-4c6c-9a6c-ebba90257891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:49.155474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8f5b8-5257-4c6c-9a6c-ebba90257891 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:49.155925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8f5b8-5257-4c6c-9a6c-ebba90257891 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:49.156395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f8f5b8-5257-4c6c-9a6c-ebba90257891 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:49.157401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8f5b8-5257-4c6c-9a6c-ebba90257891 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:49.158338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8f5b8-5257-4c6c-9a6c-ebba90257891 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:49.160430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f8f5b8-5257-4c6c-9a6c-ebba90257891 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:49.167396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890fd959-742b-4e00-8ee1-473f6778b6ba None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:49.178474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 420/861] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:49.184759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8f5b8-5257-4c6c-9a6c-ebba90257891 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:49.218117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c22e75-c6d8-4753-908e-440ed4236471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:49.218748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c22e75-c6d8-4753-908e-440ed4236471 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:49.219038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c22e75-c6d8-4753-908e-440ed4236471 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:49.219317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c22e75-c6d8-4753-908e-440ed4236471 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:49.220322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c22e75-c6d8-4753-908e-440ed4236471 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:49.220663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c22e75-c6d8-4753-908e-440ed4236471 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:49.222208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c22e75-c6d8-4753-908e-440ed4236471 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:49.229804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 442/862] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:13:49 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:49.305181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f8f5b8-5257-4c6c-9a6c-ebba90257891 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:49.344937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d06fe-3bf3-461c-9ff9-49fc8b862eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:49.345921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d06fe-3bf3-461c-9ff9-49fc8b862eec None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:49.346397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d06fe-3bf3-461c-9ff9-49fc8b862eec None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:49.346850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5d06fe-3bf3-461c-9ff9-49fc8b862eec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:49.355433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d06fe-3bf3-461c-9ff9-49fc8b862eec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:49.357381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5d06fe-3bf3-461c-9ff9-49fc8b862eec None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3e5d06fe-3bf3-461c-9ff9-49fc8b862eec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:49.370909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:49.371985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:49.372998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:49.372998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:49.372998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:49.372998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:49.372998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:49.372998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:49.372998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:49.372998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:49.372998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:13:49.372998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:49.375984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 421/863] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 24 14:13:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:49.381539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c22e75-c6d8-4753-908e-440ed4236471 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:49.493218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c22e75-c6d8-4753-908e-440ed4236471 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:49.520832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:49.531118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebbabf-5513-4da5-b70c-bfcef6f96638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:49.531941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebbabf-5513-4da5-b70c-bfcef6f96638 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:49.532402 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebbabf-5513-4da5-b70c-bfcef6f96638 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:49.532823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebbabf-5513-4da5-b70c-bfcef6f96638 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:49.533700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebbabf-5513-4da5-b70c-bfcef6f96638 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:49.534180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebbabf-5513-4da5-b70c-bfcef6f96638 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:49.535839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebbabf-5513-4da5-b70c-bfcef6f96638 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:49.554334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 443/864] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 24 14:13:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:49.559776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d06fe-3bf3-461c-9ff9-49fc8b862eec None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:49.585283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:49.667937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5d06fe-3bf3-461c-9ff9-49fc8b862eec None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:49.703373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f860d-0599-4b6e-bfd8-cf86121f633d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:49.703976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f860d-0599-4b6e-bfd8-cf86121f633d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:49.704281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f860d-0599-4b6e-bfd8-cf86121f633d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:49.704555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2f860d-0599-4b6e-bfd8-cf86121f633d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:49.780917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f860d-0599-4b6e-bfd8-cf86121f633d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:49.782678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2f860d-0599-4b6e-bfd8-cf86121f633d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:49.806441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:49.884029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 422/865] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:49 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:13:49.889265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebbabf-5513-4da5-b70c-bfcef6f96638 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:49.993753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebbabf-5513-4da5-b70c-bfcef6f96638 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:50.029968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad7f9f-365e-4638-9664-2225899055ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:50.031185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad7f9f-365e-4638-9664-2225899055ae None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:50.031468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad7f9f-365e-4638-9664-2225899055ae None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:50.031742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ad7f9f-365e-4638-9664-2225899055ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:50.042592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad7f9f-365e-4638-9664-2225899055ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:50.044038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ad7f9f-365e-4638-9664-2225899055ae None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-90ad7f9f-365e-4638-9664-2225899055ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:50.059202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:50.060223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:50.061974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:50.061974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:50.061974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:50.061974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 444/866] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:50.069363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f860d-0599-4b6e-bfd8-cf86121f633d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:50.182773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2f860d-0599-4b6e-bfd8-cf86121f633d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:50.207939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:50.222108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e120-b2dd-4031-8658-a77d1e94bd81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:50.222727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e120-b2dd-4031-8658-a77d1e94bd81 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:50.223008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e120-b2dd-4031-8658-a77d1e94bd81 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:50.223280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b216e120-b2dd-4031-8658-a77d1e94bd81 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:50.223928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216e120-b2dd-4031-8658-a77d1e94bd81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:50.224515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216e120-b2dd-4031-8658-a77d1e94bd81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:50.225899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b216e120-b2dd-4031-8658-a77d1e94bd81 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:50.238406 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 423/867] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:50.243623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad7f9f-365e-4638-9664-2225899055ae None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:50.278840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:50.345681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ad7f9f-365e-4638-9664-2225899055ae None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:50.379661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9b91c-a4b3-4ecf-bb12-5e7b43c3d31a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:50.380318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9b91c-a4b3-4ecf-bb12-5e7b43c3d31a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:50.380655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9b91c-a4b3-4ecf-bb12-5e7b43c3d31a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:50.380927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9b91c-a4b3-4ecf-bb12-5e7b43c3d31a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:50.387665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9b91c-a4b3-4ecf-bb12-5e7b43c3d31a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:50.389123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9b91c-a4b3-4ecf-bb12-5e7b43c3d31a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4be9b91c-a4b3-4ecf-bb12-5e7b43c3d31a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:50.404764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:50.405813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:50.407318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:50.407318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:50.407318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:50.407318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:50.407318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:50.407318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:50.407318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:50.407318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:50.407318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 445/868] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:50 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:50.411924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e120-b2dd-4031-8658-a77d1e94bd81 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:50.527587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b216e120-b2dd-4031-8658-a77d1e94bd81 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:50.536029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338d761-2aac-4abc-bbcd-0774eed66f2a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:50.536622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338d761-2aac-4abc-bbcd-0774eed66f2a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:50.537131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338d761-2aac-4abc-bbcd-0774eed66f2a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:50.540026 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 446/869] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:50.544259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936f742-a3ce-4711-ace8-dd490c0e65ca None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:50.544763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936f742-a3ce-4711-ace8-dd490c0e65ca None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:50.545236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c936f742-a3ce-4711-ace8-dd490c0e65ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:50.563219 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483b994-90a6-43b1-9d1f-db7662c7b0c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:50.563829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b994-90a6-43b1-9d1f-db7662c7b0c6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:50.564111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b994-90a6-43b1-9d1f-db7662c7b0c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:50.564415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b483b994-90a6-43b1-9d1f-db7662c7b0c6 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:50.565107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483b994-90a6-43b1-9d1f-db7662c7b0c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:50.565417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483b994-90a6-43b1-9d1f-db7662c7b0c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:50.566935 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b483b994-90a6-43b1-9d1f-db7662c7b0c6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:50.567197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c936f742-a3ce-4711-ace8-dd490c0e65ca None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:50.568802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c936f742-a3ce-4711-ace8-dd490c0e65ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:50.581290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 424/870] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:50 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:50.587708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483b994-90a6-43b1-9d1f-db7662c7b0c6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:50.656179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:50.656373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 447/871] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:50.700527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b483b994-90a6-43b1-9d1f-db7662c7b0c6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:50.736254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11b131c-8678-4d3e-82e6-43d6a03b032a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:50.736777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b131c-8678-4d3e-82e6-43d6a03b032a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:50.737053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b131c-8678-4d3e-82e6-43d6a03b032a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:50.737373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11b131c-8678-4d3e-82e6-43d6a03b032a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:50.738092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b131c-8678-4d3e-82e6-43d6a03b032a None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=8af010ec8f3841a4b74907b13961e2b3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:50.738436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b131c-8678-4d3e-82e6-43d6a03b032a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:50.739860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11b131c-8678-4d3e-82e6-43d6a03b032a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:50.745966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 425/872] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:50 2022] GET /identity/v3/role_assignments?user.id=8af010ec8f3841a4b74907b13961e2b3&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 608 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:50.937484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936f742-a3ce-4711-ace8-dd490c0e65ca None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:50.966235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:50.982217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72a520-b22a-4415-b082-ed90216ecd06 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:50.982509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72a520-b22a-4415-b082-ed90216ecd06 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:50.982768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e72a520-b22a-4415-b082-ed90216ecd06 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:50.984410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 426/873] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:13:50.989662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66718-bfc8-4de0-b0db-054ba20cbb5a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:50.989866 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66718-bfc8-4de0-b0db-054ba20cbb5a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:50.990114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f66718-bfc8-4de0-b0db-054ba20cbb5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:51.009622 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-53f66718-bfc8-4de0-b0db-054ba20cbb5a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:51.010801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-53f66718-bfc8-4de0-b0db-054ba20cbb5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:51.052393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c936f742-a3ce-4711-ace8-dd490c0e65ca None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:51.093257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f86f1-92fc-405e-bf50-64e9dbee05e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:51.093865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f86f1-92fc-405e-bf50-64e9dbee05e5 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:51.094145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f86f1-92fc-405e-bf50-64e9dbee05e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:51.094419 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28f86f1-92fc-405e-bf50-64e9dbee05e5 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:51.095091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f86f1-92fc-405e-bf50-64e9dbee05e5 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:51.096259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 427/874] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:50 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:51.096483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28f86f1-92fc-405e-bf50-64e9dbee05e5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:51.117455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 448/875] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:13:50 2022] POST /identity/v3/services => generated 251 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:51.374844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f66718-bfc8-4de0-b0db-054ba20cbb5a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:51.410975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:51.485016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f66718-bfc8-4de0-b0db-054ba20cbb5a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:51.527064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1a106-1466-42a6-acc8-72c7d8b89953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:51.527700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1a106-1466-42a6-acc8-72c7d8b89953 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:51.527980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1a106-1466-42a6-acc8-72c7d8b89953 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:51.528277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1a106-1466-42a6-acc8-72c7d8b89953 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:51.529006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1a106-1466-42a6-acc8-72c7d8b89953 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:51.530923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d1a106-1466-42a6-acc8-72c7d8b89953 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-38d1a106-1466-42a6-acc8-72c7d8b89953 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:51.540002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:51.541018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:51.541872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 428/876] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:13:51 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:51.549245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f86f1-92fc-405e-bf50-64e9dbee05e5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:51.580008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d871d-5326-4eac-b7d4-76fc282ab33c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:51.580353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d871d-5326-4eac-b7d4-76fc282ab33c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:51.580585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8d871d-5326-4eac-b7d4-76fc282ab33c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:51.582028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 429/877] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:13:51.587188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9cda-d997-468d-b91c-fd4dd8a3d837 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:51.587714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9cda-d997-468d-b91c-fd4dd8a3d837 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:51.588210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde9cda-d997-468d-b91c-fd4dd8a3d837 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:51.607159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0dde9cda-d997-468d-b91c-fd4dd8a3d837 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:51.609257 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0dde9cda-d997-468d-b91c-fd4dd8a3d837 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:51.648417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:51.673335 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28f86f1-92fc-405e-bf50-64e9dbee05e5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:51.696518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 430/878] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:51 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:13:51.710165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e892355-cf4a-490d-ac2d-29994766376c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:51.710774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e892355-cf4a-490d-ac2d-29994766376c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:51.711052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e892355-cf4a-490d-ac2d-29994766376c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:51.711326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e892355-cf4a-490d-ac2d-29994766376c None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:51.711960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e892355-cf4a-490d-ac2d-29994766376c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:51.712341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e892355-cf4a-490d-ac2d-29994766376c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:51.713798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e892355-cf4a-490d-ac2d-29994766376c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:51.719010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 449/879] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 24 14:13:51 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:51.724971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9cda-d997-468d-b91c-fd4dd8a3d837 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:51.753247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:51.835064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde9cda-d997-468d-b91c-fd4dd8a3d837 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:51.870195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61127147-46ad-4040-887e-4ab7717ca811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:51.871145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61127147-46ad-4040-887e-4ab7717ca811 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:51.871634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61127147-46ad-4040-887e-4ab7717ca811 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:51.872102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61127147-46ad-4040-887e-4ab7717ca811 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:51.872945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61127147-46ad-4040-887e-4ab7717ca811 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:51.873457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61127147-46ad-4040-887e-4ab7717ca811 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:51.875549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61127147-46ad-4040-887e-4ab7717ca811 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:51.880783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 431/880] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 24 14:13:51 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:51.987721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e892355-cf4a-490d-ac2d-29994766376c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:52.097215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e892355-cf4a-490d-ac2d-29994766376c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:52.132953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f41f2f2-04d3-4823-bd37-cb1aeec5d9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:52.133563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41f2f2-04d3-4823-bd37-cb1aeec5d9c4 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:52.133845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41f2f2-04d3-4823-bd37-cb1aeec5d9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:52.134121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f41f2f2-04d3-4823-bd37-cb1aeec5d9c4 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:52.134778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41f2f2-04d3-4823-bd37-cb1aeec5d9c4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:52.136134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f41f2f2-04d3-4823-bd37-cb1aeec5d9c4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:52.155058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 450/881] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:13:51 2022] POST /identity/v3/services => generated 269 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:53.109220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51af4-7899-4f58-9f92-6d8f8b62530f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:53.110181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51af4-7899-4f58-9f92-6d8f8b62530f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:53.110659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb51af4-7899-4f58-9f92-6d8f8b62530f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:53.112482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 432/882] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:53.118004 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc83f-472b-4ebf-a988-9109f22a9d52 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:53.118827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc83f-472b-4ebf-a988-9109f22a9d52 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:53.119318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ddc83f-472b-4ebf-a988-9109f22a9d52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:53.138700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b5ddc83f-472b-4ebf-a988-9109f22a9d52 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:53.140280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b5ddc83f-472b-4ebf-a988-9109f22a9d52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:53.143399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:53.220658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 451/883] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:53.385491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0ccb-9e1f-454c-b060-9e67b40bc505 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:53.386140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0ccb-9e1f-454c-b060-9e67b40bc505 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:53.386630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddad0ccb-9e1f-454c-b060-9e67b40bc505 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:53.388422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 433/884] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:53.393892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0c0f5-cdde-4d8b-b02e-6f406773e7b6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:53.394424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0c0f5-cdde-4d8b-b02e-6f406773e7b6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:53.394915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff0c0f5-cdde-4d8b-b02e-6f406773e7b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:53.413607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9ff0c0f5-cdde-4d8b-b02e-6f406773e7b6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:53.415119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9ff0c0f5-cdde-4d8b-b02e-6f406773e7b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:53.488185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 452/885] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:53 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:53.504396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0ccb-9e1f-454c-b060-9e67b40bc505 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:53.600791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:53.610159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddad0ccb-9e1f-454c-b060-9e67b40bc505 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:53.645033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f001654-cc66-489d-8add-728e4d806ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:53.645593 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f001654-cc66-489d-8add-728e4d806ab6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:53.645870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f001654-cc66-489d-8add-728e4d806ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:53.646143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f001654-cc66-489d-8add-728e4d806ab6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:53.656516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f001654-cc66-489d-8add-728e4d806ab6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8f001654-cc66-489d-8add-728e4d806ab6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:53.661411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:53.662431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:13:53.663364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:53.667429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 434/886] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 24 14:13:53 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:53.668859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0c0f5-cdde-4d8b-b02e-6f406773e7b6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:53.741267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:53.777953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff0c0f5-cdde-4d8b-b02e-6f406773e7b6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:53.794057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f001654-cc66-489d-8add-728e4d806ab6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:53.815608 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d571-e5ae-48af-adf6-6b65fbc134e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:53.816236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d571-e5ae-48af-adf6-6b65fbc134e5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:53.816519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d571-e5ae-48af-adf6-6b65fbc134e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:53.816791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0485d571-e5ae-48af-adf6-6b65fbc134e5 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:53.817451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d571-e5ae-48af-adf6-6b65fbc134e5 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:53.817755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d571-e5ae-48af-adf6-6b65fbc134e5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:53.819182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0485d571-e5ae-48af-adf6-6b65fbc134e5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:53.833212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 453/887] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 24 14:13:53 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:53.834473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d571-e5ae-48af-adf6-6b65fbc134e5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:53.920666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f001654-cc66-489d-8add-728e4d806ab6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:53.958029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0485d571-e5ae-48af-adf6-6b65fbc134e5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:53.964984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08da8c-aa9f-4bd5-bcfc-b5c195b7e87a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:53.965835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08da8c-aa9f-4bd5-bcfc-b5c195b7e87a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:53.966278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08da8c-aa9f-4bd5-bcfc-b5c195b7e87a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:53.966773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa08da8c-aa9f-4bd5-bcfc-b5c195b7e87a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:53.968283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08da8c-aa9f-4bd5-bcfc-b5c195b7e87a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:53.970383 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa08da8c-aa9f-4bd5-bcfc-b5c195b7e87a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-aa08da8c-aa9f-4bd5-bcfc-b5c195b7e87a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:53.983930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:53.985286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 14:13:53.986342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:53.989733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 435/888] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:53 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:53.995879 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:54.005756 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc9fcd-6b90-42f7-800b-8275fb0bfda5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:54.006415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc9fcd-6b90-42f7-800b-8275fb0bfda5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.006665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08da8c-aa9f-4bd5-bcfc-b5c195b7e87a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:54.006778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc9fcd-6b90-42f7-800b-8275fb0bfda5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.006950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc9fcd-6b90-42f7-800b-8275fb0bfda5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.022024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc9fcd-6b90-42f7-800b-8275fb0bfda5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:54.024805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc9fcd-6b90-42f7-800b-8275fb0bfda5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:54.028588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-42bc9fcd-6b90-42f7-800b-8275fb0bfda5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:54.045168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:54.046786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:54.047720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:54.047720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:54.047720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:54.054888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 454/889] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:54.056956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc9fcd-6b90-42f7-800b-8275fb0bfda5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:54.134861 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa08da8c-aa9f-4bd5-bcfc-b5c195b7e87a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:54.172557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-008fa6b3-c1b1-4d97-995d-d51e647aff0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:54.173075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa6b3-c1b1-4d97-995d-d51e647aff0f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.173350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa6b3-c1b1-4d97-995d-d51e647aff0f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.173595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc9fcd-6b90-42f7-800b-8275fb0bfda5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:54.174036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-008fa6b3-c1b1-4d97-995d-d51e647aff0f None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.174227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fa6b3-c1b1-4d97-995d-d51e647aff0f None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:54.174526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fa6b3-c1b1-4d97-995d-d51e647aff0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:54.175879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-008fa6b3-c1b1-4d97-995d-d51e647aff0f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:54.181161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 436/890] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:54 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:54.182600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69697bb-6b14-4065-91af-b04e6c5eee18 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.183023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69697bb-6b14-4065-91af-b04e6c5eee18 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.183297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69697bb-6b14-4065-91af-b04e6c5eee18 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.184502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 437/891] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:54.187570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69697bb-6b14-4065-91af-b04e6c5eee18 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:54.214678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84747314-f9ff-444e-b0ca-cb56a6a673e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:54.215318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84747314-f9ff-444e-b0ca-cb56a6a673e2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.215600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84747314-f9ff-444e-b0ca-cb56a6a673e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.215876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84747314-f9ff-444e-b0ca-cb56a6a673e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.216726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84747314-f9ff-444e-b0ca-cb56a6a673e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:54.217040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84747314-f9ff-444e-b0ca-cb56a6a673e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:54.219043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84747314-f9ff-444e-b0ca-cb56a6a673e2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:54.238068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 455/892] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:54.238068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a7e3-b150-44a5-a9fb-f1c678b8347c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.238068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a7e3-b150-44a5-a9fb-f1c678b8347c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.238068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f9a7e3-b150-44a5-a9fb-f1c678b8347c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.255781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-87f9a7e3-b150-44a5-a9fb-f1c678b8347c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:54.257305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-87f9a7e3-b150-44a5-a9fb-f1c678b8347c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:54.273372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:54.294324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:54.302334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69697bb-6b14-4065-91af-b04e6c5eee18 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:54.348191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 456/893] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:54.348191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9a7e3-b150-44a5-a9fb-f1c678b8347c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:54.350960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47692f23-cb81-41eb-84de-f9ecb9b373a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:54.351693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47692f23-cb81-41eb-84de-f9ecb9b373a4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.352076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47692f23-cb81-41eb-84de-f9ecb9b373a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.352501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47692f23-cb81-41eb-84de-f9ecb9b373a4 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.353247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47692f23-cb81-41eb-84de-f9ecb9b373a4 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:54.353611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47692f23-cb81-41eb-84de-f9ecb9b373a4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:54.355255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47692f23-cb81-41eb-84de-f9ecb9b373a4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:54.366140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 438/894] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:54 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:54.367613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47692f23-cb81-41eb-84de-f9ecb9b373a4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:54.454215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f9a7e3-b150-44a5-a9fb-f1c678b8347c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:54.481800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47692f23-cb81-41eb-84de-f9ecb9b373a4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:54.495754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba4a7a2-24bb-4cf7-b1cd-e8245a1229cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:54.496417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4a7a2-24bb-4cf7-b1cd-e8245a1229cd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.496703 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4a7a2-24bb-4cf7-b1cd-e8245a1229cd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.496979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba4a7a2-24bb-4cf7-b1cd-e8245a1229cd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.504657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4a7a2-24bb-4cf7-b1cd-e8245a1229cd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:54.506104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba4a7a2-24bb-4cf7-b1cd-e8245a1229cd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:54.518072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20906e9-c4ea-447f-8e90-5fce7ad8a6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-cba4a7a2-24bb-4cf7-b1cd-e8245a1229cd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:54.518227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:54.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:54.520704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:54.520704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:54.520704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:54.520704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:54.520704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:54.520704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:54.520704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:54.520704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:54.520704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:13:54.520704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:54.521268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20906e9-c4ea-447f-8e90-5fce7ad8a6ad None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.521268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20906e9-c4ea-447f-8e90-5fce7ad8a6ad None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.521412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 457/895] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 24 14:13:54 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:54.521412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038436e2-a8cb-4dee-8029-49f83bb4be3e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.521412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038436e2-a8cb-4dee-8029-49f83bb4be3e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.521412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038436e2-a8cb-4dee-8029-49f83bb4be3e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.524055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20906e9-c4ea-447f-8e90-5fce7ad8a6ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.524811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20906e9-c4ea-447f-8e90-5fce7ad8a6ad None admin] RBAC: Adding query filter params (interface=public, service_id=2d4216beb69e4ea4981cd1c4d6a4aeea, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:54.525129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20906e9-c4ea-447f-8e90-5fce7ad8a6ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:54.526661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 458/896] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:54 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:54.526823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20906e9-c4ea-447f-8e90-5fce7ad8a6ad None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:54.527418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038436e2-a8cb-4dee-8029-49f83bb4be3e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:54.536830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 439/897] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 24 14:13:54 2022] GET /identity/v3/endpoints?service_id=2d4216beb69e4ea4981cd1c4d6a4aeea&interface=public®ion_id=RegionOne => generated 194 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:54.536830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe6165-8221-4a80-b65c-582cb12ec1b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.536830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe6165-8221-4a80-b65c-582cb12ec1b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.536830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbe6165-8221-4a80-b65c-582cb12ec1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.547737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:54.553500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-acbe6165-8221-4a80-b65c-582cb12ec1b3 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:54.555354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-acbe6165-8221-4a80-b65c-582cb12ec1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:54.559207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:54.623315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 440/898] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:54 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:54.628335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe6165-8221-4a80-b65c-582cb12ec1b3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:54.640835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038436e2-a8cb-4dee-8029-49f83bb4be3e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:54.675032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ff4e2-6cba-4b90-abf6-a58d5cfdfe50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:54.675632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ff4e2-6cba-4b90-abf6-a58d5cfdfe50 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.675907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ff4e2-6cba-4b90-abf6-a58d5cfdfe50 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.676194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ff4e2-6cba-4b90-abf6-a58d5cfdfe50 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.677070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ff4e2-6cba-4b90-abf6-a58d5cfdfe50 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:54.677552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ff4e2-6cba-4b90-abf6-a58d5cfdfe50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:54.679099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ff4e2-6cba-4b90-abf6-a58d5cfdfe50 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:54.701370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 459/899] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 24 14:13:54 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:54.701370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ff4e2-6cba-4b90-abf6-a58d5cfdfe50 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:54.734011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbe6165-8221-4a80-b65c-582cb12ec1b3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:54.767208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3432c-2383-455e-9d27-beeec47a6ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:54.767807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3432c-2383-455e-9d27-beeec47a6ff7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.768080 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3432c-2383-455e-9d27-beeec47a6ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.768373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa3432c-2383-455e-9d27-beeec47a6ff7 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.768970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3432c-2383-455e-9d27-beeec47a6ff7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:54.770320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa3432c-2383-455e-9d27-beeec47a6ff7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:54.772018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:54.784202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 441/900] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 24 14:13:54 2022] GET /identity/v3/services => generated 1268 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:13:54.784202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3432c-2383-455e-9d27-beeec47a6ff7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:54.801479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:54.818749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ff4e2-6cba-4b90-abf6-a58d5cfdfe50 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:54.860462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9dc64-1e70-41f0-8a9b-e8b1203c252e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:54.861195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9dc64-1e70-41f0-8a9b-e8b1203c252e None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.861547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9dc64-1e70-41f0-8a9b-e8b1203c252e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.861939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e9dc64-1e70-41f0-8a9b-e8b1203c252e None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:54.862673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9dc64-1e70-41f0-8a9b-e8b1203c252e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:54.864287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e9dc64-1e70-41f0-8a9b-e8b1203c252e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:54.884999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 460/901] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:13:54 2022] POST /identity/v3/services => generated 241 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:54.902430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9dc64-1e70-41f0-8a9b-e8b1203c252e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:54.906034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa3432c-2383-455e-9d27-beeec47a6ff7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:54.952805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc97d4-da8f-4a4d-82db-fca935ee9f27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:54.953431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc97d4-da8f-4a4d-82db-fca935ee9f27 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:54.953711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc97d4-da8f-4a4d-82db-fca935ee9f27 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:54.953986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bc97d4-da8f-4a4d-82db-fca935ee9f27 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:55.027582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e9dc64-1e70-41f0-8a9b-e8b1203c252e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:55.028672 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:55.040780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc97d4-da8f-4a4d-82db-fca935ee9f27 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:55.042594 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7bc97d4-da8f-4a4d-82db-fca935ee9f27 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:55.072807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126dc2d-c805-4e59-bd28-f11a1b865726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:55.073445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126dc2d-c805-4e59-bd28-f11a1b865726 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:55.073871 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126dc2d-c805-4e59-bd28-f11a1b865726 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:55.074140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a126dc2d-c805-4e59-bd28-f11a1b865726 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:55.074780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126dc2d-c805-4e59-bd28-f11a1b865726 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:55.076171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a126dc2d-c805-4e59-bd28-f11a1b865726 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a126dc2d-c805-4e59-bd28-f11a1b865726 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:55.085754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:55.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:55.088266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 461/902] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Sep 24 14:13:54 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:55.092686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126dc2d-c805-4e59-bd28-f11a1b865726 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:55.109651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:55.188289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 442/903] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:13:54 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:13:55.190812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc97d4-da8f-4a4d-82db-fca935ee9f27 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:55.217635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a126dc2d-c805-4e59-bd28-f11a1b865726 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:55.260511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e5cc2-f7e6-4064-a156-1e6db4e6ad0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:55.261496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5cc2-f7e6-4064-a156-1e6db4e6ad0c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:55.262031 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5cc2-f7e6-4064-a156-1e6db4e6ad0c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:55.262508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636e5cc2-f7e6-4064-a156-1e6db4e6ad0c None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:55.263379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e5cc2-f7e6-4064-a156-1e6db4e6ad0c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:55.264067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e5cc2-f7e6-4064-a156-1e6db4e6ad0c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:55.267129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-636e5cc2-f7e6-4064-a156-1e6db4e6ad0c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:55.277938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 462/904] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:13:55 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:55.278899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e5cc2-f7e6-4064-a156-1e6db4e6ad0c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:55.296438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:55.302890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7bc97d4-da8f-4a4d-82db-fca935ee9f27 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:55.339328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4f36a-db4f-4f9c-92d2-4e537a92579f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:55.339966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4f36a-db4f-4f9c-92d2-4e537a92579f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:55.340283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4f36a-db4f-4f9c-92d2-4e537a92579f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:55.340554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad4f36a-db4f-4f9c-92d2-4e537a92579f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:55.352706 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4f36a-db4f-4f9c-92d2-4e537a92579f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:55.354277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ad4f36a-db4f-4f9c-92d2-4e537a92579f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3ad4f36a-db4f-4f9c-92d2-4e537a92579f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:55.369217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:55.370212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:55.376477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:55.376477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:55.376477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:55.376477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 443/905] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:55.376477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4f36a-db4f-4f9c-92d2-4e537a92579f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:55.392992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:55.423890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-636e5cc2-f7e6-4064-a156-1e6db4e6ad0c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:55.465372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac242273-b529-44ce-9fe6-606309c61e17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:55.466476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac242273-b529-44ce-9fe6-606309c61e17 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:55.466974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac242273-b529-44ce-9fe6-606309c61e17 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:55.468253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac242273-b529-44ce-9fe6-606309c61e17 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:55.469099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac242273-b529-44ce-9fe6-606309c61e17 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:55.469412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac242273-b529-44ce-9fe6-606309c61e17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:55.470870 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac242273-b529-44ce-9fe6-606309c61e17 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:55.482307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 463/906] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:13:55 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:55.483262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac242273-b529-44ce-9fe6-606309c61e17 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:55.503288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad4f36a-db4f-4f9c-92d2-4e537a92579f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:55.541880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f4366-495e-4872-99cf-59a95786d842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:55.542857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4366-495e-4872-99cf-59a95786d842 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:55.543399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4366-495e-4872-99cf-59a95786d842 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:55.543883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0f4366-495e-4872-99cf-59a95786d842 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:55.544891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f4366-495e-4872-99cf-59a95786d842 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:55.545398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f4366-495e-4872-99cf-59a95786d842 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:55.547084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0f4366-495e-4872-99cf-59a95786d842 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:55.562083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 444/907] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:55.567103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f4366-495e-4872-99cf-59a95786d842 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:55.585606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:55.602020 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac242273-b529-44ce-9fe6-606309c61e17 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:55.649052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e73b0-e5a0-4de6-b1f2-743bf07f56e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:55.649678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e73b0-e5a0-4de6-b1f2-743bf07f56e4 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:55.649965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e73b0-e5a0-4de6-b1f2-743bf07f56e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:55.650246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-448e73b0-e5a0-4de6-b1f2-743bf07f56e4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:55.650949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e73b0-e5a0-4de6-b1f2-743bf07f56e4 None admin] RBAC: Adding query filter params (interface=public, service_id=be4a032f02a94d44b8e111652b8e407f, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:55.651264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e73b0-e5a0-4de6-b1f2-743bf07f56e4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:55.652663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-448e73b0-e5a0-4de6-b1f2-743bf07f56e4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:55.666617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 464/908] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 24 14:13:55 2022] GET /identity/v3/endpoints?service_id=be4a032f02a94d44b8e111652b8e407f&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:55.667612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e73b0-e5a0-4de6-b1f2-743bf07f56e4 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:55.672589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:55.691826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0f4366-495e-4872-99cf-59a95786d842 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:55.728930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e793879-b729-4202-8bae-b55b3a56a720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:55.729935 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e793879-b729-4202-8bae-b55b3a56a720 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:55.730451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e793879-b729-4202-8bae-b55b3a56a720 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:55.730989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e793879-b729-4202-8bae-b55b3a56a720 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:55.738655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e793879-b729-4202-8bae-b55b3a56a720 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:55.740433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e793879-b729-4202-8bae-b55b3a56a720 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-3e793879-b729-4202-8bae-b55b3a56a720 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:13:55.752324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:55.753283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:55.754184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:13:55.754184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:13:55.754184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:13:55.754184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:13:55.754184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:13:55.754184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:13:55.754184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:13:55.754184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:55.756663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 445/909] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:13:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:55.762553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e793879-b729-4202-8bae-b55b3a56a720 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:55.796868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-448e73b0-e5a0-4de6-b1f2-743bf07f56e4 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:55.839420 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2d90b-0ed2-4f50-a92e-80229a41908d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:55.840428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2d90b-0ed2-4f50-a92e-80229a41908d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:55.840966 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2d90b-0ed2-4f50-a92e-80229a41908d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:55.841445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2d90b-0ed2-4f50-a92e-80229a41908d None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:55.841981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:55.843556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2d90b-0ed2-4f50-a92e-80229a41908d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:55.845336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2d90b-0ed2-4f50-a92e-80229a41908d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:55.860775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 465/910] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 24 14:13:55 2022] GET /identity/v3/services => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:13:55.890267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e793879-b729-4202-8bae-b55b3a56a720 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:55.929052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71011bba-521f-475a-a070-476dff2db009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:55.929672 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011bba-521f-475a-a070-476dff2db009 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:55.929949 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011bba-521f-475a-a070-476dff2db009 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:55.930219 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71011bba-521f-475a-a070-476dff2db009 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:55.930918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71011bba-521f-475a-a070-476dff2db009 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:55.931223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71011bba-521f-475a-a070-476dff2db009 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:55.932825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71011bba-521f-475a-a070-476dff2db009 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:55.946802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 446/911] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:13:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:55.957324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2d90b-0ed2-4f50-a92e-80229a41908d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:56.034185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:56.071615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2d90b-0ed2-4f50-a92e-80229a41908d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:56.107850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f61f62-c440-4ecd-bc55-e34443ecbc2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:56.108938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f61f62-c440-4ecd-bc55-e34443ecbc2a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:56.109221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f61f62-c440-4ecd-bc55-e34443ecbc2a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:56.109498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f61f62-c440-4ecd-bc55-e34443ecbc2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:56.110225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f61f62-c440-4ecd-bc55-e34443ecbc2a None admin] RBAC: Adding query filter params (role.id=f7cf85ae67814930bcd2ba2183fc5102, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=8af010ec8f3841a4b74907b13961e2b3) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:56.110533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f61f62-c440-4ecd-bc55-e34443ecbc2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:56.111953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f61f62-c440-4ecd-bc55-e34443ecbc2a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:56.118068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 466/912] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:13:55 2022] GET /identity/v3/role_assignments?user.id=8af010ec8f3841a4b74907b13961e2b3&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=f7cf85ae67814930bcd2ba2183fc5102 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:57.077899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b09e6-9c24-4141-bc1a-b0a7c5d67547 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:57.078457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b09e6-9c24-4141-bc1a-b0a7c5d67547 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:57.078457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-472b09e6-9c24-4141-bc1a-b0a7c5d67547 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:57.080108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 447/913] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:57.085458 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50242657-84f8-490a-b959-3d42af38f06c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:57.085882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50242657-84f8-490a-b959-3d42af38f06c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:57.086046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50242657-84f8-490a-b959-3d42af38f06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:57.109281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-50242657-84f8-490a-b959-3d42af38f06c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:57.110769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-50242657-84f8-490a-b959-3d42af38f06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:57.165783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40e38c-ed87-479b-affc-62925950865f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:57.166052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40e38c-ed87-479b-affc-62925950865f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:57.166327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f40e38c-ed87-479b-affc-62925950865f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:57.167864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 448/914] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:57.173410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b9698-947d-47a3-b46c-510a80f9ad33 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:57.173691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b9698-947d-47a3-b46c-510a80f9ad33 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:57.173965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4b9698-947d-47a3-b46c-510a80f9ad33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:57.196290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 467/915] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:57.197201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1a4b9698-947d-47a3-b46c-510a80f9ad33 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:57.198399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1a4b9698-947d-47a3-b46c-510a80f9ad33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:57.268574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 449/916] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:57 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:13:57.479778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50242657-84f8-490a-b959-3d42af38f06c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:57.540526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b9698-947d-47a3-b46c-510a80f9ad33 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:57.557765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:57.607103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50242657-84f8-490a-b959-3d42af38f06c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:57.614967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:57.652489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18befa88-663b-4e60-9e37-d5139a206528 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:57.654061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18befa88-663b-4e60-9e37-d5139a206528 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:57.654543 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18befa88-663b-4e60-9e37-d5139a206528 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:57.655758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18befa88-663b-4e60-9e37-d5139a206528 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:57.656555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18befa88-663b-4e60-9e37-d5139a206528 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:57.658210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18befa88-663b-4e60-9e37-d5139a206528 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:57.663565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4b9698-947d-47a3-b46c-510a80f9ad33 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-18befa88-663b-4e60-9e37-d5139a206528 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:57.668891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:57.670120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Sep 24 14:13:57.671271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:57.673823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 468/917] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:57 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:57.679898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18befa88-663b-4e60-9e37-d5139a206528 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:57.714467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec264-b870-43f0-ba5e-e53932422308 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:57.715649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec264-b870-43f0-ba5e-e53932422308 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:57.716081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec264-b870-43f0-ba5e-e53932422308 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:57.716839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03ec264-b870-43f0-ba5e-e53932422308 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:57.718541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ec264-b870-43f0-ba5e-e53932422308 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:57.720369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03ec264-b870-43f0-ba5e-e53932422308 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e03ec264-b870-43f0-ba5e-e53932422308 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:57.732736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:57.734049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:13:57.735145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:57.738029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 450/918] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:13:57 2022] GET /identity/v3/services/object-store => generated 93 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:57.743262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec264-b870-43f0-ba5e-e53932422308 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:57.810623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18befa88-663b-4e60-9e37-d5139a206528 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:57.844258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:57.855294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03ec264-b870-43f0-ba5e-e53932422308 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:57.855844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a92a1b-ca9a-48a6-8965-61433e587a51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:57.856493 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a92a1b-ca9a-48a6-8965-61433e587a51 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:57.856769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a92a1b-ca9a-48a6-8965-61433e587a51 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:57.857042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a92a1b-ca9a-48a6-8965-61433e587a51 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:57.857673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a92a1b-ca9a-48a6-8965-61433e587a51 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:57.858050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a92a1b-ca9a-48a6-8965-61433e587a51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:57.860650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a92a1b-ca9a-48a6-8965-61433e587a51 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:57.866399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 469/919] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:57 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:57.871785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a92a1b-ca9a-48a6-8965-61433e587a51 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:57.886111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:57.901870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31866910-78f7-4dd1-886d-e463c90664f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:57.902910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31866910-78f7-4dd1-886d-e463c90664f3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:57.903425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31866910-78f7-4dd1-886d-e463c90664f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:57.903914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31866910-78f7-4dd1-886d-e463c90664f3 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:57.904947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31866910-78f7-4dd1-886d-e463c90664f3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:57.905577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31866910-78f7-4dd1-886d-e463c90664f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:57.907241 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31866910-78f7-4dd1-886d-e463c90664f3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:57.913234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 451/920] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 24 14:13:57 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:57.922407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31866910-78f7-4dd1-886d-e463c90664f3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:57.991445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a92a1b-ca9a-48a6-8965-61433e587a51 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:58.029145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1562acc-5aa5-4928-aff2-0f7033133b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:58.029863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1562acc-5aa5-4928-aff2-0f7033133b8c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.030714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1562acc-5aa5-4928-aff2-0f7033133b8c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.030993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1562acc-5aa5-4928-aff2-0f7033133b8c None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.031623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1562acc-5aa5-4928-aff2-0f7033133b8c None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:58.031927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1562acc-5aa5-4928-aff2-0f7033133b8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:58.033326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1562acc-5aa5-4928-aff2-0f7033133b8c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:58.043819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31866910-78f7-4dd1-886d-e463c90664f3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:58.044237 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 470/921] 10.222.0.16 () {56 vars in 1114 bytes} [Sat Sep 24 14:13:57 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:58.045634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1562acc-5aa5-4928-aff2-0f7033133b8c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:58.087407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64591be2-73c0-46a0-8e09-53e4b571f6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:58.088189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591be2-73c0-46a0-8e09-53e4b571f6bd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.088564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591be2-73c0-46a0-8e09-53e4b571f6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.088930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64591be2-73c0-46a0-8e09-53e4b571f6bd None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.089658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64591be2-73c0-46a0-8e09-53e4b571f6bd None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:58.090074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64591be2-73c0-46a0-8e09-53e4b571f6bd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:58.091539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64591be2-73c0-46a0-8e09-53e4b571f6bd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:58.103996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 452/922] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 24 14:13:57 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:58.106667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cca3ba-5c0a-4bc2-9b4d-2dbd4a0c4db0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.106667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cca3ba-5c0a-4bc2-9b4d-2dbd4a0c4db0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.106667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cca3ba-5c0a-4bc2-9b4d-2dbd4a0c4db0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.111176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 453/923] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:58.111176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cca3ba-5c0a-4bc2-9b4d-2dbd4a0c4db0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:58.112316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:58.161907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:58.164091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1562acc-5aa5-4928-aff2-0f7033133b8c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:58.204784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b25f97-d11b-4474-9282-fe93a6db3def None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:58.205379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b25f97-d11b-4474-9282-fe93a6db3def None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.205659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b25f97-d11b-4474-9282-fe93a6db3def None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.205933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b25f97-d11b-4474-9282-fe93a6db3def None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.206767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b25f97-d11b-4474-9282-fe93a6db3def None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:58.208852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b25f97-d11b-4474-9282-fe93a6db3def None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:58.213520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cca3ba-5c0a-4bc2-9b4d-2dbd4a0c4db0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:58.235633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 471/924] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:13:58 2022] POST /identity/v3/endpoints => generated 346 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:13:58.237605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28bb1-91ce-4136-b2e2-9a69a7424e98 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.237900 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28bb1-91ce-4136-b2e2-9a69a7424e98 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.238182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c28bb1-91ce-4136-b2e2-9a69a7424e98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.259592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b3c28bb1-91ce-4136-b2e2-9a69a7424e98 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:58.261561 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b3c28bb1-91ce-4136-b2e2-9a69a7424e98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:58.266922 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f75df9-eac7-4c61-aaa5-16b8abd358b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:58.267549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f75df9-eac7-4c61-aaa5-16b8abd358b2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.267827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f75df9-eac7-4c61-aaa5-16b8abd358b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.268096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f75df9-eac7-4c61-aaa5-16b8abd358b2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.268849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f75df9-eac7-4c61-aaa5-16b8abd358b2 None admin] RBAC: Adding query filter params (interface=public, service_id=c09ca0a69e0d496892b5939a6df83256, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:58.269156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f75df9-eac7-4c61-aaa5-16b8abd358b2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:58.270590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f75df9-eac7-4c61-aaa5-16b8abd358b2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:58.281501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 454/925] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 24 14:13:58 2022] GET /identity/v3/endpoints?service_id=c09ca0a69e0d496892b5939a6df83256&interface=public®ion_id=RegionOne => generated 194 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:58.282500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f75df9-eac7-4c61-aaa5-16b8abd358b2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:58.353883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 472/926] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:58.355672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e51d4-685c-42ca-bdbd-0b0e6f80809a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.356468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e51d4-685c-42ca-bdbd-0b0e6f80809a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.356969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e51d4-685c-42ca-bdbd-0b0e6f80809a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.359836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 473/927] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:13:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:13:58.366681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef9813-ea01-4e78-943c-ad7101d63fd4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.366974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef9813-ea01-4e78-943c-ad7101d63fd4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.367232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ef9813-ea01-4e78-943c-ad7101d63fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.391469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-98ef9813-ea01-4e78-943c-ad7101d63fd4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:13:58.393556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-98ef9813-ea01-4e78-943c-ad7101d63fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:13:58.398320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f75df9-eac7-4c61-aaa5-16b8abd358b2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:58.410595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:58.444437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c86534-5f7c-46ba-9730-0622d6c1fa8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:58.445050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86534-5f7c-46ba-9730-0622d6c1fa8c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.445325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86534-5f7c-46ba-9730-0622d6c1fa8c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.445652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c86534-5f7c-46ba-9730-0622d6c1fa8c None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.446258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c86534-5f7c-46ba-9730-0622d6c1fa8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:58.447736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c86534-5f7c-46ba-9730-0622d6c1fa8c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:58.448228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:58.456023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 455/928] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 24 14:13:58 2022] GET /identity/v3/services => generated 1497 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:13:58.501048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 474/929] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:13:58 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:13:58.641811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c86534-5f7c-46ba-9730-0622d6c1fa8c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:58.749670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c86534-5f7c-46ba-9730-0622d6c1fa8c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:58.773027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef9813-ea01-4e78-943c-ad7101d63fd4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:58.785458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872768d-1c29-4e3a-95ab-4db782ccdb25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:58.786114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872768d-1c29-4e3a-95ab-4db782ccdb25 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.786382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872768d-1c29-4e3a-95ab-4db782ccdb25 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.786647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872768d-1c29-4e3a-95ab-4db782ccdb25 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.787229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872768d-1c29-4e3a-95ab-4db782ccdb25 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:58.788848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872768d-1c29-4e3a-95ab-4db782ccdb25 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1872768d-1c29-4e3a-95ab-4db782ccdb25 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:58.798306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:58.799470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:13:58.800553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 456/930] 10.222.0.16 () {56 vars in 1132 bytes} [Sat Sep 24 14:13:58 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:58.805302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872768d-1c29-4e3a-95ab-4db782ccdb25 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:58.850134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:58.887599 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98ef9813-ea01-4e78-943c-ad7101d63fd4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:58.932584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872768d-1c29-4e3a-95ab-4db782ccdb25 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:58.937031 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdc729-b539-43da-9a1c-b4e01ce70be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:58.937678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdc729-b539-43da-9a1c-b4e01ce70be9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.937996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdc729-b539-43da-9a1c-b4e01ce70be9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.938267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ffdc729-b539-43da-9a1c-b4e01ce70be9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.951449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ffdc729-b539-43da-9a1c-b4e01ce70be9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9ffdc729-b539-43da-9a1c-b4e01ce70be9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:13:58.957830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:58.958791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:58.959648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 475/931] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 24 14:13:58 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:58.964677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdc729-b539-43da-9a1c-b4e01ce70be9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:58.980591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578435e-6c8a-44d0-abf0-cc3b36e514f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:58.981246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578435e-6c8a-44d0-abf0-cc3b36e514f8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:58.981640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578435e-6c8a-44d0-abf0-cc3b36e514f8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:58.981912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b578435e-6c8a-44d0-abf0-cc3b36e514f8 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:58.982542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578435e-6c8a-44d0-abf0-cc3b36e514f8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:58.983084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578435e-6c8a-44d0-abf0-cc3b36e514f8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:58.984483 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b578435e-6c8a-44d0-abf0-cc3b36e514f8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:58.994892 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 457/932] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:13:58 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:58.995920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578435e-6c8a-44d0-abf0-cc3b36e514f8 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:59.017716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:59.113346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b578435e-6c8a-44d0-abf0-cc3b36e514f8 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:59.114935 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:59.115967 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ffdc729-b539-43da-9a1c-b4e01ce70be9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:59.152788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81f8d4-075b-4a78-8720-337ed7125fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:59.153393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81f8d4-075b-4a78-8720-337ed7125fe5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:59.153674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81f8d4-075b-4a78-8720-337ed7125fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:59.153946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae81f8d4-075b-4a78-8720-337ed7125fe5 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:59.154572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81f8d4-075b-4a78-8720-337ed7125fe5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:59.154904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81f8d4-075b-4a78-8720-337ed7125fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:59.156316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae81f8d4-075b-4a78-8720-337ed7125fe5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:59.157154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a30f2-5bbc-43cc-bd1f-bab036525e0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:59.158055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a30f2-5bbc-43cc-bd1f-bab036525e0c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:59.158542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a30f2-5bbc-43cc-bd1f-bab036525e0c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:59.159067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6a30f2-5bbc-43cc-bd1f-bab036525e0c None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:59.159998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a30f2-5bbc-43cc-bd1f-bab036525e0c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:59.160528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a30f2-5bbc-43cc-bd1f-bab036525e0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:59.166339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 458/933] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:13:58 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:59.166492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6a30f2-5bbc-43cc-bd1f-bab036525e0c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:59.167321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81f8d4-075b-4a78-8720-337ed7125fe5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:59.176079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 476/934] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 24 14:13:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:13:59.182143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a30f2-5bbc-43cc-bd1f-bab036525e0c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:59.294330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:59.300423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae81f8d4-075b-4a78-8720-337ed7125fe5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:59.307279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6a30f2-5bbc-43cc-bd1f-bab036525e0c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:59.340422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc8e96-7d48-44c5-baba-6fd3226d5b61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:59.341030 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc8e96-7d48-44c5-baba-6fd3226d5b61 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:59.341317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc8e96-7d48-44c5-baba-6fd3226d5b61 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:59.341636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbc8e96-7d48-44c5-baba-6fd3226d5b61 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:59.342966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc8e96-7d48-44c5-baba-6fd3226d5b61 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:59.344363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bbc8e96-7d48-44c5-baba-6fd3226d5b61 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:59.348134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8cd70-3886-409c-877c-39bb4f0906cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:59.349031 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8cd70-3886-409c-877c-39bb4f0906cd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:59.349811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8cd70-3886-409c-877c-39bb4f0906cd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:59.350293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb8cd70-3886-409c-877c-39bb4f0906cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:59.364677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8cd70-3886-409c-877c-39bb4f0906cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:59.366628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb8cd70-3886-409c-877c-39bb4f0906cd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:59.376186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 459/935] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:13:59 2022] POST /identity/v3/endpoints => generated 347 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-cfb8cd70-3886-409c-877c-39bb4f0906cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:13:59.393226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:59.394289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:13:59.395223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:13:59.395223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:13:59.395223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:59.395223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 477/936] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:13:59.400551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc8e96-7d48-44c5-baba-6fd3226d5b61 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:59.432911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:59.535668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbc8e96-7d48-44c5-baba-6fd3226d5b61 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:59.571463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf38dc-04de-42ea-8e6f-66f6b53458f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:59.572002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf38dc-04de-42ea-8e6f-66f6b53458f4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:59.572340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf38dc-04de-42ea-8e6f-66f6b53458f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:59.572619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadf38dc-04de-42ea-8e6f-66f6b53458f4 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:59.573274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf38dc-04de-42ea-8e6f-66f6b53458f4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:59.573616 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf38dc-04de-42ea-8e6f-66f6b53458f4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:59.574988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadf38dc-04de-42ea-8e6f-66f6b53458f4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:59.587941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 460/937] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:13:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:59.593601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8cd70-3886-409c-877c-39bb4f0906cd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:59.702457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb8cd70-3886-409c-877c-39bb4f0906cd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:59.738144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95c93b-780c-4277-b13b-4a07202f5ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:59.738777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95c93b-780c-4277-b13b-4a07202f5ade None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:59.739058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95c93b-780c-4277-b13b-4a07202f5ade None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:59.739333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b95c93b-780c-4277-b13b-4a07202f5ade None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:59.747598 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95c93b-780c-4277-b13b-4a07202f5ade None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:59.749640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b95c93b-780c-4277-b13b-4a07202f5ade None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0b95c93b-780c-4277-b13b-4a07202f5ade None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:13:59.760882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:13:59.761857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:13:59.763457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 478/938] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 24 14:13:59 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:13:59.767719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf38dc-04de-42ea-8e6f-66f6b53458f4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:59.855834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:13:59.878345 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadf38dc-04de-42ea-8e6f-66f6b53458f4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:13:59.913534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9af7b7-bef5-48f3-bd14-b691520d40ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:13:59.914146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9af7b7-bef5-48f3-bd14-b691520d40ae None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:13:59.914426 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9af7b7-bef5-48f3-bd14-b691520d40ae None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:13:59.914700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9af7b7-bef5-48f3-bd14-b691520d40ae None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:13:59.915422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9af7b7-bef5-48f3-bd14-b691520d40ae None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:13:59.915726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9af7b7-bef5-48f3-bd14-b691520d40ae None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:13:59.917177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9af7b7-bef5-48f3-bd14-b691520d40ae None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:13:59.935145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 461/939] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 24 14:13:59 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:13:59.941314 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95c93b-780c-4277-b13b-4a07202f5ade None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:13:59.945473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:00.050137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b95c93b-780c-4277-b13b-4a07202f5ade None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:00.084618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3ec6e-67bb-478e-8903-35ec73c4fff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:00.085248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3ec6e-67bb-478e-8903-35ec73c4fff1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:00.085527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3ec6e-67bb-478e-8903-35ec73c4fff1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:00.085798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d3ec6e-67bb-478e-8903-35ec73c4fff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:00.096794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3ec6e-67bb-478e-8903-35ec73c4fff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:00.098582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d3ec6e-67bb-478e-8903-35ec73c4fff1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f7d3ec6e-67bb-478e-8903-35ec73c4fff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:00.113165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:00.114147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:14:00.115057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:00.115057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:00.115057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:00.115057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 479/940] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:13:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:00.121553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9af7b7-bef5-48f3-bd14-b691520d40ae None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:00.233654 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9af7b7-bef5-48f3-bd14-b691520d40ae None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:00.269848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0227183-a732-46e8-bd49-8c2fcd750987 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:00.270889 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0227183-a732-46e8-bd49-8c2fcd750987 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:00.271369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0227183-a732-46e8-bd49-8c2fcd750987 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:00.271849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0227183-a732-46e8-bd49-8c2fcd750987 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:00.272720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0227183-a732-46e8-bd49-8c2fcd750987 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:00.273226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0227183-a732-46e8-bd49-8c2fcd750987 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:00.274821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0227183-a732-46e8-bd49-8c2fcd750987 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:00.277561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:00.287984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 462/941] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:14:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:00.294022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3ec6e-67bb-478e-8903-35ec73c4fff1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:00.360650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:00.405671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d3ec6e-67bb-478e-8903-35ec73c4fff1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:00.440129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e7b3-7573-44b1-8f1c-8a304ccd1384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:00.440779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e7b3-7573-44b1-8f1c-8a304ccd1384 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:00.441058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e7b3-7573-44b1-8f1c-8a304ccd1384 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:00.441332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd5e7b3-7573-44b1-8f1c-8a304ccd1384 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:00.448117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5e7b3-7573-44b1-8f1c-8a304ccd1384 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:00.449593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd5e7b3-7573-44b1-8f1c-8a304ccd1384 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-afd5e7b3-7573-44b1-8f1c-8a304ccd1384 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:14:00.461149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:00.462064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:00.462977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:14:00.462977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:14:00.462977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:14:00.462977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:14:00.462977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:14:00.462977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:14:00.462977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:00.462977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:00.462977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 480/942] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:14:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:00.469755 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0227183-a732-46e8-bd49-8c2fcd750987 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:00.580300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0227183-a732-46e8-bd49-8c2fcd750987 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:00.617016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4d36d1-0514-4a83-b184-6448155b03b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:00.617654 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d36d1-0514-4a83-b184-6448155b03b0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:00.617930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d36d1-0514-4a83-b184-6448155b03b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:00.618200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4d36d1-0514-4a83-b184-6448155b03b0 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:00.618918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d36d1-0514-4a83-b184-6448155b03b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:00.619221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d36d1-0514-4a83-b184-6448155b03b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:00.620746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4d36d1-0514-4a83-b184-6448155b03b0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:00.635932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 463/943] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:14:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:00.645301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e7b3-7573-44b1-8f1c-8a304ccd1384 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:00.655866 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0039ca-35b3-46fa-b56c-97058ccc3979 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:00.656129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0039ca-35b3-46fa-b56c-97058ccc3979 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:00.656393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0039ca-35b3-46fa-b56c-97058ccc3979 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:00.659026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 464/944] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:14:00.662973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ebcf4-9f9d-440e-b3db-887750a0bf9a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:00.663260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ebcf4-9f9d-440e-b3db-887750a0bf9a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:00.663542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303ebcf4-9f9d-440e-b3db-887750a0bf9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:00.689574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-303ebcf4-9f9d-440e-b3db-887750a0bf9a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:00.691121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-303ebcf4-9f9d-440e-b3db-887750a0bf9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:00.759307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd5e7b3-7573-44b1-8f1c-8a304ccd1384 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:00.762852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:00.776512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:00.782378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 465/945] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:00.792284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3244a-3f30-4cd6-ae7e-792c90ba9241 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:00.792284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3244a-3f30-4cd6-ae7e-792c90ba9241 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:00.792284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f3244a-3f30-4cd6-ae7e-792c90ba9241 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:00.792284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 466/946] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:00.797220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af223e3d-17ef-4812-93ee-028ef84ebfb6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:00.797501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af223e3d-17ef-4812-93ee-028ef84ebfb6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:00.797773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af223e3d-17ef-4812-93ee-028ef84ebfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:00.801730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d8299-74f0-4a7e-8302-488dad7fc9da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:00.802734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8299-74f0-4a7e-8302-488dad7fc9da None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:00.803198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8299-74f0-4a7e-8302-488dad7fc9da None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:00.803996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563d8299-74f0-4a7e-8302-488dad7fc9da None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/8af010ec8f3841a4b74907b13961e2b3/roles/f7cf85ae67814930bcd2ba2183fc5102` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:00.807483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d8299-74f0-4a7e-8302-488dad7fc9da None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=8af010ec8f3841a4b74907b13961e2b3, role_id=f7cf85ae67814930bcd2ba2183fc5102)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:00.809229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-563d8299-74f0-4a7e-8302-488dad7fc9da None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:00.818050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-af223e3d-17ef-4812-93ee-028ef84ebfb6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:00.819444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-af223e3d-17ef-4812-93ee-028ef84ebfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:00.827066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 481/947] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:14:00 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/8af010ec8f3841a4b74907b13961e2b3/roles/f7cf85ae67814930bcd2ba2183fc5102 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:14:00.904126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 467/948] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:00 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:01.062105 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d8299-74f0-4a7e-8302-488dad7fc9da None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:01.173675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-563d8299-74f0-4a7e-8302-488dad7fc9da None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:01.207001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af223e3d-17ef-4812-93ee-028ef84ebfb6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:01.212274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:01.213130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:01.213638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:01.214117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:01.215002 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:01.216805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:01.220024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: WARNING keystone.server.flask.common [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 24 14:14:01.242502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.sql.core [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 14:14:01.242502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 14:14:01.242502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [parameters: {'id': '537eae1931e243eb9d8b00e23ac41cf3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 14:14:01.242502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81458) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 537eae1931e243eb9d8b00e23ac41cf3.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 537eae1931e243eb9d8b00e23ac41cf3. Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 14:14:01.250382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Sep 24 14:14:01.251212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return project_ref.to_dict() Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application yield resource Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application next(self.gen) Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise self.value Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application session.commit() Sep 24 14:14:01.257717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.session.flush() Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application compat.raise_( Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 14:14:01.258672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application c = connection._execute_20( Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 14:14:01.259622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application conn.query(q) Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application result.read() Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 14:14:01.260475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [parameters: {'id': '537eae1931e243eb9d8b00e23ac41cf3', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:01.262727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:01.265084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:01.267356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:01.267356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Sep 24 14:14:01.267356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Sep 24 14:14:01.267356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:01.267356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:01.267356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Sep 24 14:14:01.267356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.Conflict( Sep 24 14:14:01.267356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 537eae1931e243eb9d8b00e23ac41cf3. Sep 24 14:14:01.267356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:01.267356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 482/949] 10.222.0.16 () {60 vars in 1140 bytes} [Sat Sep 24 14:14:01 2022] POST /identity/v3/projects => generated 262 bytes in 190 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:01.269605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:01.312571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:01.338696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af223e3d-17ef-4812-93ee-028ef84ebfb6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:01.362826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:01.382463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d96290-b02c-4695-882c-a21cf502907d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:01.383453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d96290-b02c-4695-882c-a21cf502907d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:01.384039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d96290-b02c-4695-882c-a21cf502907d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:01.384532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d96290-b02c-4695-882c-a21cf502907d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:01.385408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d96290-b02c-4695-882c-a21cf502907d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:01.387066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d96290-b02c-4695-882c-a21cf502907d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a8d96290-b02c-4695-882c-a21cf502907d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:01.397358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:01.398569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:14:01.399457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:01.400990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25928210-1792-4c5a-9d45-b437ec57916e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:01.407736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 468/950] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:14:01 2022] GET /identity/v3/services/object-store => generated 93 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:01.409365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d96290-b02c-4695-882c-a21cf502907d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:01.443437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ae819-4df6-4633-8077-daba9cbb607b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:01.444427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ae819-4df6-4633-8077-daba9cbb607b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:01.444849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ae819-4df6-4633-8077-daba9cbb607b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:01.445594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913ae819-4df6-4633-8077-daba9cbb607b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:01.454836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ae819-4df6-4633-8077-daba9cbb607b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:01.457066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913ae819-4df6-4633-8077-daba9cbb607b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-913ae819-4df6-4633-8077-daba9cbb607b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:14:01.471497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:01.472625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:01.473548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:14:01.473548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:14:01.473548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:14:01.473548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:14:01.473548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:14:01.473548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:14:01.473548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:01.473548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:01.478902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 483/951] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:14:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:01.479800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ae819-4df6-4633-8077-daba9cbb607b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:01.537067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d96290-b02c-4695-882c-a21cf502907d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:01.578688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba33230-88e3-4c57-b19c-4de94fe19a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:01.579778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba33230-88e3-4c57-b19c-4de94fe19a97 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:01.580329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba33230-88e3-4c57-b19c-4de94fe19a97 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:01.580853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba33230-88e3-4c57-b19c-4de94fe19a97 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:01.581802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba33230-88e3-4c57-b19c-4de94fe19a97 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:01.582310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba33230-88e3-4c57-b19c-4de94fe19a97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:01.584027 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aba33230-88e3-4c57-b19c-4de94fe19a97 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:01.595330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 469/952] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 24 14:14:01 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:01.596953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba33230-88e3-4c57-b19c-4de94fe19a97 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:01.597908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:01.609294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913ae819-4df6-4633-8077-daba9cbb607b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:01.660070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:01.664095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5283a043-65b3-4ac9-8757-ec0e6881226a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:01.665097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283a043-65b3-4ac9-8757-ec0e6881226a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:01.665997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283a043-65b3-4ac9-8757-ec0e6881226a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:01.665997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5283a043-65b3-4ac9-8757-ec0e6881226a None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:01.666323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283a043-65b3-4ac9-8757-ec0e6881226a None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:01.666869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283a043-65b3-4ac9-8757-ec0e6881226a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:01.668355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5283a043-65b3-4ac9-8757-ec0e6881226a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:01.690888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 484/953] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:14:01 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:01.692222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67249-559c-4173-971a-cf613be0a1ae None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:01.692557 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67249-559c-4173-971a-cf613be0a1ae None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:01.692875 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae67249-559c-4173-971a-cf613be0a1ae None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:01.694795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 485/954] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:01.705607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb44b8b-4b99-4715-b2e7-7f6079d57fc6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:01.706196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb44b8b-4b99-4715-b2e7-7f6079d57fc6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:01.706336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb44b8b-4b99-4715-b2e7-7f6079d57fc6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:01.730286 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-abb44b8b-4b99-4715-b2e7-7f6079d57fc6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:01.733082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-abb44b8b-4b99-4715-b2e7-7f6079d57fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:01.735124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba33230-88e3-4c57-b19c-4de94fe19a97 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:01.779335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b272f2d-e930-4fa6-a849-48e839899fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:01.780855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b272f2d-e930-4fa6-a849-48e839899fdb None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:01.781135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b272f2d-e930-4fa6-a849-48e839899fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:01.781403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b272f2d-e930-4fa6-a849-48e839899fdb None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:01.783074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b272f2d-e930-4fa6-a849-48e839899fdb None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:01.783385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b272f2d-e930-4fa6-a849-48e839899fdb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:01.784834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b272f2d-e930-4fa6-a849-48e839899fdb None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:01.792202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 470/955] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 24 14:14:01 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:01.798013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b272f2d-e930-4fa6-a849-48e839899fdb None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:01.837933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 486/956] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:01 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:01.921111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b272f2d-e930-4fa6-a849-48e839899fdb None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:01.931029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:01.963946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8b17-2ec0-4b18-9f4b-7d6c6a278154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:01.964716 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8b17-2ec0-4b18-9f4b-7d6c6a278154 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:01.965026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8b17-2ec0-4b18-9f4b-7d6c6a278154 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:01.965273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8e8b17-2ec0-4b18-9f4b-7d6c6a278154 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:01.965951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8b17-2ec0-4b18-9f4b-7d6c6a278154 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:01.967900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8e8b17-2ec0-4b18-9f4b-7d6c6a278154 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:01.991399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 471/957] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:14:01 2022] POST /identity/v3/endpoints => generated 349 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:14:02.106309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb44b8b-4b99-4715-b2e7-7f6079d57fc6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:02.205445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:02.224408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb44b8b-4b99-4715-b2e7-7f6079d57fc6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:02.274248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10ea9e-4cc6-4dce-9b9f-b81c456495a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:02.274881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10ea9e-4cc6-4dce-9b9f-b81c456495a2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:02.275156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10ea9e-4cc6-4dce-9b9f-b81c456495a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:02.275424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb10ea9e-4cc6-4dce-9b9f-b81c456495a2 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:02.276171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10ea9e-4cc6-4dce-9b9f-b81c456495a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:02.280021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb10ea9e-4cc6-4dce-9b9f-b81c456495a2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-bb10ea9e-4cc6-4dce-9b9f-b81c456495a2 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:02.290260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:02.291336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:02.292876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 487/958] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:14:02 2022] GET /identity/v3/services/compute => generated 88 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:02.297929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8b17-2ec0-4b18-9f4b-7d6c6a278154 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:02.409705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8e8b17-2ec0-4b18-9f4b-7d6c6a278154 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:02.448500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77100b20-5282-4bc3-96c0-03715276f293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:02.449512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77100b20-5282-4bc3-96c0-03715276f293 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:02.449937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77100b20-5282-4bc3-96c0-03715276f293 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:02.450496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77100b20-5282-4bc3-96c0-03715276f293 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:02.451390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77100b20-5282-4bc3-96c0-03715276f293 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:02.452238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77100b20-5282-4bc3-96c0-03715276f293 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:02.453492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77100b20-5282-4bc3-96c0-03715276f293 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:02.459838 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 472/959] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:14:02 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:02.465278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10ea9e-4cc6-4dce-9b9f-b81c456495a2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:02.576185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb10ea9e-4cc6-4dce-9b9f-b81c456495a2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:02.613731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82096c7b-3fbe-4058-a271-a40ce35ea00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:02.614352 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82096c7b-3fbe-4058-a271-a40ce35ea00d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:02.614636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82096c7b-3fbe-4058-a271-a40ce35ea00d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:02.614918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82096c7b-3fbe-4058-a271-a40ce35ea00d None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:02.615558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82096c7b-3fbe-4058-a271-a40ce35ea00d None admin] RBAC: Adding query filter params (type=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:02.615864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82096c7b-3fbe-4058-a271-a40ce35ea00d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:02.617261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82096c7b-3fbe-4058-a271-a40ce35ea00d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:02.622531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 488/960] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:14:02 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:03.083203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49953b2d-c65a-4e73-965b-91ce57126e22 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:03.083528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49953b2d-c65a-4e73-965b-91ce57126e22 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:03.083755 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49953b2d-c65a-4e73-965b-91ce57126e22 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:03.085355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 473/961] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:03.090827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c5c87-3154-49c8-a704-d08d0481f66e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:03.091112 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c5c87-3154-49c8-a704-d08d0481f66e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:03.091394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66c5c87-3154-49c8-a704-d08d0481f66e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:03.106304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:03.112024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e66c5c87-3154-49c8-a704-d08d0481f66e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:03.114109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e66c5c87-3154-49c8-a704-d08d0481f66e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:03.193698 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 489/962] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:03 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:03.466847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49953b2d-c65a-4e73-965b-91ce57126e22 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:03.501667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:03.580243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49953b2d-c65a-4e73-965b-91ce57126e22 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:03.614452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54436afb-898d-4d5c-beed-ceaa51a33931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:03.615081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54436afb-898d-4d5c-beed-ceaa51a33931 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:03.615360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54436afb-898d-4d5c-beed-ceaa51a33931 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:03.615633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54436afb-898d-4d5c-beed-ceaa51a33931 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:03.627230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54436afb-898d-4d5c-beed-ceaa51a33931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-54436afb-898d-4d5c-beed-ceaa51a33931 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:14:03.632225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:03.633173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:03.634416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 474/963] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 24 14:14:03 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:03.641260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c5c87-3154-49c8-a704-d08d0481f66e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:03.746702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66c5c87-3154-49c8-a704-d08d0481f66e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:03.782312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5782da-1409-4aa7-8026-22b5c322005c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:03.782923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5782da-1409-4aa7-8026-22b5c322005c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:03.783205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5782da-1409-4aa7-8026-22b5c322005c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:03.783479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5782da-1409-4aa7-8026-22b5c322005c None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:03.784147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5782da-1409-4aa7-8026-22b5c322005c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:03.784478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5782da-1409-4aa7-8026-22b5c322005c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:03.785841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5782da-1409-4aa7-8026-22b5c322005c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:03.788472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:03.794791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 490/964] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 24 14:14:03 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:03.800907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54436afb-898d-4d5c-beed-ceaa51a33931 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:03.897969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:03.912854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54436afb-898d-4d5c-beed-ceaa51a33931 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:03.948983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4478158-3ce5-487f-8a6a-f4348ffb71df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:03.949617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4478158-3ce5-487f-8a6a-f4348ffb71df None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:03.949897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4478158-3ce5-487f-8a6a-f4348ffb71df None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:03.950173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4478158-3ce5-487f-8a6a-f4348ffb71df None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:03.962097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4478158-3ce5-487f-8a6a-f4348ffb71df None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:03.963717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4478158-3ce5-487f-8a6a-f4348ffb71df None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b4478158-3ce5-487f-8a6a-f4348ffb71df None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:03.978738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:03.979729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:14:03.980704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:03.980704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:03.980704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:03.980704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 475/965] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:03.989281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5782da-1409-4aa7-8026-22b5c322005c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:04.097692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5782da-1409-4aa7-8026-22b5c322005c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:04.132627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d80d18-2b92-4ce5-9f30-8e80a2431d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:04.133230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80d18-2b92-4ce5-9f30-8e80a2431d62 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.133507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80d18-2b92-4ce5-9f30-8e80a2431d62 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.133775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d80d18-2b92-4ce5-9f30-8e80a2431d62 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.134410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d80d18-2b92-4ce5-9f30-8e80a2431d62 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:04.134712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d80d18-2b92-4ce5-9f30-8e80a2431d62 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:04.136058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d80d18-2b92-4ce5-9f30-8e80a2431d62 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:04.148389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 491/966] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:14:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:04.157352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4478158-3ce5-487f-8a6a-f4348ffb71df None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:04.166465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1eff1c-899b-4487-b205-01583dbc24cd None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.166781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1eff1c-899b-4487-b205-01583dbc24cd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.167015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1eff1c-899b-4487-b205-01583dbc24cd None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.169539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 492/967] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:14:04.177520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab98e4-005a-47c5-bba8-d89f7d53d7ce None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.177808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab98e4-005a-47c5-bba8-d89f7d53d7ce None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.178126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ab98e4-005a-47c5-bba8-d89f7d53d7ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.208861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b5ab98e4-005a-47c5-bba8-d89f7d53d7ce None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:04.210930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b5ab98e4-005a-47c5-bba8-d89f7d53d7ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:04.278745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4478158-3ce5-487f-8a6a-f4348ffb71df None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:04.278942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:04.300195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 493/968] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:04.300195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa0ea-f3ce-47af-9a44-3057eb1b3a7c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.300195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa0ea-f3ce-47af-9a44-3057eb1b3a7c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.300531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-338aa0ea-f3ce-47af-9a44-3057eb1b3a7c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.305738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 494/969] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:04.307016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34c96e-a049-460b-8023-6637e49529d7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.307303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34c96e-a049-460b-8023-6637e49529d7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.307577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc34c96e-a049-460b-8023-6637e49529d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.320766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59135-d9b7-48fe-8c83-f33a2caa08d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:04.321698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59135-d9b7-48fe-8c83-f33a2caa08d3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.322126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59135-d9b7-48fe-8c83-f33a2caa08d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.322557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e59135-d9b7-48fe-8c83-f33a2caa08d3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.327518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cc34c96e-a049-460b-8023-6637e49529d7 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:04.329125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cc34c96e-a049-460b-8023-6637e49529d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:04.331438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e59135-d9b7-48fe-8c83-f33a2caa08d3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:04.333045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e59135-d9b7-48fe-8c83-f33a2caa08d3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:04.335647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-93e59135-d9b7-48fe-8c83-f33a2caa08d3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:14:04.345565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:04.352026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 476/970] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 24 14:14:04 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:04.353218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59135-d9b7-48fe-8c83-f33a2caa08d3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:04.415733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 495/971] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:04 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:04.468289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e59135-d9b7-48fe-8c83-f33a2caa08d3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:04.515576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c66ea-4005-4a71-97cd-6a73f3439fe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:04.516612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c66ea-4005-4a71-97cd-6a73f3439fe0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.517098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c66ea-4005-4a71-97cd-6a73f3439fe0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.517571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029c66ea-4005-4a71-97cd-6a73f3439fe0 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.518494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c66ea-4005-4a71-97cd-6a73f3439fe0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:04.519024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c66ea-4005-4a71-97cd-6a73f3439fe0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:04.520685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029c66ea-4005-4a71-97cd-6a73f3439fe0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:04.539611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 477/972] 10.222.0.16 () {56 vars in 1149 bytes} [Sat Sep 24 14:14:04 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:04.545120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34c96e-a049-460b-8023-6637e49529d7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:04.578354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c66ea-4005-4a71-97cd-6a73f3439fe0 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:04.666620 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc34c96e-a049-460b-8023-6637e49529d7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:04.682004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029c66ea-4005-4a71-97cd-6a73f3439fe0 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:04.689138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:04.706325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:04.713355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a552440-ab07-4faa-9502-a8c1c2cad78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:04.714095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a552440-ab07-4faa-9502-a8c1c2cad78a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.714702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a552440-ab07-4faa-9502-a8c1c2cad78a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.714983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a552440-ab07-4faa-9502-a8c1c2cad78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.722145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:04.722752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.723037 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.723311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.724420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:04.725728 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:04.728483 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WARNING keystone.server.flask.common [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Sep 24 14:14:04.742679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.sql.core [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 14:14:04.742679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 14:14:04.742679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [parameters: {'user_id': 'cba96759e28e418398b802945939c3e0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 14:14:04.742679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81459) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application conn.query(q) Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result.read() Sep 24 14:14:04.758793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return method(*args, **kwargs) Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 14:14:04.759771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application next(self.gen) Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application yield resource Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application next(self.gen) Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.session.rollback() Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.force_reraise() Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise self.value Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application session.commit() Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Sep 24 14:14:04.766617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._prepare_impl() Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.session.flush() Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._flush(objects) Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application compat.raise_( Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application flush_context.execute() Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rec.execute(self) Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Sep 24 14:14:04.767537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application _emit_insert_statements( Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result = connection._execute_20( Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ret = self._execute_context( Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Sep 24 14:14:04.768484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self.dialect.do_execute( Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result = self._query(query) Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application conn.query(q) Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application result.read() Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Sep 24 14:14:04.769376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application packet.raise_for_error() Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [parameters: {'user_id': 'cba96759e28e418398b802945939c3e0', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:04.770243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Sep 24 14:14:04.771036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Sep 24 14:14:04.771960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Sep 24 14:14:04.771960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Sep 24 14:14:04.771960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Sep 24 14:14:04.771960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Sep 24 14:14:04.771960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Sep 24 14:14:04.771960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:04.771960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 478/973] 10.222.0.16 () {60 vars in 1131 bytes} [Sat Sep 24 14:14:04 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:04.771960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:04.805492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a552440-ab07-4faa-9502-a8c1c2cad78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:04.807046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a552440-ab07-4faa-9502-a8c1c2cad78a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:04.874948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae606b29-10d0-4082-8dc7-3e83f810f7b9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:04.898664 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:04.911554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 496/974] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:04 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:14:04.913078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a552440-ab07-4faa-9502-a8c1c2cad78a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:04.914360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fa32f9-23ee-46b8-912d-a20dc72ef4f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:04.914996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa32f9-23ee-46b8-912d-a20dc72ef4f0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.915281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa32f9-23ee-46b8-912d-a20dc72ef4f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.915561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fa32f9-23ee-46b8-912d-a20dc72ef4f0 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.916168 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa32f9-23ee-46b8-912d-a20dc72ef4f0 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:04.917803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fa32f9-23ee-46b8-912d-a20dc72ef4f0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-48fa32f9-23ee-46b8-912d-a20dc72ef4f0 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:04.926583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:04.927697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:04.928620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 479/975] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:14:04 2022] GET /identity/v3/services/object-store => generated 93 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:04.929450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4b688-73c4-4917-a988-f04fc7bd94b4 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:04.929450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4b688-73c4-4917-a988-f04fc7bd94b4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:04.929450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a4b688-73c4-4917-a988-f04fc7bd94b4 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:04.933450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 480/976] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:04.934152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4b688-73c4-4917-a988-f04fc7bd94b4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:04.936975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:05.017883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a552440-ab07-4faa-9502-a8c1c2cad78a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.035400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a4b688-73c4-4917-a988-f04fc7bd94b4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.051319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20383b98-9a92-499b-a2c4-5003bfe917dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.051936 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20383b98-9a92-499b-a2c4-5003bfe917dd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.052252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20383b98-9a92-499b-a2c4-5003bfe917dd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.052528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20383b98-9a92-499b-a2c4-5003bfe917dd None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.059301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20383b98-9a92-499b-a2c4-5003bfe917dd None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.061294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20383b98-9a92-499b-a2c4-5003bfe917dd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.067772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d3b606-d3dc-4bd2-b92b-da5246a26c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.068423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3b606-d3dc-4bd2-b92b-da5246a26c2e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.068707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3b606-d3dc-4bd2-b92b-da5246a26c2e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.068985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d3b606-d3dc-4bd2-b92b-da5246a26c2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-20383b98-9a92-499b-a2c4-5003bfe917dd None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:14:05.072485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:05.073442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 497/977] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:14:04 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:05.074465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20383b98-9a92-499b-a2c4-5003bfe917dd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:05.083018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3b606-d3dc-4bd2-b92b-da5246a26c2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.084515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d3b606-d3dc-4bd2-b92b-da5246a26c2e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-08d3b606-d3dc-4bd2-b92b-da5246a26c2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:05.099366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:05.100538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:14:05.101945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:05.101945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:05.101945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:05.101945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 481/978] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:05.102308 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5a973-859e-4994-a0b2-46b9fbbe0072 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.102308 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5a973-859e-4994-a0b2-46b9fbbe0072 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.102556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a5a973-859e-4994-a0b2-46b9fbbe0072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.120879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-30a5a973-859e-4994-a0b2-46b9fbbe0072 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:05.122405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-30a5a973-859e-4994-a0b2-46b9fbbe0072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:05.151392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:05.161850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:05.186366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20383b98-9a92-499b-a2c4-5003bfe917dd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.193508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 482/979] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:05 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:05.194365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5a973-859e-4994-a0b2-46b9fbbe0072 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:05.244601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017f0d-dd8f-4fd1-b31e-29031df53c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.245212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017f0d-dd8f-4fd1-b31e-29031df53c13 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.245494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017f0d-dd8f-4fd1-b31e-29031df53c13 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.245777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9017f0d-dd8f-4fd1-b31e-29031df53c13 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.246408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9017f0d-dd8f-4fd1-b31e-29031df53c13 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:05.246718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9017f0d-dd8f-4fd1-b31e-29031df53c13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.248080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9017f0d-dd8f-4fd1-b31e-29031df53c13 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.254134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 498/980] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 24 14:14:05 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:05.255666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017f0d-dd8f-4fd1-b31e-29031df53c13 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:05.296824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a5a973-859e-4994-a0b2-46b9fbbe0072 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.339682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663cc1-5b1d-45e4-86db-0b3ea5a29e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.341017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663cc1-5b1d-45e4-86db-0b3ea5a29e76 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.341758 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663cc1-5b1d-45e4-86db-0b3ea5a29e76 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.342329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61663cc1-5b1d-45e4-86db-0b3ea5a29e76 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.343508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663cc1-5b1d-45e4-86db-0b3ea5a29e76 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:05.344455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663cc1-5b1d-45e4-86db-0b3ea5a29e76 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.346591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61663cc1-5b1d-45e4-86db-0b3ea5a29e76 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.362493 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9017f0d-dd8f-4fd1-b31e-29031df53c13 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.401053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 483/981] 10.222.0.16 () {56 vars in 1101 bytes} [Sat Sep 24 14:14:05 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:05.401053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663cc1-5b1d-45e4-86db-0b3ea5a29e76 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:05.401361 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381d20f-7db2-40e6-b114-c13cc0e3ef0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.401361 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d20f-7db2-40e6-b114-c13cc0e3ef0f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.401361 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d20f-7db2-40e6-b114-c13cc0e3ef0f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.401361 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1381d20f-7db2-40e6-b114-c13cc0e3ef0f None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.401656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381d20f-7db2-40e6-b114-c13cc0e3ef0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:05.401656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381d20f-7db2-40e6-b114-c13cc0e3ef0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.403995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1381d20f-7db2-40e6-b114-c13cc0e3ef0f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.421483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 499/982] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:14:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:05.427893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381d20f-7db2-40e6-b114-c13cc0e3ef0f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:05.431636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:05.434829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:05.533685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61663cc1-5b1d-45e4-86db-0b3ea5a29e76 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.551869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1381d20f-7db2-40e6-b114-c13cc0e3ef0f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.572015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b01ea-8426-4c40-a3d8-ca40c673b130 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.572290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b01ea-8426-4c40-a3d8-ca40c673b130 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.572559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b01ea-8426-4c40-a3d8-ca40c673b130 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.572830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8b01ea-8426-4c40-a3d8-ca40c673b130 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.573461 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b01ea-8426-4c40-a3d8-ca40c673b130 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:05.573769 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b01ea-8426-4c40-a3d8-ca40c673b130 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.575146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8b01ea-8426-4c40-a3d8-ca40c673b130 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.581882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 484/983] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 24 14:14:05 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:05.583485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b01ea-8426-4c40-a3d8-ca40c673b130 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:05.590971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eb126-45bd-46f3-8e1c-6d279522aa02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.591622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eb126-45bd-46f3-8e1c-6d279522aa02 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.592222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eb126-45bd-46f3-8e1c-6d279522aa02 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.592331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a03eb126-45bd-46f3-8e1c-6d279522aa02 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.601194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03eb126-45bd-46f3-8e1c-6d279522aa02 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.602651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a03eb126-45bd-46f3-8e1c-6d279522aa02 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-a03eb126-45bd-46f3-8e1c-6d279522aa02 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:14:05.614798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:05.615737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:05.616722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:14:05.616722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:14:05.616722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:14:05.616722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:14:05.616722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:14:05.616722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:14:05.616722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:05.616722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:05.616722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 500/984] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:14:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:05.616722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eb126-45bd-46f3-8e1c-6d279522aa02 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:05.690530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:05.697375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:05.709431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8b01ea-8426-4c40-a3d8-ca40c673b130 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.730003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a03eb126-45bd-46f3-8e1c-6d279522aa02 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.742901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf9599-8dc4-4dba-a5b2-9fa3d19b2780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.743441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf9599-8dc4-4dba-a5b2-9fa3d19b2780 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.743727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf9599-8dc4-4dba-a5b2-9fa3d19b2780 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.743999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbf9599-8dc4-4dba-a5b2-9fa3d19b2780 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.744674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf9599-8dc4-4dba-a5b2-9fa3d19b2780 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.746048 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fbf9599-8dc4-4dba-a5b2-9fa3d19b2780 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.761600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 485/985] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:14:05 2022] POST /identity/v3/services => generated 242 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:14:05.762629 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf9599-8dc4-4dba-a5b2-9fa3d19b2780 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:05.777330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bb3a2-b6d4-4be8-b820-92c2225eb79f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.777957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb3a2-b6d4-4be8-b820-92c2225eb79f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.778335 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb3a2-b6d4-4be8-b820-92c2225eb79f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.778529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5bb3a2-b6d4-4be8-b820-92c2225eb79f None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.780062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bb3a2-b6d4-4be8-b820-92c2225eb79f None admin] RBAC: Adding query filter params (interface=admin, service_id=c09ca0a69e0d496892b5939a6df83256, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:05.780209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bb3a2-b6d4-4be8-b820-92c2225eb79f None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.781571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5bb3a2-b6d4-4be8-b820-92c2225eb79f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.787495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 501/986] 10.222.0.16 () {56 vars in 1249 bytes} [Sat Sep 24 14:14:05 2022] GET /identity/v3/endpoints?service_id=c09ca0a69e0d496892b5939a6df83256&interface=admin®ion_id=RegionOne => generated 193 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:05.793355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bb3a2-b6d4-4be8-b820-92c2225eb79f None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:05.878445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbf9599-8dc4-4dba-a5b2-9fa3d19b2780 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.909377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5bb3a2-b6d4-4be8-b820-92c2225eb79f None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:05.913955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3e0e-5f7f-4746-af91-e146ba9d2910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.914579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3e0e-5f7f-4746-af91-e146ba9d2910 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.914854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3e0e-5f7f-4746-af91-e146ba9d2910 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.915122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31de3e0e-5f7f-4746-af91-e146ba9d2910 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.915817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de3e0e-5f7f-4746-af91-e146ba9d2910 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:05.916119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de3e0e-5f7f-4746-af91-e146ba9d2910 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.917607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31de3e0e-5f7f-4746-af91-e146ba9d2910 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.932854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 486/987] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:14:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:05.933874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:05.939298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3e0e-5f7f-4746-af91-e146ba9d2910 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:05.948829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1d0ab9-3b5a-4475-8373-80b9239af02d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:05.949877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d0ab9-3b5a-4475-8373-80b9239af02d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:05.949877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d0ab9-3b5a-4475-8373-80b9239af02d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:05.950163 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1d0ab9-3b5a-4475-8373-80b9239af02d None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:05.950711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d0ab9-3b5a-4475-8373-80b9239af02d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:05.950837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:05.952222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1d0ab9-3b5a-4475-8373-80b9239af02d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:05.959040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 502/988] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 24 14:14:05 2022] GET /identity/v3/services => generated 1727 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:14:06.055271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31de3e0e-5f7f-4746-af91-e146ba9d2910 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:06.092314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9f01b8-78d8-40f6-8e84-98167edd652b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:06.092933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f01b8-78d8-40f6-8e84-98167edd652b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:06.093212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f01b8-78d8-40f6-8e84-98167edd652b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:06.093485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9f01b8-78d8-40f6-8e84-98167edd652b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:06.094212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f01b8-78d8-40f6-8e84-98167edd652b None admin] RBAC: Adding query filter params (role.id=f7cf85ae67814930bcd2ba2183fc5102, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=8af010ec8f3841a4b74907b13961e2b3) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:06.094521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f01b8-78d8-40f6-8e84-98167edd652b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:06.096008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9f01b8-78d8-40f6-8e84-98167edd652b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:06.103012 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 487/989] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:14:05 2022] GET /identity/v3/role_assignments?user.id=8af010ec8f3841a4b74907b13961e2b3&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=f7cf85ae67814930bcd2ba2183fc5102 => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:07.967234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69606914-beaf-4e09-bd3d-0916915ce542 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:07.967748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69606914-beaf-4e09-bd3d-0916915ce542 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:07.967825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69606914-beaf-4e09-bd3d-0916915ce542 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:07.969299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 503/990] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:07.974490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63abe1-f936-4105-9cae-92e0a32b78c1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:07.974862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63abe1-f936-4105-9cae-92e0a32b78c1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:07.975041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c63abe1-f936-4105-9cae-92e0a32b78c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:07.993502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2c63abe1-f936-4105-9cae-92e0a32b78c1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:07.994710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2c63abe1-f936-4105-9cae-92e0a32b78c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:08.067899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 488/991] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:07 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:08.131421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5afa1-916a-48f1-94ef-48fc337d4d86 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.131749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5afa1-916a-48f1-94ef-48fc337d4d86 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.131967 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b5afa1-916a-48f1-94ef-48fc337d4d86 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.133460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 504/992] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:08.138416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760491-cf14-4482-8a30-059bad7f60e0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.138757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760491-cf14-4482-8a30-059bad7f60e0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.139033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04760491-cf14-4482-8a30-059bad7f60e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.145354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:08.160393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-04760491-cf14-4482-8a30-059bad7f60e0 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:08.161607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-04760491-cf14-4482-8a30-059bad7f60e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:08.233393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 489/993] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:08.273918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f5460-4d03-4e1e-85dc-29223186600d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.274210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f5460-4d03-4e1e-85dc-29223186600d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.274478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-777f5460-4d03-4e1e-85dc-29223186600d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.275943 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 505/994] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:08.281054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f5457-6e18-486f-958d-885892bec8d3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.281346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f5457-6e18-486f-958d-885892bec8d3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.281624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f5457-6e18-486f-958d-885892bec8d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.299744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-449f5457-6e18-486f-958d-885892bec8d3 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:08.300959 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-449f5457-6e18-486f-958d-885892bec8d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:08.339827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f5460-4d03-4e1e-85dc-29223186600d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:08.370552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 490/995] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:08 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:08.443323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-777f5460-4d03-4e1e-85dc-29223186600d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:08.489640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e52453-4330-41dc-b09e-55d6e099a883 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:08.490278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e52453-4330-41dc-b09e-55d6e099a883 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.490559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e52453-4330-41dc-b09e-55d6e099a883 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.490839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e52453-4330-41dc-b09e-55d6e099a883 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.491427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e52453-4330-41dc-b09e-55d6e099a883 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:08.492827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e52453-4330-41dc-b09e-55d6e099a883 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:08.496538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f5457-6e18-486f-958d-885892bec8d3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-70e52453-4330-41dc-b09e-55d6e099a883 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:08.502265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:08.503316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 14:14:08.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:08.508268 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 506/996] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:14:08 2022] GET /identity/v3/services/compute => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:08.509093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e52453-4330-41dc-b09e-55d6e099a883 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:08.561418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:08.563098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:08.603096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f5457-6e18-486f-958d-885892bec8d3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:08.618444 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e52453-4330-41dc-b09e-55d6e099a883 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:08.639520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332d9da-c64a-4ba0-a60c-a5e5f2b40b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:08.640173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d9da-c64a-4ba0-a60c-a5e5f2b40b91 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.640452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d9da-c64a-4ba0-a60c-a5e5f2b40b91 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.640724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6332d9da-c64a-4ba0-a60c-a5e5f2b40b91 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.641298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332d9da-c64a-4ba0-a60c-a5e5f2b40b91 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:08.642662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6332d9da-c64a-4ba0-a60c-a5e5f2b40b91 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6332d9da-c64a-4ba0-a60c-a5e5f2b40b91 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:08.651173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:08.652258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:08.653156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 491/997] 10.222.0.16 () {56 vars in 1126 bytes} [Sat Sep 24 14:14:08 2022] GET /identity/v3/services/object-store => generated 93 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:08.653975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173126f-3691-4a39-8f6e-9e0705f69db6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:08.654317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173126f-3691-4a39-8f6e-9e0705f69db6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.655102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173126f-3691-4a39-8f6e-9e0705f69db6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.655378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c173126f-3691-4a39-8f6e-9e0705f69db6 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.655880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332d9da-c64a-4ba0-a60c-a5e5f2b40b91 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:08.655998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173126f-3691-4a39-8f6e-9e0705f69db6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:08.656334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173126f-3691-4a39-8f6e-9e0705f69db6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:08.657759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c173126f-3691-4a39-8f6e-9e0705f69db6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:08.666924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 507/998] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:14:08 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:08.666924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173126f-3691-4a39-8f6e-9e0705f69db6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:08.755181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6332d9da-c64a-4ba0-a60c-a5e5f2b40b91 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:08.762758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c173126f-3691-4a39-8f6e-9e0705f69db6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:08.777121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:08.780378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:08.789927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8421275-54c3-41a2-9293-ba3e7e6c96e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:08.790583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8421275-54c3-41a2-9293-ba3e7e6c96e6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.790867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8421275-54c3-41a2-9293-ba3e7e6c96e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.791141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8421275-54c3-41a2-9293-ba3e7e6c96e6 None admin] PATH_INFO: `/v3/services/image` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.791725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8421275-54c3-41a2-9293-ba3e7e6c96e6 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:08.793957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8421275-54c3-41a2-9293-ba3e7e6c96e6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:08.799514 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c37ad-3d2e-473c-9e4a-6a168baaaf58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:08.800107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c37ad-3d2e-473c-9e4a-6a168baaaf58 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.800412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c37ad-3d2e-473c-9e4a-6a168baaaf58 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.800684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915c37ad-3d2e-473c-9e4a-6a168baaaf58 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.801301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c37ad-3d2e-473c-9e4a-6a168baaaf58 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:08.801601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c37ad-3d2e-473c-9e4a-6a168baaaf58 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-f8421275-54c3-41a2-9293-ba3e7e6c96e6 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:08.801800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:08.802903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 14:14:08.804130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:08.805180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915c37ad-3d2e-473c-9e4a-6a168baaaf58 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:08.805268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 492/999] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Sep 24 14:14:08 2022] GET /identity/v3/services/image => generated 86 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:08.805268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8421275-54c3-41a2-9293-ba3e7e6c96e6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:08.812204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 508/1000] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 24 14:14:08 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:08.812986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c37ad-3d2e-473c-9e4a-6a168baaaf58 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:08.905033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8421275-54c3-41a2-9293-ba3e7e6c96e6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:08.910387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915c37ad-3d2e-473c-9e4a-6a168baaaf58 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:08.940251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c94ce-03de-46a4-97af-6c92bddd2a15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:08.940855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c94ce-03de-46a4-97af-6c92bddd2a15 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.941138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c94ce-03de-46a4-97af-6c92bddd2a15 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.941413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c94ce-03de-46a4-97af-6c92bddd2a15 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.942039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c94ce-03de-46a4-97af-6c92bddd2a15 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:08.942363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c94ce-03de-46a4-97af-6c92bddd2a15 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:08.943728 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c94ce-03de-46a4-97af-6c92bddd2a15 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:08.943829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cadcc5-0ebf-406e-959e-527848671f48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:08.944349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cadcc5-0ebf-406e-959e-527848671f48 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:08.944627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cadcc5-0ebf-406e-959e-527848671f48 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:08.945049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cadcc5-0ebf-406e-959e-527848671f48 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:08.945972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cadcc5-0ebf-406e-959e-527848671f48 None admin] RBAC: Adding query filter params (name=image) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:08.946280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cadcc5-0ebf-406e-959e-527848671f48 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:08.947610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cadcc5-0ebf-406e-959e-527848671f48 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:08.948815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 493/1001] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:14:08 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:08.949260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c94ce-03de-46a4-97af-6c92bddd2a15 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:08.952561 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 509/1002] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:08 2022] GET /identity/v3/services?name=image => generated 122 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:08.954276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cadcc5-0ebf-406e-959e-527848671f48 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:09.000622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:09.007655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:09.053326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c94ce-03de-46a4-97af-6c92bddd2a15 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:09.058072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cadcc5-0ebf-406e-959e-527848671f48 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:09.086215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb64c1-29de-42ec-930f-f1598e40ccea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:09.086811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb64c1-29de-42ec-930f-f1598e40ccea None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:09.087086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb64c1-29de-42ec-930f-f1598e40ccea None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:09.087357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1cb64c1-29de-42ec-930f-f1598e40ccea None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:09.088035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb64c1-29de-42ec-930f-f1598e40ccea None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:09.088309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb64c1-29de-42ec-930f-f1598e40ccea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:09.089670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1cb64c1-29de-42ec-930f-f1598e40ccea None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:09.091372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39139-4e07-47ff-a27d-2579e9376955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:09.092539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39139-4e07-47ff-a27d-2579e9376955 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:09.092821 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39139-4e07-47ff-a27d-2579e9376955 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:09.093102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26a39139-4e07-47ff-a27d-2579e9376955 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:09.093791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a39139-4e07-47ff-a27d-2579e9376955 None admin] RBAC: Adding query filter params (interface=public, service_id=027a002949f74cc1aa6a54069f7bb197, region_id=RegionOne) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:09.094103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a39139-4e07-47ff-a27d-2579e9376955 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:09.094986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 494/1003] 10.222.0.16 () {56 vars in 1122 bytes} [Sat Sep 24 14:14:08 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:09.095449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26a39139-4e07-47ff-a27d-2579e9376955 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:09.095736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb64c1-29de-42ec-930f-f1598e40ccea None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:09.105394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 510/1004] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 24 14:14:08 2022] GET /identity/v3/endpoints?service_id=027a002949f74cc1aa6a54069f7bb197&interface=public®ion_id=RegionOne => generated 194 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:09.105394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39139-4e07-47ff-a27d-2579e9376955 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:09.195233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1cb64c1-29de-42ec-930f-f1598e40ccea None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:09.200955 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26a39139-4e07-47ff-a27d-2579e9376955 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:09.208315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:09.212426 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:09.232015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e196f6-c9dc-4f5c-8a7e-00ec409b3426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:09.233178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e196f6-c9dc-4f5c-8a7e-00ec409b3426 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:09.233456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e196f6-c9dc-4f5c-8a7e-00ec409b3426 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:09.233729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e196f6-c9dc-4f5c-8a7e-00ec409b3426 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:09.234359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e196f6-c9dc-4f5c-8a7e-00ec409b3426 None admin] RBAC: Adding query filter params (type=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:09.234691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e196f6-c9dc-4f5c-8a7e-00ec409b3426 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:09.236068 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e196f6-c9dc-4f5c-8a7e-00ec409b3426 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:09.238808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31a31d6-b545-4426-9ae4-d304ab9ae409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:09.239411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a31d6-b545-4426-9ae4-d304ab9ae409 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:09.239694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a31d6-b545-4426-9ae4-d304ab9ae409 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:09.239972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31a31d6-b545-4426-9ae4-d304ab9ae409 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:09.240414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 495/1005] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:09 2022] GET /identity/v3/services?type=image => generated 122 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:09.240680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a31d6-b545-4426-9ae4-d304ab9ae409 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:09.241172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e196f6-c9dc-4f5c-8a7e-00ec409b3426 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:09.242036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b31a31d6-b545-4426-9ae4-d304ab9ae409 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:09.262304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 511/1006] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:14:09 2022] POST /identity/v3/endpoints => generated 325 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:14:09.370017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e196f6-c9dc-4f5c-8a7e-00ec409b3426 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:09.416053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e353d64d-4816-419e-8877-116bda5b5350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:09.416715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353d64d-4816-419e-8877-116bda5b5350 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:09.416997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353d64d-4816-419e-8877-116bda5b5350 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:09.417270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e353d64d-4816-419e-8877-116bda5b5350 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:09.417884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353d64d-4816-419e-8877-116bda5b5350 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:09.419334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e353d64d-4816-419e-8877-116bda5b5350 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:09.427106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 496/1007] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 24 14:14:09 2022] GET /identity/v3/services => generated 1727 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:14:11.415948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ed9ab-6230-4c75-8458-950774a68280 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:11.419259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ed9ab-6230-4c75-8458-950774a68280 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:11.419259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-293ed9ab-6230-4c75-8458-950774a68280 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:11.419259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 512/1008] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:11.423312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802762-2856-41c7-afe2-7298bcee652b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:11.423817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802762-2856-41c7-afe2-7298bcee652b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:11.423983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0802762-2856-41c7-afe2-7298bcee652b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:11.442283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b0802762-2856-41c7-afe2-7298bcee652b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:11.443461 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b0802762-2856-41c7-afe2-7298bcee652b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:11.464445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3cef-e049-4a07-8cb4-97cd869b0a33 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:11.464791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3cef-e049-4a07-8cb4-97cd869b0a33 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:11.465031 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f41c3cef-e049-4a07-8cb4-97cd869b0a33 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:11.466396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 513/1009] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:14:11.473088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f60f-e3d8-45f9-bff5-48e70169d8f6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:11.473683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f60f-e3d8-45f9-bff5-48e70169d8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:11.474395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f60f-e3d8-45f9-bff5-48e70169d8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:11.493234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3548f60f-e3d8-45f9-bff5-48e70169d8f6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:11.494415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3548f60f-e3d8-45f9-bff5-48e70169d8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:11.494937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:11.528407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 497/1010] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:11 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:11.572338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 514/1011] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:11 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:11.579198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99ff99-7086-44de-91ee-630ae81b0d8d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:11.579489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99ff99-7086-44de-91ee-630ae81b0d8d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:11.579772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e99ff99-7086-44de-91ee-630ae81b0d8d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:11.581280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 498/1012] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:11.586408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3cbd-7e60-4c85-83f1-884e6b27cf60 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:11.586921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3cbd-7e60-4c85-83f1-884e6b27cf60 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:11.587388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7d3cbd-7e60-4c85-83f1-884e6b27cf60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:11.605450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-de7d3cbd-7e60-4c85-83f1-884e6b27cf60 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:11.606882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-de7d3cbd-7e60-4c85-83f1-884e6b27cf60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:11.673929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 515/1013] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:11 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:11.791377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99ff99-7086-44de-91ee-630ae81b0d8d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:11.839107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d3cbd-7e60-4c85-83f1-884e6b27cf60 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:11.866953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:11.894054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e99ff99-7086-44de-91ee-630ae81b0d8d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:11.929763 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f78bf3-46ee-4c2d-8bf8-27963a6024e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:11.930287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78bf3-46ee-4c2d-8bf8-27963a6024e2 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:11.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78bf3-46ee-4c2d-8bf8-27963a6024e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:11.930858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f78bf3-46ee-4c2d-8bf8-27963a6024e2 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:11.931522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f78bf3-46ee-4c2d-8bf8-27963a6024e2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:11.932917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f78bf3-46ee-4c2d-8bf8-27963a6024e2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:11.947680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7d3cbd-7e60-4c85-83f1-884e6b27cf60 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:11.949530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 499/1014] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:14:11 2022] POST /identity/v3/services => generated 242 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:14:11.950327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f78bf3-46ee-4c2d-8bf8-27963a6024e2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:11.990947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:11.992659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0d3f7-c2c0-4c0a-9984-0914ce0507e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:11.993350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0d3f7-c2c0-4c0a-9984-0914ce0507e1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:11.993657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0d3f7-c2c0-4c0a-9984-0914ce0507e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:11.993929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a0d3f7-c2c0-4c0a-9984-0914ce0507e1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:11.995336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0d3f7-c2c0-4c0a-9984-0914ce0507e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:11.997423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a0d3f7-c2c0-4c0a-9984-0914ce0507e1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:11.999366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 516/1015] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:12.005482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0d3f7-c2c0-4c0a-9984-0914ce0507e1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:12.074804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f78bf3-46ee-4c2d-8bf8-27963a6024e2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:12.103313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:12.113795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a0d3f7-c2c0-4c0a-9984-0914ce0507e1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:12.116796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb0dad-3f17-415a-b84e-f8e64b2c0915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:12.117448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb0dad-3f17-415a-b84e-f8e64b2c0915 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:12.117732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb0dad-3f17-415a-b84e-f8e64b2c0915 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:12.118011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9bb0dad-3f17-415a-b84e-f8e64b2c0915 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:12.118608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb0dad-3f17-415a-b84e-f8e64b2c0915 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:12.119992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9bb0dad-3f17-415a-b84e-f8e64b2c0915 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b9bb0dad-3f17-415a-b84e-f8e64b2c0915 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:12.129939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:12.131144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:12.132103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 500/1016] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:14:11 2022] GET /identity/v3/services/compute => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:12.136595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb0dad-3f17-415a-b84e-f8e64b2c0915 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:12.158680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537615-2549-463c-b0b9-5419c0c0be0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:12.159295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537615-2549-463c-b0b9-5419c0c0be0d None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:12.159580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537615-2549-463c-b0b9-5419c0c0be0d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:12.159854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a537615-2549-463c-b0b9-5419c0c0be0d None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:12.160978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a537615-2549-463c-b0b9-5419c0c0be0d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:12.162412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a537615-2549-463c-b0b9-5419c0c0be0d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:12.194433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 517/1017] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:14:12 2022] POST /identity/v3/projects => generated 311 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:14:12.245628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:12.253560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9bb0dad-3f17-415a-b84e-f8e64b2c0915 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:12.291875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91a824-787a-4d33-bf8a-1aaf3d11bc36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:12.292573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91a824-787a-4d33-bf8a-1aaf3d11bc36 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:12.292851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91a824-787a-4d33-bf8a-1aaf3d11bc36 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:12.293119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae91a824-787a-4d33-bf8a-1aaf3d11bc36 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:12.293749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91a824-787a-4d33-bf8a-1aaf3d11bc36 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:12.294050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91a824-787a-4d33-bf8a-1aaf3d11bc36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:12.295525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae91a824-787a-4d33-bf8a-1aaf3d11bc36 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:12.305720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 501/1018] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:14:12 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:12.307436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537615-2549-463c-b0b9-5419c0c0be0d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:12.414159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a537615-2549-463c-b0b9-5419c0c0be0d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:12.449134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d5886b-6be0-4d42-8c86-d9ac3f15282f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:12.449753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5886b-6be0-4d42-8c86-d9ac3f15282f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:12.450001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5886b-6be0-4d42-8c86-d9ac3f15282f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:12.450189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d5886b-6be0-4d42-8c86-d9ac3f15282f None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:12.450818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5886b-6be0-4d42-8c86-d9ac3f15282f None admin] RBAC: Adding query filter params (type=compute) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:12.451149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5886b-6be0-4d42-8c86-d9ac3f15282f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:12.452537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d5886b-6be0-4d42-8c86-d9ac3f15282f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:12.457722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 518/1019] 10.222.0.16 () {56 vars in 1112 bytes} [Sat Sep 24 14:14:12 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:12.463592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91a824-787a-4d33-bf8a-1aaf3d11bc36 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:12.576538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae91a824-787a-4d33-bf8a-1aaf3d11bc36 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:12.610610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3337e6d5-b756-4599-a37f-81212a2107f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:12.611232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337e6d5-b756-4599-a37f-81212a2107f2 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:12.611498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337e6d5-b756-4599-a37f-81212a2107f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:12.611771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3337e6d5-b756-4599-a37f-81212a2107f2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:12.612461 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337e6d5-b756-4599-a37f-81212a2107f2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:12.613835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3337e6d5-b756-4599-a37f-81212a2107f2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:12.633450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 502/1020] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:14:12 2022] POST /identity/v3/endpoints => generated 334 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:14:14.147142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ca90a-42ec-4604-9496-5b103f073bb2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:14.147685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ca90a-42ec-4604-9496-5b103f073bb2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:14.147685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59ca90a-42ec-4604-9496-5b103f073bb2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:14.149215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 519/1021] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:14.154196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee7b9-4ef0-4abf-be95-d27d413afd2d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:14.154605 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee7b9-4ef0-4abf-be95-d27d413afd2d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:14.154835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cee7b9-4ef0-4abf-be95-d27d413afd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:14.173040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-02cee7b9-4ef0-4abf-be95-d27d413afd2d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:14.174226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02cee7b9-4ef0-4abf-be95-d27d413afd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:14.185945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:14.253493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 503/1022] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:14.434209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278c05a-e3bf-4265-982e-4edac788c553 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:14.434409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278c05a-e3bf-4265-982e-4edac788c553 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:14.434676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6278c05a-e3bf-4265-982e-4edac788c553 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:14.436741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 520/1023] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:14.441733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cd76d-f098-40e3-b166-4142704c72b2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:14.442025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cd76d-f098-40e3-b166-4142704c72b2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:14.442303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-829cd76d-f098-40e3-b166-4142704c72b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:14.460265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-829cd76d-f098-40e3-b166-4142704c72b2 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:14.461442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-829cd76d-f098-40e3-b166-4142704c72b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:14.526490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278c05a-e3bf-4265-982e-4edac788c553 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:14.533230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 504/1024] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:14.536186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:14.633044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6278c05a-e3bf-4265-982e-4edac788c553 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:14.668062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b352f3c-0cac-4fbe-b67f-b6e67976f57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:14.668709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b352f3c-0cac-4fbe-b67f-b6e67976f57d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:14.668983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b352f3c-0cac-4fbe-b67f-b6e67976f57d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:14.669257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b352f3c-0cac-4fbe-b67f-b6e67976f57d None admin] PATH_INFO: `/v3/services/image` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:14.669869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b352f3c-0cac-4fbe-b67f-b6e67976f57d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:14.671215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b352f3c-0cac-4fbe-b67f-b6e67976f57d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2b352f3c-0cac-4fbe-b67f-b6e67976f57d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:14.680430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:14.681450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:14.685374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 521/1025] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Sep 24 14:14:14 2022] GET /identity/v3/services/image => generated 86 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:14.687528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cd76d-f098-40e3-b166-4142704c72b2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:14.757515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:14.789757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-829cd76d-f098-40e3-b166-4142704c72b2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:14.806220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b352f3c-0cac-4fbe-b67f-b6e67976f57d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:14.828033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe57469-f956-4d5f-adbf-ebaedacff4d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:14.828905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe57469-f956-4d5f-adbf-ebaedacff4d3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:14.829301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe57469-f956-4d5f-adbf-ebaedacff4d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:14.829709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe57469-f956-4d5f-adbf-ebaedacff4d3 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:14.830635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe57469-f956-4d5f-adbf-ebaedacff4d3 None admin] RBAC: Adding query filter params (name=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:14.831082 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe57469-f956-4d5f-adbf-ebaedacff4d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:14.832922 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe57469-f956-4d5f-adbf-ebaedacff4d3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:14.837975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 505/1026] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:14 2022] GET /identity/v3/services?name=image => generated 122 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:14.843936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe57469-f956-4d5f-adbf-ebaedacff4d3 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:14.882913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:14.917257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b352f3c-0cac-4fbe-b67f-b6e67976f57d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:14.944541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe57469-f956-4d5f-adbf-ebaedacff4d3 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:14.949476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054ba542-476f-4671-81e5-c53b9432296f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:14.950120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ba542-476f-4671-81e5-c53b9432296f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:14.950395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ba542-476f-4671-81e5-c53b9432296f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:14.950660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054ba542-476f-4671-81e5-c53b9432296f None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:14.952329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ba542-476f-4671-81e5-c53b9432296f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:14.953747 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054ba542-476f-4671-81e5-c53b9432296f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:14.955323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 522/1027] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:14.957053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea182-be29-47b1-847e-08676b973d11 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:14.957053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea182-be29-47b1-847e-08676b973d11 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:14.957053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a8ea182-be29-47b1-847e-08676b973d11 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:14.962274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 523/1028] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:14 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:14.962274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ea182-be29-47b1-847e-08676b973d11 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:14.985625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a489f469-9a1b-4361-b9bf-eb29b88f3020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:14.986233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f469-9a1b-4361-b9bf-eb29b88f3020 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:14.986510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f469-9a1b-4361-b9bf-eb29b88f3020 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:14.986778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a489f469-9a1b-4361-b9bf-eb29b88f3020 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:14.987390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489f469-9a1b-4361-b9bf-eb29b88f3020 None admin] RBAC: Adding query filter params (type=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:14.987691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489f469-9a1b-4361-b9bf-eb29b88f3020 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:14.989084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a489f469-9a1b-4361-b9bf-eb29b88f3020 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:14.991089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:14.999291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 506/1029] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:14 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:15.000400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72ced1-4042-493c-a7d7-662fc0b208f9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:15.000680 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72ced1-4042-493c-a7d7-662fc0b208f9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:15.000950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf72ced1-4042-493c-a7d7-662fc0b208f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:15.018301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bf72ced1-4042-493c-a7d7-662fc0b208f9 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:15.019468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bf72ced1-4042-493c-a7d7-662fc0b208f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:15.061293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a8ea182-be29-47b1-847e-08676b973d11 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:15.084485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 507/1030] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:14 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:15.085293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72ced1-4042-493c-a7d7-662fc0b208f9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:15.094612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81855a-e4b7-464d-8e83-2f6d7b5bf557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:15.095210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81855a-e4b7-464d-8e83-2f6d7b5bf557 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:15.095489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81855a-e4b7-464d-8e83-2f6d7b5bf557 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:15.095760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d81855a-e4b7-464d-8e83-2f6d7b5bf557 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:15.096438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81855a-e4b7-464d-8e83-2f6d7b5bf557 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:15.097860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d81855a-e4b7-464d-8e83-2f6d7b5bf557 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:15.109298 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:15.123999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 524/1031] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:14:14 2022] POST /identity/v3/users => generated 285 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:14:15.197424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf72ced1-4042-493c-a7d7-662fc0b208f9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:15.229539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:15.236040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3da86f-6d49-4ce1-a392-d71bcb3c3c69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:15.236693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3da86f-6d49-4ce1-a392-d71bcb3c3c69 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:15.236971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3da86f-6d49-4ce1-a392-d71bcb3c3c69 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:15.237239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3da86f-6d49-4ce1-a392-d71bcb3c3c69 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:15.237940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3da86f-6d49-4ce1-a392-d71bcb3c3c69 None admin] RBAC: Adding query filter params (interface=public, service_id=2917824cc35746d280fd257769c3b6a9, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:15.238245 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3da86f-6d49-4ce1-a392-d71bcb3c3c69 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:15.239624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3da86f-6d49-4ce1-a392-d71bcb3c3c69 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:15.245641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 508/1032] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 24 14:14:15 2022] GET /identity/v3/endpoints?service_id=2917824cc35746d280fd257769c3b6a9&interface=public®ion_id=RegionOne => generated 194 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:15.252027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81855a-e4b7-464d-8e83-2f6d7b5bf557 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:15.361736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d81855a-e4b7-464d-8e83-2f6d7b5bf557 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:15.363987 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3da86f-6d49-4ce1-a392-d71bcb3c3c69 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:15.404606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a5f68-033e-4b69-bdad-fc7c0bf1d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:15.405218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5f68-033e-4b69-bdad-fc7c0bf1d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:15.405497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5f68-033e-4b69-bdad-fc7c0bf1d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:15.405768 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183a5f68-033e-4b69-bdad-fc7c0bf1d3d8 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:15.406368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a5f68-033e-4b69-bdad-fc7c0bf1d3d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:15.407731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183a5f68-033e-4b69-bdad-fc7c0bf1d3d8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:15.414389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 525/1033] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 24 14:14:15 2022] GET /identity/v3/services => generated 1957 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:14:15.489397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3da86f-6d49-4ce1-a392-d71bcb3c3c69 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:15.527538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2977f8-7488-49ef-a5db-4f2f2f32b202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:15.528657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2977f8-7488-49ef-a5db-4f2f2f32b202 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:15.529692 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2977f8-7488-49ef-a5db-4f2f2f32b202 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:15.530177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2977f8-7488-49ef-a5db-4f2f2f32b202 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:15.542444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2977f8-7488-49ef-a5db-4f2f2f32b202 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5d2977f8-7488-49ef-a5db-4f2f2f32b202 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:14:15.548413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:15.549434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:14:15.550379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:15.553245 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 509/1034] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 24 14:14:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:15.559217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a5f68-033e-4b69-bdad-fc7c0bf1d3d8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:15.622476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:15.667333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183a5f68-033e-4b69-bdad-fc7c0bf1d3d8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:15.702544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32571e-8027-4736-bcd1-55c769a92720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:15.703158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32571e-8027-4736-bcd1-55c769a92720 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:15.703474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32571e-8027-4736-bcd1-55c769a92720 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:15.703717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c32571e-8027-4736-bcd1-55c769a92720 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:15.704375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32571e-8027-4736-bcd1-55c769a92720 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:15.704712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32571e-8027-4736-bcd1-55c769a92720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:15.706022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c32571e-8027-4736-bcd1-55c769a92720 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:15.714630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 526/1035] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 24 14:14:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:15.721252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2977f8-7488-49ef-a5db-4f2f2f32b202 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:15.780919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:15.827185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2977f8-7488-49ef-a5db-4f2f2f32b202 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:15.862102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba5ef1-d187-4ddd-8bc0-4502b344dd33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:15.862926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba5ef1-d187-4ddd-8bc0-4502b344dd33 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:15.863321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba5ef1-d187-4ddd-8bc0-4502b344dd33 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:15.863693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ba5ef1-d187-4ddd-8bc0-4502b344dd33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:15.877972 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba5ef1-d187-4ddd-8bc0-4502b344dd33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:15.880314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ba5ef1-d187-4ddd-8bc0-4502b344dd33 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b7ba5ef1-d187-4ddd-8bc0-4502b344dd33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:15.897905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:15.899109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:14:15.900280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:15.900280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:15.900280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:15.904571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 510/1036] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:15.907603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32571e-8027-4736-bcd1-55c769a92720 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:16.009252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c32571e-8027-4736-bcd1-55c769a92720 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:16.028982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:16.043654 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be2183-80a2-4112-b3ba-02132e3be14a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:16.044312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be2183-80a2-4112-b3ba-02132e3be14a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:16.044686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be2183-80a2-4112-b3ba-02132e3be14a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:16.045022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49be2183-80a2-4112-b3ba-02132e3be14a None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:16.045728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be2183-80a2-4112-b3ba-02132e3be14a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:16.046100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be2183-80a2-4112-b3ba-02132e3be14a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:16.047528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49be2183-80a2-4112-b3ba-02132e3be14a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:16.064990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 527/1037] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:14:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:16.066207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba5ef1-d187-4ddd-8bc0-4502b344dd33 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:16.167193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ba5ef1-d187-4ddd-8bc0-4502b344dd33 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:16.174099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:16.203671 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679f7c-5953-4d44-a6c4-6a2ef88ed1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:16.204359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679f7c-5953-4d44-a6c4-6a2ef88ed1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:16.204601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679f7c-5953-4d44-a6c4-6a2ef88ed1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:16.204852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b679f7c-5953-4d44-a6c4-6a2ef88ed1e9 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:16.212343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679f7c-5953-4d44-a6c4-6a2ef88ed1e9 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:16.213776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b679f7c-5953-4d44-a6c4-6a2ef88ed1e9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-9b679f7c-5953-4d44-a6c4-6a2ef88ed1e9 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:14:16.224910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:16.225995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:16.227782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 511/1038] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 24 14:14:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:16.231702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be2183-80a2-4112-b3ba-02132e3be14a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:16.334098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49be2183-80a2-4112-b3ba-02132e3be14a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:16.368328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d929-873a-490f-b2a8-18d9b6d86704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:16.368927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d929-873a-490f-b2a8-18d9b6d86704 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:16.369204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d929-873a-490f-b2a8-18d9b6d86704 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:16.369475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a4d929-873a-490f-b2a8-18d9b6d86704 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:16.370193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4d929-873a-490f-b2a8-18d9b6d86704 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:16.370499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4d929-873a-490f-b2a8-18d9b6d86704 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:16.371913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a4d929-873a-490f-b2a8-18d9b6d86704 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:16.389260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 528/1039] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 24 14:14:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:16.394756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679f7c-5953-4d44-a6c4-6a2ef88ed1e9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:16.500888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b679f7c-5953-4d44-a6c4-6a2ef88ed1e9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:16.535201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fe177-b3b1-4147-bcfc-b333f0659a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:16.535797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fe177-b3b1-4147-bcfc-b333f0659a42 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:16.536074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fe177-b3b1-4147-bcfc-b333f0659a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:16.536369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a66fe177-b3b1-4147-bcfc-b333f0659a42 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:16.571036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:16.605083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fe177-b3b1-4147-bcfc-b333f0659a42 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:16.606448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a66fe177-b3b1-4147-bcfc-b333f0659a42 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:16.706784 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 512/1040] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:16 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:14:16.707951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d929-873a-490f-b2a8-18d9b6d86704 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:16.749360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:16.809304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a4d929-873a-490f-b2a8-18d9b6d86704 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:16.844255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30a8e8-25fe-406c-8c9b-8e3806ad61db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:16.844878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a8e8-25fe-406c-8c9b-8e3806ad61db None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:16.845156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a8e8-25fe-406c-8c9b-8e3806ad61db None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:16.845426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec30a8e8-25fe-406c-8c9b-8e3806ad61db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:16.856538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30a8e8-25fe-406c-8c9b-8e3806ad61db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:16.858478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec30a8e8-25fe-406c-8c9b-8e3806ad61db None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-ec30a8e8-25fe-406c-8c9b-8e3806ad61db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:16.872641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:16.873606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:14:16.879467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:16.879467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:16.879467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:16.879467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 529/1041] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:16.879708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fe177-b3b1-4147-bcfc-b333f0659a42 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:16.942791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:16.978653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a66fe177-b3b1-4147-bcfc-b333f0659a42 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:17.012998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50477280-8761-4d92-ab38-65c6e477c14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:17.014162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50477280-8761-4d92-ab38-65c6e477c14e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:17.014434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50477280-8761-4d92-ab38-65c6e477c14e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:17.014696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50477280-8761-4d92-ab38-65c6e477c14e None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:17.015326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50477280-8761-4d92-ab38-65c6e477c14e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:17.015629 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50477280-8761-4d92-ab38-65c6e477c14e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:17.017010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50477280-8761-4d92-ab38-65c6e477c14e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:17.032782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 513/1042] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:14:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:17.034594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30a8e8-25fe-406c-8c9b-8e3806ad61db None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:17.129067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:17.140811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec30a8e8-25fe-406c-8c9b-8e3806ad61db None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:17.175767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfd82e-d7e1-48c5-aa8e-a64bb0354e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:17.176431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd82e-d7e1-48c5-aa8e-a64bb0354e3a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:17.176716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd82e-d7e1-48c5-aa8e-a64bb0354e3a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:17.176996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dbfd82e-d7e1-48c5-aa8e-a64bb0354e3a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:17.183806 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfd82e-d7e1-48c5-aa8e-a64bb0354e3a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:17.185849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dbfd82e-d7e1-48c5-aa8e-a64bb0354e3a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2dbfd82e-d7e1-48c5-aa8e-a64bb0354e3a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:14:17.197323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:17.198252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:17.199164 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:14:17.199164 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:14:17.199164 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:14:17.199164 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:14:17.199164 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:14:17.199164 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:14:17.199164 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:17.199164 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:17.200488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 530/1043] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:14:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:17.204291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50477280-8761-4d92-ab38-65c6e477c14e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:17.315125 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50477280-8761-4d92-ab38-65c6e477c14e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:17.339434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:17.349295 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-230470ea-0b81-4c6c-a382-0701a05ebabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:17.349899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230470ea-0b81-4c6c-a382-0701a05ebabd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:17.350172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230470ea-0b81-4c6c-a382-0701a05ebabd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:17.350438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-230470ea-0b81-4c6c-a382-0701a05ebabd None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:17.351119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230470ea-0b81-4c6c-a382-0701a05ebabd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:17.351422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230470ea-0b81-4c6c-a382-0701a05ebabd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:17.352887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-230470ea-0b81-4c6c-a382-0701a05ebabd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:17.365847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 514/1044] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:14:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:17.371631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfd82e-d7e1-48c5-aa8e-a64bb0354e3a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:17.382698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea8bf-2672-4f7a-814a-dcf05807771c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:17.382920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea8bf-2672-4f7a-814a-dcf05807771c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:17.383197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e98ea8bf-2672-4f7a-814a-dcf05807771c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:17.384691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 515/1045] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:17.389385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc6aac-012f-4f8d-91eb-89e8e9b31039 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:17.389660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc6aac-012f-4f8d-91eb-89e8e9b31039 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:17.389939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fc6aac-012f-4f8d-91eb-89e8e9b31039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:17.408660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-43fc6aac-012f-4f8d-91eb-89e8e9b31039 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:17.409840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-43fc6aac-012f-4f8d-91eb-89e8e9b31039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:17.488744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dbfd82e-d7e1-48c5-aa8e-a64bb0354e3a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:17.489193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 516/1046] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:17.526606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe85eb-8190-4515-b48b-20f2c4b82cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:17.527231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe85eb-8190-4515-b48b-20f2c4b82cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:17.527510 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe85eb-8190-4515-b48b-20f2c4b82cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:17.527782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe85eb-8190-4515-b48b-20f2c4b82cb6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:17.528556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe85eb-8190-4515-b48b-20f2c4b82cb6 None admin] RBAC: Adding query filter params (role.id=f7cf85ae67814930bcd2ba2183fc5102, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=758be68931aa49e5828bc2c164940571) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:17.529408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe85eb-8190-4515-b48b-20f2c4b82cb6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:17.530894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fe85eb-8190-4515-b48b-20f2c4b82cb6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:17.537479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 531/1047] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:14:17 2022] GET /identity/v3/role_assignments?user.id=758be68931aa49e5828bc2c164940571&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=f7cf85ae67814930bcd2ba2183fc5102 => generated 259 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:17.644810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a58d0-14c1-4990-8420-a263a6a242d3 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:17.645110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a58d0-14c1-4990-8420-a263a6a242d3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:17.645274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3a58d0-14c1-4990-8420-a263a6a242d3 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:17.646809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 517/1048] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:17.652424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6e58-be36-496a-9203-c12a4e1af96e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:17.652718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6e58-be36-496a-9203-c12a4e1af96e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:17.653002 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb1a6e58-be36-496a-9203-c12a4e1af96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:17.674109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fb1a6e58-be36-496a-9203-c12a4e1af96e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:17.675346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fb1a6e58-be36-496a-9203-c12a4e1af96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:17.686684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:17.751088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 532/1049] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:17 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:17.759703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a58d0-14c1-4990-8420-a263a6a242d3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:17.871175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3a58d0-14c1-4990-8420-a263a6a242d3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:17.888919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:17.908858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346329a-d816-4590-bf67-6cedd5760b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:17.909419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346329a-d816-4590-bf67-6cedd5760b0a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:17.909700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346329a-d816-4590-bf67-6cedd5760b0a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:17.909976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6346329a-d816-4590-bf67-6cedd5760b0a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:17.920875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6346329a-d816-4590-bf67-6cedd5760b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6346329a-d816-4590-bf67-6cedd5760b0a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:14:17.925725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:17.926696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:17.927581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:17.929148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 518/1050] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:14:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:17.932804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a6e58-be36-496a-9203-c12a4e1af96e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:18.017872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346329a-d816-4590-bf67-6cedd5760b0a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:18.037431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb1a6e58-be36-496a-9203-c12a4e1af96e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:18.076897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a293-c651-40f9-86bf-f7edb503daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:18.077618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a293-c651-40f9-86bf-f7edb503daf5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:18.077897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a293-c651-40f9-86bf-f7edb503daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:18.078170 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872a293-c651-40f9-86bf-f7edb503daf5 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:18.078830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a293-c651-40f9-86bf-f7edb503daf5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:18.079135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a293-c651-40f9-86bf-f7edb503daf5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:18.080665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872a293-c651-40f9-86bf-f7edb503daf5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:18.094328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 533/1051] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:14:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:18.095313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a293-c651-40f9-86bf-f7edb503daf5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:18.104588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:18.130259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6346329a-d816-4590-bf67-6cedd5760b0a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:18.167295 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f9866-4b57-4910-a2c6-7a5dc2d2a802 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:18.167852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f9866-4b57-4910-a2c6-7a5dc2d2a802 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:18.168129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f9866-4b57-4910-a2c6-7a5dc2d2a802 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:18.168443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f9866-4b57-4910-a2c6-7a5dc2d2a802 None admin] PATH_INFO: `/v3/services/image` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:18.169013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f9866-4b57-4910-a2c6-7a5dc2d2a802 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:18.170433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527f9866-4b57-4910-a2c6-7a5dc2d2a802 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-527f9866-4b57-4910-a2c6-7a5dc2d2a802 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:18.179389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:18.180476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:18.181351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 519/1052] 10.222.0.16 () {56 vars in 1105 bytes} [Sat Sep 24 14:14:18 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:18.186928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f9866-4b57-4910-a2c6-7a5dc2d2a802 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:18.206904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872a293-c651-40f9-86bf-f7edb503daf5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:18.232101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:18.244905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518babe9-68e3-4546-a28e-0f23abb1dac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:18.245544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518babe9-68e3-4546-a28e-0f23abb1dac2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:18.245833 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518babe9-68e3-4546-a28e-0f23abb1dac2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:18.246106 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518babe9-68e3-4546-a28e-0f23abb1dac2 None admin] PATH_INFO: `/v3/users/6002006b181d4671ad4e8690c388267d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:18.261055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518babe9-68e3-4546-a28e-0f23abb1dac2 None admin] RBAC: Authorizing `identity:get_user(user_id=6002006b181d4671ad4e8690c388267d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:18.262652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518babe9-68e3-4546-a28e-0f23abb1dac2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:18.265682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 534/1053] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:18 2022] GET /identity/v3/users/6002006b181d4671ad4e8690c388267d => generated 285 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:18.271274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518babe9-68e3-4546-a28e-0f23abb1dac2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:18.297527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f9866-4b57-4910-a2c6-7a5dc2d2a802 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:18.332906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1859b27-5cbd-440f-b5d0-69a5488741c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:18.333711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1859b27-5cbd-440f-b5d0-69a5488741c5 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:18.333903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1859b27-5cbd-440f-b5d0-69a5488741c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:18.334182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1859b27-5cbd-440f-b5d0-69a5488741c5 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:18.334808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1859b27-5cbd-440f-b5d0-69a5488741c5 None admin] RBAC: Adding query filter params (name=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:18.335116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1859b27-5cbd-440f-b5d0-69a5488741c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:18.336730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:18.337738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1859b27-5cbd-440f-b5d0-69a5488741c5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:18.344226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 520/1054] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:18 2022] GET /identity/v3/services?name=image => generated 122 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:18.349849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1859b27-5cbd-440f-b5d0-69a5488741c5 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:18.381260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518babe9-68e3-4546-a28e-0f23abb1dac2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:18.418958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260831b-c5e7-44d6-bd3e-3804f59d6ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:18.419985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260831b-c5e7-44d6-bd3e-3804f59d6ba8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:18.420299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260831b-c5e7-44d6-bd3e-3804f59d6ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:18.420577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4260831b-c5e7-44d6-bd3e-3804f59d6ba8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:18.452992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1859b27-5cbd-440f-b5d0-69a5488741c5 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:18.455305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:18.495236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68a27c-8f4c-4fd6-9971-176db18f5e94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:18.495849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68a27c-8f4c-4fd6-9971-176db18f5e94 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:18.496128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68a27c-8f4c-4fd6-9971-176db18f5e94 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:18.496587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c68a27c-8f4c-4fd6-9971-176db18f5e94 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:18.498381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68a27c-8f4c-4fd6-9971-176db18f5e94 None admin] RBAC: Adding query filter params (type=image) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:18.498696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68a27c-8f4c-4fd6-9971-176db18f5e94 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:18.500010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260831b-c5e7-44d6-bd3e-3804f59d6ba8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:18.500118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c68a27c-8f4c-4fd6-9971-176db18f5e94 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:18.501600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4260831b-c5e7-44d6-bd3e-3804f59d6ba8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:18.505055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 521/1055] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:18 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:18.510481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68a27c-8f4c-4fd6-9971-176db18f5e94 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:18.571251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:18.612720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c68a27c-8f4c-4fd6-9971-176db18f5e94 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:18.620492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 535/1056] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:18 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 14:14:18.621857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260831b-c5e7-44d6-bd3e-3804f59d6ba8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:18.655251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2c52a-ca43-4526-b842-f76843e0aacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:18.655866 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2c52a-ca43-4526-b842-f76843e0aacd None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:18.656146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2c52a-ca43-4526-b842-f76843e0aacd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:18.656541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c2c52a-ca43-4526-b842-f76843e0aacd None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:18.657173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2c52a-ca43-4526-b842-f76843e0aacd None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:18.658597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c2c52a-ca43-4526-b842-f76843e0aacd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:18.680875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 522/1057] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:14:18 2022] POST /identity/v3/endpoints => generated 327 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:14:18.739725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4260831b-c5e7-44d6-bd3e-3804f59d6ba8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:18.786024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aac130a-ebcf-437e-924d-afe335006c6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:18.786718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac130a-ebcf-437e-924d-afe335006c6e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:18.787003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac130a-ebcf-437e-924d-afe335006c6e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:18.787279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aac130a-ebcf-437e-924d-afe335006c6e None admin] PATH_INFO: `/v3/projects/0f811338be6a46acbd513d5740aea447` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:18.788522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac130a-ebcf-437e-924d-afe335006c6e None admin] RBAC: Authorizing `identity:get_project(project_id=0f811338be6a46acbd513d5740aea447)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:18.789969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6aac130a-ebcf-437e-924d-afe335006c6e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:18.796872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 536/1058] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:14:18 2022] GET /identity/v3/projects/0f811338be6a46acbd513d5740aea447 => generated 311 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:18.798617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2c52a-ca43-4526-b842-f76843e0aacd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:18.828075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:18.919515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c2c52a-ca43-4526-b842-f76843e0aacd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:18.953781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b441928a-6b61-48bb-83de-f8629710c56b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:18.954303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441928a-6b61-48bb-83de-f8629710c56b None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:18.954585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441928a-6b61-48bb-83de-f8629710c56b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:18.954860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b441928a-6b61-48bb-83de-f8629710c56b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:18.955576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441928a-6b61-48bb-83de-f8629710c56b None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=0f811338be6a46acbd513d5740aea447, user.id=6002006b181d4671ad4e8690c388267d) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:18.955889 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441928a-6b61-48bb-83de-f8629710c56b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:18.957351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b441928a-6b61-48bb-83de-f8629710c56b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:18.968231 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 523/1059] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:14:18 2022] GET /identity/v3/role_assignments?user.id=6002006b181d4671ad4e8690c388267d&scope.project.id=0f811338be6a46acbd513d5740aea447&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:19.669366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97177819-c574-4e72-98f0-4715b1061d89 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:19.669891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97177819-c574-4e72-98f0-4715b1061d89 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:19.669891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97177819-c574-4e72-98f0-4715b1061d89 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:19.671397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 537/1060] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:19.676272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd10e26-437e-43f1-befa-17665d3547cd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:19.676662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd10e26-437e-43f1-befa-17665d3547cd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:19.676835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd10e26-437e-43f1-befa-17665d3547cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:19.695062 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7dd10e26-437e-43f1-befa-17665d3547cd None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:19.696260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7dd10e26-437e-43f1-befa-17665d3547cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:19.762960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 524/1061] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:20.027853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97177819-c574-4e72-98f0-4715b1061d89 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:20.056570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:20.128878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97177819-c574-4e72-98f0-4715b1061d89 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:20.162627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2ed6a-4aeb-4d17-9ba3-78916def484b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:20.163245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2ed6a-4aeb-4d17-9ba3-78916def484b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:20.163520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2ed6a-4aeb-4d17-9ba3-78916def484b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:20.163779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f2ed6a-4aeb-4d17-9ba3-78916def484b None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:20.173671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f2ed6a-4aeb-4d17-9ba3-78916def484b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-d0f2ed6a-4aeb-4d17-9ba3-78916def484b None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:14:20.178364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:20.179305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:14:20.180207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:20.184637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 538/1062] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 24 14:14:20 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:20.188119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd10e26-437e-43f1-befa-17665d3547cd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:20.208254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:20.293120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd10e26-437e-43f1-befa-17665d3547cd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:20.326725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1cff-4873-466b-ae68-0d8437717598 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:20.327335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1cff-4873-466b-ae68-0d8437717598 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:20.327616 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1cff-4873-466b-ae68-0d8437717598 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:20.327892 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17b1cff-4873-466b-ae68-0d8437717598 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:20.328583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b1cff-4873-466b-ae68-0d8437717598 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:20.328893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b1cff-4873-466b-ae68-0d8437717598 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:20.330265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17b1cff-4873-466b-ae68-0d8437717598 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:20.343365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 525/1063] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 24 14:14:20 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:20.344780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2ed6a-4aeb-4d17-9ba3-78916def484b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:20.432730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:20.446715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f2ed6a-4aeb-4d17-9ba3-78916def484b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:20.489981 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e293d-3b31-4358-bb15-c7217bd6ed2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:20.490653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e293d-3b31-4358-bb15-c7217bd6ed2a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:20.490935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e293d-3b31-4358-bb15-c7217bd6ed2a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:20.491208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5e293d-3b31-4358-bb15-c7217bd6ed2a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:20.502326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e293d-3b31-4358-bb15-c7217bd6ed2a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:20.503781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5e293d-3b31-4358-bb15-c7217bd6ed2a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-8a5e293d-3b31-4358-bb15-c7217bd6ed2a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:20.518347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:20.519324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:14:20.525262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:20.525262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:20.525262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:20.525262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 539/1064] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:20.525505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1cff-4873-466b-ae68-0d8437717598 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:20.607873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:20.628726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17b1cff-4873-466b-ae68-0d8437717598 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:20.661987 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab730d-1bc9-4b9c-bdff-7003cec33a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:20.662592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab730d-1bc9-4b9c-bdff-7003cec33a6c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:20.662872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab730d-1bc9-4b9c-bdff-7003cec33a6c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:20.663148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3ab730d-1bc9-4b9c-bdff-7003cec33a6c None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:20.663787 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab730d-1bc9-4b9c-bdff-7003cec33a6c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:20.664091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab730d-1bc9-4b9c-bdff-7003cec33a6c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:20.665500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3ab730d-1bc9-4b9c-bdff-7003cec33a6c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:20.682238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 526/1065] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:14:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:20.683436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e293d-3b31-4358-bb15-c7217bd6ed2a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:20.788592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5e293d-3b31-4358-bb15-c7217bd6ed2a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:20.822056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ff32563-88e1-4353-b219-148e8b911a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:20.822680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32563-88e1-4353-b219-148e8b911a0c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:20.822960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32563-88e1-4353-b219-148e8b911a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:20.823236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ff32563-88e1-4353-b219-148e8b911a0c None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:20.831455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff32563-88e1-4353-b219-148e8b911a0c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:20.833125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ff32563-88e1-4353-b219-148e8b911a0c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:20.835779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-4ff32563-88e1-4353-b219-148e8b911a0c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:14:20.846403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:20.847366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:20.853404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 540/1066] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 24 14:14:20 2022] GET /identity/v3/users/nova => generated 82 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:20.854016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab730d-1bc9-4b9c-bdff-7003cec33a6c None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:20.866413 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3dbd7-be03-4bb5-ac53-ef486148ef20 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:20.866681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3dbd7-be03-4bb5-ac53-ef486148ef20 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:20.866912 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba3dbd7-be03-4bb5-ac53-ef486148ef20 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:20.868263 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 541/1067] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:14:20.873669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ec5db-79ce-423d-b031-a566e2194d53 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:20.873945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ec5db-79ce-423d-b031-a566e2194d53 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:20.874224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6ec5db-79ce-423d-b031-a566e2194d53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:20.893595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6b6ec5db-79ce-423d-b031-a566e2194d53 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:20.894790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6b6ec5db-79ce-423d-b031-a566e2194d53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:20.964498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 542/1068] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:20.964691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3ab730d-1bc9-4b9c-bdff-7003cec33a6c None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.001574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54214376-e08c-43df-85cc-8216b19af0b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:21.002208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54214376-e08c-43df-85cc-8216b19af0b0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.002492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54214376-e08c-43df-85cc-8216b19af0b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.002765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54214376-e08c-43df-85cc-8216b19af0b0 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.003518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54214376-e08c-43df-85cc-8216b19af0b0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:21.003829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54214376-e08c-43df-85cc-8216b19af0b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:21.005356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54214376-e08c-43df-85cc-8216b19af0b0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:21.015533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:21.030802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 527/1069] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 24 14:14:20 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:21.032003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ec5db-79ce-423d-b031-a566e2194d53 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:21.109576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b092b-8fd5-4522-b551-2f0054dcd0cd None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.109916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b092b-8fd5-4522-b551-2f0054dcd0cd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.110131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c5b092b-8fd5-4522-b551-2f0054dcd0cd None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.111600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 528/1070] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:21.116315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e538c-590e-4531-9b63-da8bb3df4a59 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.116661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e538c-590e-4531-9b63-da8bb3df4a59 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.116885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f40e538c-590e-4531-9b63-da8bb3df4a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.134400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6ec5db-79ce-423d-b031-a566e2194d53 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.134917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f40e538c-590e-4531-9b63-da8bb3df4a59 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:21.136100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f40e538c-590e-4531-9b63-da8bb3df4a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:21.166300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:21.174069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4095-e86d-4689-ba75-de582f168757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:21.174705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4095-e86d-4689-ba75-de582f168757 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.174982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4095-e86d-4689-ba75-de582f168757 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.175254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed4095-e86d-4689-ba75-de582f168757 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.189003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed4095-e86d-4689-ba75-de582f168757 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:21.190476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed4095-e86d-4689-ba75-de582f168757 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-e8ed4095-e86d-4689-ba75-de582f168757 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:21.205233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:21.206228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:14:21.207161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:21.207161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:21.207161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:21.212203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 529/1071] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:21.212353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 543/1072] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:21.212445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e538c-590e-4531-9b63-da8bb3df4a59 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:21.236666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4095-e86d-4689-ba75-de582f168757 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:21.318370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f40e538c-590e-4531-9b63-da8bb3df4a59 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.343987 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed4095-e86d-4689-ba75-de582f168757 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.344682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:21.353987 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca221f-9a48-47c5-ac09-5dfdb5026c04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:21.354590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca221f-9a48-47c5-ac09-5dfdb5026c04 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.354869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca221f-9a48-47c5-ac09-5dfdb5026c04 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.355145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ca221f-9a48-47c5-ac09-5dfdb5026c04 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.355781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca221f-9a48-47c5-ac09-5dfdb5026c04 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:21.356087 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca221f-9a48-47c5-ac09-5dfdb5026c04 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:21.357508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ca221f-9a48-47c5-ac09-5dfdb5026c04 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:21.373827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 530/1073] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:21.375055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca221f-9a48-47c5-ac09-5dfdb5026c04 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:21.385926 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e511-7720-4966-9c5e-21be83f256b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:21.386540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e511-7720-4966-9c5e-21be83f256b7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.387140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e511-7720-4966-9c5e-21be83f256b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.387422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f2e511-7720-4966-9c5e-21be83f256b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.440266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:21.460896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2e511-7720-4966-9c5e-21be83f256b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:21.462476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f2e511-7720-4966-9c5e-21be83f256b7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:21.476512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ca221f-9a48-47c5-ac09-5dfdb5026c04 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.510837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6925-924c-45a0-bbde-6b6e001c37b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:21.511462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6925-924c-45a0-bbde-6b6e001c37b9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.511745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6925-924c-45a0-bbde-6b6e001c37b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.512017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bb6925-924c-45a0-bbde-6b6e001c37b9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.519122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6925-924c-45a0-bbde-6b6e001c37b9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:21.520617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9bb6925-924c-45a0-bbde-6b6e001c37b9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-a9bb6925-924c-45a0-bbde-6b6e001c37b9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:14:21.531579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:21.532558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:21.533463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:14:21.533463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:14:21.533463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:14:21.533463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:14:21.533463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:14:21.533463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:14:21.533463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:21.533463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:21.533463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 531/1074] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:14:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:21.533463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6925-924c-45a0-bbde-6b6e001c37b9 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:21.571626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 544/1075] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:21 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 14:14:21.571626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e511-7720-4966-9c5e-21be83f256b7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:21.581969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:21.633368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9bb6925-924c-45a0-bbde-6b6e001c37b9 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.648321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:21.666415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f2e511-7720-4966-9c5e-21be83f256b7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.666962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d5a4-0d23-411a-8127-7121c0b48555 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:21.667584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d5a4-0d23-411a-8127-7121c0b48555 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.667864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d5a4-0d23-411a-8127-7121c0b48555 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.668135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd8d5a4-0d23-411a-8127-7121c0b48555 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.679014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd8d5a4-0d23-411a-8127-7121c0b48555 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5fd8d5a4-0d23-411a-8127-7121c0b48555 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:14:21.683772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:21.685354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 532/1076] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:14:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:21.686223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d5a4-0d23-411a-8127-7121c0b48555 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:21.701989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167578e-a5cb-4781-b5fe-7e64dce0bd7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:21.702596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167578e-a5cb-4781-b5fe-7e64dce0bd7d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.702876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167578e-a5cb-4781-b5fe-7e64dce0bd7d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.703156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0167578e-a5cb-4781-b5fe-7e64dce0bd7d None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.703838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167578e-a5cb-4781-b5fe-7e64dce0bd7d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:21.704174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167578e-a5cb-4781-b5fe-7e64dce0bd7d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:21.705600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0167578e-a5cb-4781-b5fe-7e64dce0bd7d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:21.717128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 545/1077] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:14:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:21.717908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167578e-a5cb-4781-b5fe-7e64dce0bd7d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:21.785309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd8d5a4-0d23-411a-8127-7121c0b48555 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.793703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:21.819491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526fd3e-10fe-43c8-bbbd-3522d96e21ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:21.820105 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526fd3e-10fe-43c8-bbbd-3522d96e21ac None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.820297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0167578e-a5cb-4781-b5fe-7e64dce0bd7d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.820400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526fd3e-10fe-43c8-bbbd-3522d96e21ac None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.820664 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8526fd3e-10fe-43c8-bbbd-3522d96e21ac None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.831437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526fd3e-10fe-43c8-bbbd-3522d96e21ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:21.832960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8526fd3e-10fe-43c8-bbbd-3522d96e21ac None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-8526fd3e-10fe-43c8-bbbd-3522d96e21ac None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:21.846634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:21.847719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:14:21.848670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:21.848670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:21.848670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:21.848670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 533/1078] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:21.848670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526fd3e-10fe-43c8-bbbd-3522d96e21ac None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:21.854952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb676b80-648c-48a6-9e8b-0393640bf481 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:21.855549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb676b80-648c-48a6-9e8b-0393640bf481 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.855826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb676b80-648c-48a6-9e8b-0393640bf481 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.856096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb676b80-648c-48a6-9e8b-0393640bf481 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.857314 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb676b80-648c-48a6-9e8b-0393640bf481 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:21.857624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb676b80-648c-48a6-9e8b-0393640bf481 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:21.858978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb676b80-648c-48a6-9e8b-0393640bf481 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:21.867206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 546/1079] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:14:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:21.868183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb676b80-648c-48a6-9e8b-0393640bf481 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:21.871969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:21.952077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8526fd3e-10fe-43c8-bbbd-3522d96e21ac None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.968096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb676b80-648c-48a6-9e8b-0393640bf481 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:21.985325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50403555-904e-42e6-9cc2-4e8f256486e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:21.985982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50403555-904e-42e6-9cc2-4e8f256486e6 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:21.986261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50403555-904e-42e6-9cc2-4e8f256486e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:21.986534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50403555-904e-42e6-9cc2-4e8f256486e6 None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/758be68931aa49e5828bc2c164940571/roles/f7cf85ae67814930bcd2ba2183fc5102` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:21.988712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50403555-904e-42e6-9cc2-4e8f256486e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=758be68931aa49e5828bc2c164940571, role_id=f7cf85ae67814930bcd2ba2183fc5102)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:21.990148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50403555-904e-42e6-9cc2-4e8f256486e6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:22.001358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e4a6a-4f9e-49eb-b3b0-67fa9a160848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:22.001933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e4a6a-4f9e-49eb-b3b0-67fa9a160848 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:22.002206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e4a6a-4f9e-49eb-b3b0-67fa9a160848 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:22.002472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-379e4a6a-4f9e-49eb-b3b0-67fa9a160848 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:22.003103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e4a6a-4f9e-49eb-b3b0-67fa9a160848 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:22.003402 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e4a6a-4f9e-49eb-b3b0-67fa9a160848 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:22.003606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 534/1080] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:14:21 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/758be68931aa49e5828bc2c164940571/roles/f7cf85ae67814930bcd2ba2183fc5102 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:14:22.004443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50403555-904e-42e6-9cc2-4e8f256486e6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:22.004914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-379e4a6a-4f9e-49eb-b3b0-67fa9a160848 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:22.018948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 547/1081] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:14:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:22.048533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:22.144464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50403555-904e-42e6-9cc2-4e8f256486e6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:22.184319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e20d1-5ac1-4d39-baa5-1acfe64187b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:22.185559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e20d1-5ac1-4d39-baa5-1acfe64187b2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:22.185842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e20d1-5ac1-4d39-baa5-1acfe64187b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:22.186112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c9e20d1-5ac1-4d39-baa5-1acfe64187b2 None admin] PATH_INFO: `/v3/users/6002006b181d4671ad4e8690c388267d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:22.188107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e20d1-5ac1-4d39-baa5-1acfe64187b2 None admin] RBAC: Authorizing `identity:get_user(user_id=6002006b181d4671ad4e8690c388267d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:22.189627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c9e20d1-5ac1-4d39-baa5-1acfe64187b2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:22.191659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 535/1082] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:22 2022] GET /identity/v3/users/6002006b181d4671ad4e8690c388267d => generated 285 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:22.198194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e4a6a-4f9e-49eb-b3b0-67fa9a160848 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:22.266820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:22.307898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-379e4a6a-4f9e-49eb-b3b0-67fa9a160848 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:22.345588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634576cb-fa7a-4ebd-9cf5-81cc796cbc10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:22.346187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634576cb-fa7a-4ebd-9cf5-81cc796cbc10 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:22.346468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634576cb-fa7a-4ebd-9cf5-81cc796cbc10 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:22.346740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634576cb-fa7a-4ebd-9cf5-81cc796cbc10 None admin] PATH_INFO: `/v3/projects/0f811338be6a46acbd513d5740aea447` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:22.347883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634576cb-fa7a-4ebd-9cf5-81cc796cbc10 None admin] RBAC: Authorizing `identity:get_project(project_id=0f811338be6a46acbd513d5740aea447)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:22.349630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634576cb-fa7a-4ebd-9cf5-81cc796cbc10 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:22.351279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 548/1083] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:14:22 2022] GET /identity/v3/projects/0f811338be6a46acbd513d5740aea447 => generated 311 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:22.358023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e20d1-5ac1-4d39-baa5-1acfe64187b2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:22.448948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:22.461486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c9e20d1-5ac1-4d39-baa5-1acfe64187b2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:22.499008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f04810a-c37f-4dc6-850c-137df5ff93b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:22.499680 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04810a-c37f-4dc6-850c-137df5ff93b5 None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:22.499960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04810a-c37f-4dc6-850c-137df5ff93b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:22.500269 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f04810a-c37f-4dc6-850c-137df5ff93b5 None admin] PATH_INFO: `/v3/projects/0f811338be6a46acbd513d5740aea447/users/6002006b181d4671ad4e8690c388267d/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:22.502171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04810a-c37f-4dc6-850c-137df5ff93b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f811338be6a46acbd513d5740aea447, user_id=6002006b181d4671ad4e8690c388267d, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:22.503609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f04810a-c37f-4dc6-850c-137df5ff93b5 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:22.516607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 536/1084] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:14:22 2022] PUT /identity/v3/projects/0f811338be6a46acbd513d5740aea447/users/6002006b181d4671ad4e8690c388267d/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:14:24.156222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02283d-d8cd-41a8-ba1a-549946c7c1b8 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:24.156800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02283d-d8cd-41a8-ba1a-549946c7c1b8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:24.156800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c02283d-d8cd-41a8-ba1a-549946c7c1b8 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:24.158114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 549/1085] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:24.163390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad80f64-4019-4e75-87da-f011c5bbb558 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:24.163819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad80f64-4019-4e75-87da-f011c5bbb558 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:24.163938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad80f64-4019-4e75-87da-f011c5bbb558 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:24.183204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-aad80f64-4019-4e75-87da-f011c5bbb558 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:24.184392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-aad80f64-4019-4e75-87da-f011c5bbb558 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:24.248650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 537/1086] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:24.519751 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02283d-d8cd-41a8-ba1a-549946c7c1b8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:24.623804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c02283d-d8cd-41a8-ba1a-549946c7c1b8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:24.649926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aae019-c1c4-40e3-a642-a5039e7867f5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:24.650211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aae019-c1c4-40e3-a642-a5039e7867f5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:24.650494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6aae019-c1c4-40e3-a642-a5039e7867f5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:24.651832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 538/1087] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:14:24.652417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:24.657197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c427d8-01ca-40ea-b1d0-900b34493f02 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:24.657485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c427d8-01ca-40ea-b1d0-900b34493f02 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:24.657760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c427d8-01ca-40ea-b1d0-900b34493f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:24.658214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654152ae-5a89-42d1-a220-b1caf2af29d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:24.658838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654152ae-5a89-42d1-a220-b1caf2af29d9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:24.659123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654152ae-5a89-42d1-a220-b1caf2af29d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:24.659396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-654152ae-5a89-42d1-a220-b1caf2af29d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:24.670399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-654152ae-5a89-42d1-a220-b1caf2af29d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-654152ae-5a89-42d1-a220-b1caf2af29d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:14:24.675076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:24.676079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Sep 24 14:14:24.677044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:24.677745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c1c427d8-01ca-40ea-b1d0-900b34493f02 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:24.677826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 550/1088] 10.222.0.16 () {56 vars in 1120 bytes} [Sat Sep 24 14:14:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:24.677902 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c1c427d8-01ca-40ea-b1d0-900b34493f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:24.681996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654152ae-5a89-42d1-a220-b1caf2af29d9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:24.744769 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 539/1089] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:24.780190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-654152ae-5a89-42d1-a220-b1caf2af29d9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:24.812095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c29c36-e8a1-44fd-9b8a-d25c902b9ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:24.812710 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c29c36-e8a1-44fd-9b8a-d25c902b9ea6 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:24.812988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c29c36-e8a1-44fd-9b8a-d25c902b9ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:24.813262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c29c36-e8a1-44fd-9b8a-d25c902b9ea6 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:24.813912 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c29c36-e8a1-44fd-9b8a-d25c902b9ea6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:24.814216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c29c36-e8a1-44fd-9b8a-d25c902b9ea6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:24.815575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c29c36-e8a1-44fd-9b8a-d25c902b9ea6 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:24.823141 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 551/1090] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 24 14:14:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:24.829505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c427d8-01ca-40ea-b1d0-900b34493f02 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:24.839679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:24.928574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c427d8-01ca-40ea-b1d0-900b34493f02 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:24.964081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd04b2-da07-4ec1-96a6-092918865d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:24.964735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd04b2-da07-4ec1-96a6-092918865d90 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:24.965015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd04b2-da07-4ec1-96a6-092918865d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:24.965289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffd04b2-da07-4ec1-96a6-092918865d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:24.975391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd04b2-da07-4ec1-96a6-092918865d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:24.976857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ffd04b2-da07-4ec1-96a6-092918865d90 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7ffd04b2-da07-4ec1-96a6-092918865d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:24.991186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:24.992376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:14:24.993617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:24.993617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:24.993617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:24.996531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 540/1091] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:24.998510 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c29c36-e8a1-44fd-9b8a-d25c902b9ea6 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.034508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd04b2-da07-4ec1-96a6-092918865d90 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.052349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:25.092713 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:25.100227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c29c36-e8a1-44fd-9b8a-d25c902b9ea6 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:25.133443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a4877-cb95-4cf7-bca6-4de097a4b84d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:25.134036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a4877-cb95-4cf7-bca6-4de097a4b84d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:25.134312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a4877-cb95-4cf7-bca6-4de097a4b84d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:25.134578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7a4877-cb95-4cf7-bca6-4de097a4b84d None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:25.135211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a4877-cb95-4cf7-bca6-4de097a4b84d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:25.135433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffd04b2-da07-4ec1-96a6-092918865d90 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:25.135556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a4877-cb95-4cf7-bca6-4de097a4b84d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:25.136872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7a4877-cb95-4cf7-bca6-4de097a4b84d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:25.148679 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 552/1092] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:14:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:25.154766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a4877-cb95-4cf7-bca6-4de097a4b84d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.170645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ae371-30d4-4326-8a55-f63660b7120a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:25.171276 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ae371-30d4-4326-8a55-f63660b7120a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:25.171555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ae371-30d4-4326-8a55-f63660b7120a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:25.171831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3ae371-30d4-4326-8a55-f63660b7120a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:25.182967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3ae371-30d4-4326-8a55-f63660b7120a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1d3ae371-30d4-4326-8a55-f63660b7120a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:14:25.188238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:25.189379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:25.190637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 541/1093] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:25.195205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ae371-30d4-4326-8a55-f63660b7120a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.253331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7a4877-cb95-4cf7-bca6-4de097a4b84d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:25.267602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:25.288297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe228b83-21bd-4609-ad1c-1ec49a29f365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:25.288918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe228b83-21bd-4609-ad1c-1ec49a29f365 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:25.289196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe228b83-21bd-4609-ad1c-1ec49a29f365 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:25.289555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe228b83-21bd-4609-ad1c-1ec49a29f365 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:25.293039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3ae371-30d4-4326-8a55-f63660b7120a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:25.297236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe228b83-21bd-4609-ad1c-1ec49a29f365 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:25.299726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe228b83-21bd-4609-ad1c-1ec49a29f365 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-fe228b83-21bd-4609-ad1c-1ec49a29f365 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:14:25.313010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:25.314181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:25.315342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 553/1094] 10.222.0.16 () {56 vars in 1093 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:25.319362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:25.319740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe228b83-21bd-4609-ad1c-1ec49a29f365 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.333691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2352ab-af6a-4441-bda2-f06a9f45254f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:25.334299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2352ab-af6a-4441-bda2-f06a9f45254f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:25.334598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2352ab-af6a-4441-bda2-f06a9f45254f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:25.334857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2352ab-af6a-4441-bda2-f06a9f45254f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:25.335519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2352ab-af6a-4441-bda2-f06a9f45254f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:25.335823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2352ab-af6a-4441-bda2-f06a9f45254f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:25.337235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2352ab-af6a-4441-bda2-f06a9f45254f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:25.346682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 542/1095] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:25.352740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2352ab-af6a-4441-bda2-f06a9f45254f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.418498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe228b83-21bd-4609-ad1c-1ec49a29f365 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:25.451280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2352ab-af6a-4441-bda2-f06a9f45254f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:25.451828 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cda5d-cf8f-496b-8ca3-e3723d54c4a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:25.452452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cda5d-cf8f-496b-8ca3-e3723d54c4a1 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:25.452731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cda5d-cf8f-496b-8ca3-e3723d54c4a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:25.452999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53cda5d-cf8f-496b-8ca3-e3723d54c4a1 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:25.453705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cda5d-cf8f-496b-8ca3-e3723d54c4a1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:25.454011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cda5d-cf8f-496b-8ca3-e3723d54c4a1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:25.455410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53cda5d-cf8f-496b-8ca3-e3723d54c4a1 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:25.472723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 554/1096] 10.222.0.16 () {56 vars in 1133 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:25.478654 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cda5d-cf8f-496b-8ca3-e3723d54c4a1 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.490235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267ce29-db01-4f87-a84c-80942e8f9400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:25.490870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267ce29-db01-4f87-a84c-80942e8f9400 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:25.491151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267ce29-db01-4f87-a84c-80942e8f9400 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:25.491424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b267ce29-db01-4f87-a84c-80942e8f9400 None admin] PATH_INFO: `/v3/users/6002006b181d4671ad4e8690c388267d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:25.492653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267ce29-db01-4f87-a84c-80942e8f9400 None admin] RBAC: Authorizing `identity:get_user(user_id=6002006b181d4671ad4e8690c388267d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:25.494077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b267ce29-db01-4f87-a84c-80942e8f9400 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:25.495657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 543/1097] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/users/6002006b181d4671ad4e8690c388267d => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:25.501299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267ce29-db01-4f87-a84c-80942e8f9400 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.512517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:25.551102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:25.581751 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53cda5d-cf8f-496b-8ca3-e3723d54c4a1 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:25.601151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b267ce29-db01-4f87-a84c-80942e8f9400 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:25.616115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaf1a8-fb57-4ac7-b3ee-98f257ae6e58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:25.616735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaf1a8-fb57-4ac7-b3ee-98f257ae6e58 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:25.617015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaf1a8-fb57-4ac7-b3ee-98f257ae6e58 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:25.617289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceeaf1a8-fb57-4ac7-b3ee-98f257ae6e58 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:25.634988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebd6ea-3486-474e-b4e7-a38dce61d723 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:25.635608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebd6ea-3486-474e-b4e7-a38dce61d723 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:25.635889 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebd6ea-3486-474e-b4e7-a38dce61d723 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:25.636172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebd6ea-3486-474e-b4e7-a38dce61d723 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:25.684603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaf1a8-fb57-4ac7-b3ee-98f257ae6e58 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:25.686531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceeaf1a8-fb57-4ac7-b3ee-98f257ae6e58 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:25.704831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebd6ea-3486-474e-b4e7-a38dce61d723 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:25.706262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ebd6ea-3486-474e-b4e7-a38dce61d723 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:25.715672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:25.754116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:25.786199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 555/1098] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 14:14:25.791802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaf1a8-fb57-4ac7-b3ee-98f257ae6e58 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.810458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 544/1099] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 14:14:25.811462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebd6ea-3486-474e-b4e7-a38dce61d723 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.887616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceeaf1a8-fb57-4ac7-b3ee-98f257ae6e58 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:25.906648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ebd6ea-3486-474e-b4e7-a38dce61d723 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:25.918234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:25.924225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1fa3-9b50-4347-9929-d236c8276616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:25.924852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1fa3-9b50-4347-9929-d236c8276616 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:25.925133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1fa3-9b50-4347-9929-d236c8276616 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:25.925409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4a1fa3-9b50-4347-9929-d236c8276616 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:25.935488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1fa3-9b50-4347-9929-d236c8276616 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:25.936949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4a1fa3-9b50-4347-9929-d236c8276616 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:25.941334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d538d1c-6492-4f7e-81b3-0df833c927f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:25.941954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d538d1c-6492-4f7e-81b3-0df833c927f4 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:25.942235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d538d1c-6492-4f7e-81b3-0df833c927f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:25.942597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d538d1c-6492-4f7e-81b3-0df833c927f4 None admin] PATH_INFO: `/v3/projects/0f811338be6a46acbd513d5740aea447` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:25.943714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d538d1c-6492-4f7e-81b3-0df833c927f4 None admin] RBAC: Authorizing `identity:get_project(project_id=0f811338be6a46acbd513d5740aea447)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:25.945163 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d538d1c-6492-4f7e-81b3-0df833c927f4 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:25.946787 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 545/1100] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/projects/0f811338be6a46acbd513d5740aea447 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-fd4a1fa3-9b50-4347-9929-d236c8276616 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:25.951622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:25.952771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:14:25.953696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:25.953696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:14:25.953696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:25.953882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d538d1c-6492-4f7e-81b3-0df833c927f4 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.953962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 556/1101] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:14:25.958213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1fa3-9b50-4347-9929-d236c8276616 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:25.973174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:26.053417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d538d1c-6492-4f7e-81b3-0df833c927f4 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:26.056486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4a1fa3-9b50-4347-9929-d236c8276616 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:26.086408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228773f-0f4f-450b-9cc4-7ed5a2e8f2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:26.086995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228773f-0f4f-450b-9cc4-7ed5a2e8f2aa None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:26.087277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228773f-0f4f-450b-9cc4-7ed5a2e8f2aa None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:26.087547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a228773f-0f4f-450b-9cc4-7ed5a2e8f2aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:26.088282 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228773f-0f4f-450b-9cc4-7ed5a2e8f2aa None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=0f811338be6a46acbd513d5740aea447, user.id=6002006b181d4671ad4e8690c388267d) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:26.088587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228773f-0f4f-450b-9cc4-7ed5a2e8f2aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:26.089308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada43927-4e57-4f7f-a91b-4050d88d2739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:26.089916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada43927-4e57-4f7f-a91b-4050d88d2739 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:26.090019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a228773f-0f4f-450b-9cc4-7ed5a2e8f2aa None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:26.090198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada43927-4e57-4f7f-a91b-4050d88d2739 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:26.090472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada43927-4e57-4f7f-a91b-4050d88d2739 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:26.091663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada43927-4e57-4f7f-a91b-4050d88d2739 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:26.091966 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada43927-4e57-4f7f-a91b-4050d88d2739 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:26.093339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada43927-4e57-4f7f-a91b-4050d88d2739 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:26.096165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 546/1102] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/role_assignments?user.id=6002006b181d4671ad4e8690c388267d&scope.project.id=0f811338be6a46acbd513d5740aea447&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:26.105509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 557/1103] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:14:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:26.111500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228773f-0f4f-450b-9cc4-7ed5a2e8f2aa None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:26.198159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:26.217441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a228773f-0f4f-450b-9cc4-7ed5a2e8f2aa None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:26.253509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bb307-4b79-44c4-a265-330b1120e653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:26.254140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb307-4b79-44c4-a265-330b1120e653 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:26.254412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb307-4b79-44c4-a265-330b1120e653 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:26.254707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f1bb307-4b79-44c4-a265-330b1120e653 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:26.261650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bb307-4b79-44c4-a265-330b1120e653 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:26.263113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f1bb307-4b79-44c4-a265-330b1120e653 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-6f1bb307-4b79-44c4-a265-330b1120e653 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:14:26.274243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:26.275412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:26.276808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:14:26.276808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:14:26.276808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:14:26.276808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:14:26.276808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:14:26.276808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:14:26.276808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:14:26.276808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:26.276808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 547/1104] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:14:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:26.281370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada43927-4e57-4f7f-a91b-4050d88d2739 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:26.329774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:26.383978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada43927-4e57-4f7f-a91b-4050d88d2739 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:26.417330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb47dc7d-d264-4844-8cff-f8eab217ed24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:26.417925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47dc7d-d264-4844-8cff-f8eab217ed24 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:26.418205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47dc7d-d264-4844-8cff-f8eab217ed24 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:26.418476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb47dc7d-d264-4844-8cff-f8eab217ed24 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:26.419211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47dc7d-d264-4844-8cff-f8eab217ed24 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:26.419518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47dc7d-d264-4844-8cff-f8eab217ed24 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:26.420959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb47dc7d-d264-4844-8cff-f8eab217ed24 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:26.432130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 558/1105] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:14:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:26.438839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bb307-4b79-44c4-a265-330b1120e653 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:26.538786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f1bb307-4b79-44c4-a265-330b1120e653 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:26.571245 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0123d2-1a19-42cf-b270-2cd09780c0a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:26.571843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0123d2-1a19-42cf-b270-2cd09780c0a8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:26.572120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0123d2-1a19-42cf-b270-2cd09780c0a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:26.572414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0123d2-1a19-42cf-b270-2cd09780c0a8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:26.573122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0123d2-1a19-42cf-b270-2cd09780c0a8 None admin] RBAC: Adding query filter params (role.id=f7cf85ae67814930bcd2ba2183fc5102, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=758be68931aa49e5828bc2c164940571) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:26.573427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0123d2-1a19-42cf-b270-2cd09780c0a8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:26.574844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0123d2-1a19-42cf-b270-2cd09780c0a8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:26.581216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 548/1106] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:14:26 2022] GET /identity/v3/role_assignments?user.id=758be68931aa49e5828bc2c164940571&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=f7cf85ae67814930bcd2ba2183fc5102 => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:28.262507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e878e8-472f-45b2-890e-0c453a48af62 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:28.263091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e878e8-472f-45b2-890e-0c453a48af62 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:28.263091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e878e8-472f-45b2-890e-0c453a48af62 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:28.264439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 559/1107] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:28.270854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654fae4-64d6-442c-b1f8-fddc9d018183 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:28.271253 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654fae4-64d6-442c-b1f8-fddc9d018183 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:28.271397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8654fae4-64d6-442c-b1f8-fddc9d018183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:28.286205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:28.291677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8654fae4-64d6-442c-b1f8-fddc9d018183 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:28.292882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8654fae4-64d6-442c-b1f8-fddc9d018183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:28.356135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 549/1108] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:28 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:28.627323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e878e8-472f-45b2-890e-0c453a48af62 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:28.725304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e878e8-472f-45b2-890e-0c453a48af62 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:28.727554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:28.758067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e440583a-65dc-494e-a40b-ee4b2a70a147 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:28.758676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440583a-65dc-494e-a40b-ee4b2a70a147 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:28.758952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440583a-65dc-494e-a40b-ee4b2a70a147 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:28.759221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e440583a-65dc-494e-a40b-ee4b2a70a147 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:28.760337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440583a-65dc-494e-a40b-ee4b2a70a147 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:28.761753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e440583a-65dc-494e-a40b-ee4b2a70a147 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:28.763309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 560/1109] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:28.768985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654fae4-64d6-442c-b1f8-fddc9d018183 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:28.862820 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8654fae4-64d6-442c-b1f8-fddc9d018183 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:28.894534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1989e16a-c907-4c1b-867f-d2b73c24a83b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:28.895064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e16a-c907-4c1b-867f-d2b73c24a83b None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:28.895340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e16a-c907-4c1b-867f-d2b73c24a83b None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:28.895608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1989e16a-c907-4c1b-867f-d2b73c24a83b None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:28.896271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989e16a-c907-4c1b-867f-d2b73c24a83b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:28.897687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1989e16a-c907-4c1b-867f-d2b73c24a83b None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:28.906810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:28.918806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 550/1110] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:14:28 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:14:31.109331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7abe8d-2b23-434b-aff0-12f1a6aa0c71 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:31.109886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7abe8d-2b23-434b-aff0-12f1a6aa0c71 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:31.109886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7abe8d-2b23-434b-aff0-12f1a6aa0c71 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:31.111192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 561/1111] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:31.116320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832037-476c-4504-a6df-64829ae5ef67 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:31.116707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832037-476c-4504-a6df-64829ae5ef67 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:31.116871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76832037-476c-4504-a6df-64829ae5ef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:31.134592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-76832037-476c-4504-a6df-64829ae5ef67 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:31.135771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-76832037-476c-4504-a6df-64829ae5ef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:31.199239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 551/1112] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:31.467279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7abe8d-2b23-434b-aff0-12f1a6aa0c71 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:31.564533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7abe8d-2b23-434b-aff0-12f1a6aa0c71 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:31.597121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc722e-7818-4588-a9b5-52f997ef002a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:31.597730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc722e-7818-4588-a9b5-52f997ef002a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:31.598005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc722e-7818-4588-a9b5-52f997ef002a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:31.598274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cc722e-7818-4588-a9b5-52f997ef002a None admin] PATH_INFO: `/v3/roles/4f8d839474214ed89390c34864229684` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:31.599885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc722e-7818-4588-a9b5-52f997ef002a None admin] RBAC: Authorizing `identity:get_role(role_id=4f8d839474214ed89390c34864229684)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:31.601257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8cc722e-7818-4588-a9b5-52f997ef002a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:31.602545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 562/1113] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:31 2022] GET /identity/v3/roles/4f8d839474214ed89390c34864229684 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:31.608313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832037-476c-4504-a6df-64829ae5ef67 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:31.708954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76832037-476c-4504-a6df-64829ae5ef67 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:31.731195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:31.742920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d2883-f35f-4a40-b3d0-3453f70b4312 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:31.743545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2883-f35f-4a40-b3d0-3453f70b4312 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:31.743824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2883-f35f-4a40-b3d0-3453f70b4312 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:31.744095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0d2883-f35f-4a40-b3d0-3453f70b4312 None admin] PATH_INFO: `/v3/users/481382a971f8450ebd160f15cfa9471d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:31.757184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d2883-f35f-4a40-b3d0-3453f70b4312 None admin] RBAC: Authorizing `identity:get_user(user_id=481382a971f8450ebd160f15cfa9471d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:31.758626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0d2883-f35f-4a40-b3d0-3453f70b4312 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:31.760214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 552/1114] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:31 2022] GET /identity/v3/users/481382a971f8450ebd160f15cfa9471d => generated 286 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:31.766546 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc722e-7818-4588-a9b5-52f997ef002a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:31.806266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:31.862983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cc722e-7818-4588-a9b5-52f997ef002a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:31.895839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973d2cb-6756-49d6-adec-8b8e1b24332a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:31.896461 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973d2cb-6756-49d6-adec-8b8e1b24332a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:31.896743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973d2cb-6756-49d6-adec-8b8e1b24332a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:31.897020 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973d2cb-6756-49d6-adec-8b8e1b24332a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:31.962564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973d2cb-6756-49d6-adec-8b8e1b24332a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:31.964007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6973d2cb-6756-49d6-adec-8b8e1b24332a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:32.002533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:32.059071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 563/1115] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:14:32.065726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d2883-f35f-4a40-b3d0-3453f70b4312 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:32.160382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0d2883-f35f-4a40-b3d0-3453f70b4312 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:32.193055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a5e766-049e-4b92-b2af-dc85808962b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:32.193674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5e766-049e-4b92-b2af-dc85808962b8 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:32.193956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5e766-049e-4b92-b2af-dc85808962b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:32.194232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a5e766-049e-4b92-b2af-dc85808962b8 None admin] PATH_INFO: `/v3/projects/0f811338be6a46acbd513d5740aea447` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:32.195330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5e766-049e-4b92-b2af-dc85808962b8 None admin] RBAC: Authorizing `identity:get_project(project_id=0f811338be6a46acbd513d5740aea447)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:32.196780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a5e766-049e-4b92-b2af-dc85808962b8 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:32.198369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 553/1116] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:14:32 2022] GET /identity/v3/projects/0f811338be6a46acbd513d5740aea447 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:32.204863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973d2cb-6756-49d6-adec-8b8e1b24332a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:32.301441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973d2cb-6756-49d6-adec-8b8e1b24332a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:32.334021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7251062-61e1-498a-8764-4fc750e82583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:32.334609 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251062-61e1-498a-8764-4fc750e82583 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:32.334891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251062-61e1-498a-8764-4fc750e82583 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:32.335163 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7251062-61e1-498a-8764-4fc750e82583 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:32.335874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7251062-61e1-498a-8764-4fc750e82583 None admin] RBAC: Adding query filter params (role.id=4f8d839474214ed89390c34864229684, scope.project.id=0f811338be6a46acbd513d5740aea447, user.id=481382a971f8450ebd160f15cfa9471d) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:32.336203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7251062-61e1-498a-8764-4fc750e82583 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:32.337616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7251062-61e1-498a-8764-4fc750e82583 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:32.343368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 564/1117] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:14:32 2022] GET /identity/v3/role_assignments?user.id=481382a971f8450ebd160f15cfa9471d&scope.project.id=0f811338be6a46acbd513d5740aea447&role.id=4f8d839474214ed89390c34864229684 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:34.456996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c73a7-54c0-47ca-b264-6b9b0dc66306 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:34.457526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c73a7-54c0-47ca-b264-6b9b0dc66306 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:34.457526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8c73a7-54c0-47ca-b264-6b9b0dc66306 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:34.458900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 554/1118] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:34.463938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108059a4-b818-42bf-ab1f-184ce868a4e3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:34.464381 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108059a4-b818-42bf-ab1f-184ce868a4e3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:34.464500 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108059a4-b818-42bf-ab1f-184ce868a4e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:34.472323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:34.483554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-108059a4-b818-42bf-ab1f-184ce868a4e3 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:34.484771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-108059a4-b818-42bf-ab1f-184ce868a4e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:34.550195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 565/1119] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:34 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:34.815961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c73a7-54c0-47ca-b264-6b9b0dc66306 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:34.864565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:34.914284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8c73a7-54c0-47ca-b264-6b9b0dc66306 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:34.946356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6b6a-1077-4262-a920-7c4a4f124d30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:34.946964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6b6a-1077-4262-a920-7c4a4f124d30 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:34.947236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6b6a-1077-4262-a920-7c4a4f124d30 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:34.947505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deac6b6a-1077-4262-a920-7c4a4f124d30 None admin] PATH_INFO: `/v3/roles/4f8d839474214ed89390c34864229684` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:34.948889 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6b6a-1077-4262-a920-7c4a4f124d30 None admin] RBAC: Authorizing `identity:get_role(role_id=4f8d839474214ed89390c34864229684)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:34.950304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deac6b6a-1077-4262-a920-7c4a4f124d30 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:34.951587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 555/1120] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:34 2022] GET /identity/v3/roles/4f8d839474214ed89390c34864229684 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:34.957348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108059a4-b818-42bf-ab1f-184ce868a4e3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:35.053556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108059a4-b818-42bf-ab1f-184ce868a4e3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:35.087002 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ddbae-bf89-457b-bc18-607dd80ad302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:35.087558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ddbae-bf89-457b-bc18-607dd80ad302 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:35.087839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ddbae-bf89-457b-bc18-607dd80ad302 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:35.088115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00ddbae-bf89-457b-bc18-607dd80ad302 None admin] PATH_INFO: `/v3/users/481382a971f8450ebd160f15cfa9471d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:35.089256 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ddbae-bf89-457b-bc18-607dd80ad302 None admin] RBAC: Authorizing `identity:get_user(user_id=481382a971f8450ebd160f15cfa9471d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:35.091212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f00ddbae-bf89-457b-bc18-607dd80ad302 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:35.092874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 566/1121] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:34 2022] GET /identity/v3/users/481382a971f8450ebd160f15cfa9471d => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:35.098766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6b6a-1077-4262-a920-7c4a4f124d30 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:35.193450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deac6b6a-1077-4262-a920-7c4a4f124d30 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:35.209434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:35.227031 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b54d16-591e-4ad7-8a7b-8a7b7c2053b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:35.227637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54d16-591e-4ad7-8a7b-8a7b7c2053b6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:35.227912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54d16-591e-4ad7-8a7b-8a7b7c2053b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:35.228212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b54d16-591e-4ad7-8a7b-8a7b7c2053b6 None admin] PATH_INFO: `/v3/projects/0f811338be6a46acbd513d5740aea447` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:35.229307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b54d16-591e-4ad7-8a7b-8a7b7c2053b6 None admin] RBAC: Authorizing `identity:get_project(project_id=0f811338be6a46acbd513d5740aea447)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:35.230722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b54d16-591e-4ad7-8a7b-8a7b7c2053b6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:35.232842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 556/1122] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:14:35 2022] GET /identity/v3/projects/0f811338be6a46acbd513d5740aea447 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:35.238590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ddbae-bf89-457b-bc18-607dd80ad302 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:35.241430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:35.334045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00ddbae-bf89-457b-bc18-607dd80ad302 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:35.371077 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dbfee83-0a6f-4675-a72e-dc26fa2a60a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:35.371701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfee83-0a6f-4675-a72e-dc26fa2a60a4 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:35.372496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfee83-0a6f-4675-a72e-dc26fa2a60a4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:35.372766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dbfee83-0a6f-4675-a72e-dc26fa2a60a4 None admin] PATH_INFO: `/v3/projects/0f811338be6a46acbd513d5740aea447/users/481382a971f8450ebd160f15cfa9471d/roles/4f8d839474214ed89390c34864229684` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:35.374886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfee83-0a6f-4675-a72e-dc26fa2a60a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=0f811338be6a46acbd513d5740aea447, user_id=481382a971f8450ebd160f15cfa9471d, role_id=4f8d839474214ed89390c34864229684)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:35.376331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dbfee83-0a6f-4675-a72e-dc26fa2a60a4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:35.388599 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 567/1123] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:14:35 2022] PUT /identity/v3/projects/0f811338be6a46acbd513d5740aea447/users/481382a971f8450ebd160f15cfa9471d/roles/4f8d839474214ed89390c34864229684 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:14:37.471785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee3e98-eee7-4771-8bdf-d39701554c1c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:37.472368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee3e98-eee7-4771-8bdf-d39701554c1c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:37.472368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acee3e98-eee7-4771-8bdf-d39701554c1c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:37.473955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 557/1124] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:37.479132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e3647-c467-4963-abda-b61b54b6b010 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:37.479526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e3647-c467-4963-abda-b61b54b6b010 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:37.479682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590e3647-c467-4963-abda-b61b54b6b010 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:37.498547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-590e3647-c467-4963-abda-b61b54b6b010 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:37.499710 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-590e3647-c467-4963-abda-b61b54b6b010 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:37.552969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:37.564524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 568/1125] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:37 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:37.832558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee3e98-eee7-4771-8bdf-d39701554c1c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:37.928722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acee3e98-eee7-4771-8bdf-d39701554c1c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:37.960630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67c922-5ea0-48cf-90d6-76edb2b42000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:37.961235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c922-5ea0-48cf-90d6-76edb2b42000 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:37.961508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c922-5ea0-48cf-90d6-76edb2b42000 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:37.961774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd67c922-5ea0-48cf-90d6-76edb2b42000 None admin] PATH_INFO: `/v3/roles/4f8d839474214ed89390c34864229684` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:37.963122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67c922-5ea0-48cf-90d6-76edb2b42000 None admin] RBAC: Authorizing `identity:get_role(role_id=4f8d839474214ed89390c34864229684)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:37.964506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd67c922-5ea0-48cf-90d6-76edb2b42000 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:37.966309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 558/1126] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:37 2022] GET /identity/v3/roles/4f8d839474214ed89390c34864229684 => generated 223 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:37.971975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e3647-c467-4963-abda-b61b54b6b010 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:38.075194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590e3647-c467-4963-abda-b61b54b6b010 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:38.107951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159cc3e-5fcf-4249-acd5-9b04c1ed3087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:38.108532 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159cc3e-5fcf-4249-acd5-9b04c1ed3087 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:38.108815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159cc3e-5fcf-4249-acd5-9b04c1ed3087 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:38.109090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f159cc3e-5fcf-4249-acd5-9b04c1ed3087 None admin] PATH_INFO: `/v3/users/481382a971f8450ebd160f15cfa9471d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:38.110199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159cc3e-5fcf-4249-acd5-9b04c1ed3087 None admin] RBAC: Authorizing `identity:get_user(user_id=481382a971f8450ebd160f15cfa9471d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:38.111629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f159cc3e-5fcf-4249-acd5-9b04c1ed3087 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:38.113215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 569/1127] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:37 2022] GET /identity/v3/users/481382a971f8450ebd160f15cfa9471d => generated 286 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:38.118922 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67c922-5ea0-48cf-90d6-76edb2b42000 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:38.169785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:38.214290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd67c922-5ea0-48cf-90d6-76edb2b42000 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:38.246617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db28aa-aab6-4e7f-b3d4-63c9000386cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:38.247202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db28aa-aab6-4e7f-b3d4-63c9000386cd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:38.247478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db28aa-aab6-4e7f-b3d4-63c9000386cd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:38.247748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43db28aa-aab6-4e7f-b3d4-63c9000386cd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:38.311994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db28aa-aab6-4e7f-b3d4-63c9000386cd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:38.313457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43db28aa-aab6-4e7f-b3d4-63c9000386cd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:38.361160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:38.406467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 559/1128] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:38 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 288 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:14:38.412357 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159cc3e-5fcf-4249-acd5-9b04c1ed3087 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:38.471401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:38.511063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f159cc3e-5fcf-4249-acd5-9b04c1ed3087 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:38.543195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8cfb6d-8b5a-4f33-be0a-f606b645f5ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:38.544394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cfb6d-8b5a-4f33-be0a-f606b645f5ff None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:38.544674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cfb6d-8b5a-4f33-be0a-f606b645f5ff None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:38.544946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8cfb6d-8b5a-4f33-be0a-f606b645f5ff None admin] PATH_INFO: `/v3/projects/0f811338be6a46acbd513d5740aea447` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:38.546051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cfb6d-8b5a-4f33-be0a-f606b645f5ff None admin] RBAC: Authorizing `identity:get_project(project_id=0f811338be6a46acbd513d5740aea447)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:38.547463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8cfb6d-8b5a-4f33-be0a-f606b645f5ff None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:38.549102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 570/1129] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:14:38 2022] GET /identity/v3/projects/0f811338be6a46acbd513d5740aea447 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:38.555189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db28aa-aab6-4e7f-b3d4-63c9000386cd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:38.649612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43db28aa-aab6-4e7f-b3d4-63c9000386cd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:38.682568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7319862d-e342-4571-8c26-eb9c5ebb7ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:38.683152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319862d-e342-4571-8c26-eb9c5ebb7ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:38.683430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319862d-e342-4571-8c26-eb9c5ebb7ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:38.683701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7319862d-e342-4571-8c26-eb9c5ebb7ab2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:38.684469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319862d-e342-4571-8c26-eb9c5ebb7ab2 None admin] RBAC: Adding query filter params (role.id=4f8d839474214ed89390c34864229684, scope.project.id=0f811338be6a46acbd513d5740aea447, user.id=481382a971f8450ebd160f15cfa9471d) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:38.684777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319862d-e342-4571-8c26-eb9c5ebb7ab2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:38.686191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7319862d-e342-4571-8c26-eb9c5ebb7ab2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:38.691679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 560/1130] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:14:38 2022] GET /identity/v3/role_assignments?user.id=481382a971f8450ebd160f15cfa9471d&scope.project.id=0f811338be6a46acbd513d5740aea447&role.id=4f8d839474214ed89390c34864229684 => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:40.815770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fdc11-583d-4c46-8794-dd3483eabc82 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:40.816323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fdc11-583d-4c46-8794-dd3483eabc82 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:40.816481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d7fdc11-583d-4c46-8794-dd3483eabc82 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:40.817830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 571/1131] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:40.823057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e232a-d880-401a-9026-be1a0d6009e6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:40.823447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e232a-d880-401a-9026-be1a0d6009e6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:40.823606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565e232a-d880-401a-9026-be1a0d6009e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:40.841887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-565e232a-d880-401a-9026-be1a0d6009e6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:40.843057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-565e232a-d880-401a-9026-be1a0d6009e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:40.853632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:40.908431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 561/1132] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:41.176098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fdc11-583d-4c46-8794-dd3483eabc82 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:41.275345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d7fdc11-583d-4c46-8794-dd3483eabc82 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:41.300914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:41.308754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb689e9-1507-4dee-9069-ed281147ea41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:41.309393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb689e9-1507-4dee-9069-ed281147ea41 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:41.309676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb689e9-1507-4dee-9069-ed281147ea41 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:41.309950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb689e9-1507-4dee-9069-ed281147ea41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:41.311040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb689e9-1507-4dee-9069-ed281147ea41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:41.312494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceb689e9-1507-4dee-9069-ed281147ea41 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:41.314051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 572/1133] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:41.319816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e232a-d880-401a-9026-be1a0d6009e6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:41.417847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565e232a-d880-401a-9026-be1a0d6009e6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:41.450042 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8c6f60b-47e8-40d6-8c4f-3ab0d1baaa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:41.450573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f60b-47e8-40d6-8c4f-3ab0d1baaa58 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:41.450848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f60b-47e8-40d6-8c4f-3ab0d1baaa58 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:41.451117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8c6f60b-47e8-40d6-8c4f-3ab0d1baaa58 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:41.451762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6f60b-47e8-40d6-8c4f-3ab0d1baaa58 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:41.453213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8c6f60b-47e8-40d6-8c4f-3ab0d1baaa58 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:41.473963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:41.482707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 562/1134] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:14:41 2022] POST /identity/v3/projects => generated 311 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:14:43.648238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba424f-6829-4a78-a516-69a9ea7ae5cb None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:43.648773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba424f-6829-4a78-a516-69a9ea7ae5cb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:43.648773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba424f-6829-4a78-a516-69a9ea7ae5cb None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:43.650125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 573/1135] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:43.655422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16104ef-8c26-4faa-9656-4868abd6c133 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:43.655796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16104ef-8c26-4faa-9656-4868abd6c133 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:43.655969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16104ef-8c26-4faa-9656-4868abd6c133 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:43.673830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c16104ef-8c26-4faa-9656-4868abd6c133 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:43.674994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c16104ef-8c26-4faa-9656-4868abd6c133 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:43.739193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 563/1136] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:44.011281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba424f-6829-4a78-a516-69a9ea7ae5cb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:44.109192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba424f-6829-4a78-a516-69a9ea7ae5cb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:44.141778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d7638a-c679-4a1f-9b21-0300c102e5e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:44.142395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7638a-c679-4a1f-9b21-0300c102e5e0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:44.142675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7638a-c679-4a1f-9b21-0300c102e5e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:44.142948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d7638a-c679-4a1f-9b21-0300c102e5e0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:44.144052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7638a-c679-4a1f-9b21-0300c102e5e0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:44.145501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19d7638a-c679-4a1f-9b21-0300c102e5e0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:44.147035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 574/1137] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:14:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:44.152581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16104ef-8c26-4faa-9656-4868abd6c133 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:44.247988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16104ef-8c26-4faa-9656-4868abd6c133 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:44.273589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:44.281215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e71439-521d-4570-b22d-93754f66a3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:44.281805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e71439-521d-4570-b22d-93754f66a3a6 None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:44.282073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e71439-521d-4570-b22d-93754f66a3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:44.282343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e71439-521d-4570-b22d-93754f66a3a6 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:44.282974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e71439-521d-4570-b22d-93754f66a3a6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:44.284438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e71439-521d-4570-b22d-93754f66a3a6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:44.304671 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 564/1138] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:14:44 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:14:46.452362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3304bea-6667-4604-bdd9-6fe959989a9b None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:46.452917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3304bea-6667-4604-bdd9-6fe959989a9b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:46.452917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3304bea-6667-4604-bdd9-6fe959989a9b None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:46.454227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 575/1139] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:46.459353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e59f7-0f58-4662-8574-8910b478dac6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:46.459768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e59f7-0f58-4662-8574-8910b478dac6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:46.459900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2e59f7-0f58-4662-8574-8910b478dac6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:46.478574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ad2e59f7-0f58-4662-8574-8910b478dac6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:46.479755 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ad2e59f7-0f58-4662-8574-8910b478dac6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:46.544280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 565/1140] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:46 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:46.815080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3304bea-6667-4604-bdd9-6fe959989a9b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:46.876389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:46.914948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3304bea-6667-4604-bdd9-6fe959989a9b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:46.947817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660e36-e5eb-4ce5-b521-6dfe169dac03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:46.948457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660e36-e5eb-4ce5-b521-6dfe169dac03 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:46.948742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660e36-e5eb-4ce5-b521-6dfe169dac03 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:46.949016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b660e36-e5eb-4ce5-b521-6dfe169dac03 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:46.958906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b660e36-e5eb-4ce5-b521-6dfe169dac03 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-2b660e36-e5eb-4ce5-b521-6dfe169dac03 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:14:46.963628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:46.968238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:46.969365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 576/1141] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:14:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:46.971221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e59f7-0f58-4662-8574-8910b478dac6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:47.068026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2e59f7-0f58-4662-8574-8910b478dac6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:47.081986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:47.103336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e55916-e1c4-4d6e-b4df-8bb3be562abf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:47.103936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e55916-e1c4-4d6e-b4df-8bb3be562abf None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:47.104242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e55916-e1c4-4d6e-b4df-8bb3be562abf None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:47.104516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87e55916-e1c4-4d6e-b4df-8bb3be562abf None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:47.105172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e55916-e1c4-4d6e-b4df-8bb3be562abf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:47.106015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e55916-e1c4-4d6e-b4df-8bb3be562abf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:47.107387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87e55916-e1c4-4d6e-b4df-8bb3be562abf None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:47.115182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 566/1142] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:14:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:47.121806 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660e36-e5eb-4ce5-b521-6dfe169dac03 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:47.215655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b660e36-e5eb-4ce5-b521-6dfe169dac03 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:47.238361 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:47.248973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba0d03-eb44-4fcb-ad99-c91791cf2047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:47.249580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba0d03-eb44-4fcb-ad99-c91791cf2047 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:47.249855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba0d03-eb44-4fcb-ad99-c91791cf2047 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:47.250125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eba0d03-eb44-4fcb-ad99-c91791cf2047 None admin] PATH_INFO: `/v3/users/8f58f38b493d4323878d234e9c23ea40` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:47.263004 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba0d03-eb44-4fcb-ad99-c91791cf2047 None admin] RBAC: Authorizing `identity:get_user(user_id=8f58f38b493d4323878d234e9c23ea40)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:47.264442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eba0d03-eb44-4fcb-ad99-c91791cf2047 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:47.265989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 577/1143] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:47 2022] GET /identity/v3/users/8f58f38b493d4323878d234e9c23ea40 => generated 286 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:14:47.271644 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e55916-e1c4-4d6e-b4df-8bb3be562abf None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:47.371733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87e55916-e1c4-4d6e-b4df-8bb3be562abf None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:47.405575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa787b8c-af7a-4b0e-96ec-31e0ef047e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:47.406177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa787b8c-af7a-4b0e-96ec-31e0ef047e06 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:47.406452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa787b8c-af7a-4b0e-96ec-31e0ef047e06 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:47.406717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa787b8c-af7a-4b0e-96ec-31e0ef047e06 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:47.450525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:47.473052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa787b8c-af7a-4b0e-96ec-31e0ef047e06 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:47.474757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa787b8c-af7a-4b0e-96ec-31e0ef047e06 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:47.568380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 567/1144] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:47 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:14:47.574350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba0d03-eb44-4fcb-ad99-c91791cf2047 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:47.671847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eba0d03-eb44-4fcb-ad99-c91791cf2047 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:47.705495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ffd2da-6353-45f9-ba4a-c15ddcc1081d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:47.706116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffd2da-6353-45f9-ba4a-c15ddcc1081d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:47.706395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffd2da-6353-45f9-ba4a-c15ddcc1081d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:47.706667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ffd2da-6353-45f9-ba4a-c15ddcc1081d None admin] PATH_INFO: `/v3/projects/247f737c65084693b19ed4a0ffb6f915` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:47.707764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffd2da-6353-45f9-ba4a-c15ddcc1081d None admin] RBAC: Authorizing `identity:get_project(project_id=247f737c65084693b19ed4a0ffb6f915)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:47.709221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ffd2da-6353-45f9-ba4a-c15ddcc1081d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:47.710857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 578/1145] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:14:47 2022] GET /identity/v3/projects/247f737c65084693b19ed4a0ffb6f915 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:47.717418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa787b8c-af7a-4b0e-96ec-31e0ef047e06 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:47.790358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:47.813167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa787b8c-af7a-4b0e-96ec-31e0ef047e06 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:47.846228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3608462-a3f8-4406-b03b-fe1bd642e861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:47.846815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3608462-a3f8-4406-b03b-fe1bd642e861 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:47.847095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3608462-a3f8-4406-b03b-fe1bd642e861 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:47.847369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3608462-a3f8-4406-b03b-fe1bd642e861 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:47.848079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3608462-a3f8-4406-b03b-fe1bd642e861 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=247f737c65084693b19ed4a0ffb6f915, user.id=8f58f38b493d4323878d234e9c23ea40) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:47.848668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3608462-a3f8-4406-b03b-fe1bd642e861 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:47.850085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3608462-a3f8-4406-b03b-fe1bd642e861 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:47.855202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 568/1146] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:14:47 2022] GET /identity/v3/role_assignments?user.id=8f58f38b493d4323878d234e9c23ea40&scope.project.id=247f737c65084693b19ed4a0ffb6f915&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:49.974308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0d27-7412-479f-890c-02e33c83ee69 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:49.974832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0d27-7412-479f-890c-02e33c83ee69 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:49.974832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80da0d27-7412-479f-890c-02e33c83ee69 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:49.976202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 579/1147] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:49.981288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5560fba-20cd-4c1d-ba4b-0f5e82587319 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:49.981681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5560fba-20cd-4c1d-ba4b-0f5e82587319 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:49.981846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5560fba-20cd-4c1d-ba4b-0f5e82587319 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:50.000827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e5560fba-20cd-4c1d-ba4b-0f5e82587319 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:50.002019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e5560fba-20cd-4c1d-ba4b-0f5e82587319 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:50.066702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 569/1148] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:50.342792 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da0d27-7412-479f-890c-02e33c83ee69 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:50.392691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:50.441460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80da0d27-7412-479f-890c-02e33c83ee69 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:50.474067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c925-e1fe-4ec3-abc8-7d73fbeb6bac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:50.474681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c925-e1fe-4ec3-abc8-7d73fbeb6bac None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:50.474959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c925-e1fe-4ec3-abc8-7d73fbeb6bac None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:50.475230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c9c925-e1fe-4ec3-abc8-7d73fbeb6bac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:50.485802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c9c925-e1fe-4ec3-abc8-7d73fbeb6bac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-53c9c925-e1fe-4ec3-abc8-7d73fbeb6bac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:14:50.490524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:50.491642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:50.492796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 580/1149] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:14:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:50.497874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5560fba-20cd-4c1d-ba4b-0f5e82587319 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:50.563495 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:50.593454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5560fba-20cd-4c1d-ba4b-0f5e82587319 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:50.626227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddda626-2910-46ad-9aa8-9f94cde396a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:50.626816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddda626-2910-46ad-9aa8-9f94cde396a2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:50.627095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddda626-2910-46ad-9aa8-9f94cde396a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:50.627368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ddda626-2910-46ad-9aa8-9f94cde396a2 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:50.628018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddda626-2910-46ad-9aa8-9f94cde396a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:50.628348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddda626-2910-46ad-9aa8-9f94cde396a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:50.629715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ddda626-2910-46ad-9aa8-9f94cde396a2 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:50.637571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 570/1150] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:14:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:50.643192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c925-e1fe-4ec3-abc8-7d73fbeb6bac None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:50.739523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c9c925-e1fe-4ec3-abc8-7d73fbeb6bac None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:50.749835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:50.772645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262eacc-4c20-49e1-b954-6d3374c29e07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:50.773284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262eacc-4c20-49e1-b954-6d3374c29e07 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:50.773567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262eacc-4c20-49e1-b954-6d3374c29e07 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:50.773845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9262eacc-4c20-49e1-b954-6d3374c29e07 None admin] PATH_INFO: `/v3/users/8f58f38b493d4323878d234e9c23ea40` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:50.774952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262eacc-4c20-49e1-b954-6d3374c29e07 None admin] RBAC: Authorizing `identity:get_user(user_id=8f58f38b493d4323878d234e9c23ea40)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:50.776408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9262eacc-4c20-49e1-b954-6d3374c29e07 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:50.778460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 581/1151] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:50 2022] GET /identity/v3/users/8f58f38b493d4323878d234e9c23ea40 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:50.784039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddda626-2910-46ad-9aa8-9f94cde396a2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:50.880228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ddda626-2910-46ad-9aa8-9f94cde396a2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:50.908663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:50.913791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06ea36c-a26a-4697-9b7e-c4f18eef59a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:50.914403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ea36c-a26a-4697-9b7e-c4f18eef59a3 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:50.914682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ea36c-a26a-4697-9b7e-c4f18eef59a3 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:50.914954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06ea36c-a26a-4697-9b7e-c4f18eef59a3 None admin] PATH_INFO: `/v3/projects/247f737c65084693b19ed4a0ffb6f915` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:50.916050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ea36c-a26a-4697-9b7e-c4f18eef59a3 None admin] RBAC: Authorizing `identity:get_project(project_id=247f737c65084693b19ed4a0ffb6f915)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:50.917510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06ea36c-a26a-4697-9b7e-c4f18eef59a3 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:50.919144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 571/1152] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:14:50 2022] GET /identity/v3/projects/247f737c65084693b19ed4a0ffb6f915 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:50.924919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262eacc-4c20-49e1-b954-6d3374c29e07 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:51.020830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9262eacc-4c20-49e1-b954-6d3374c29e07 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:51.053512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b256eb12-5b73-4614-8e7c-49eaf34dafd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:51.054148 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256eb12-5b73-4614-8e7c-49eaf34dafd9 None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:51.054430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256eb12-5b73-4614-8e7c-49eaf34dafd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:51.054704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b256eb12-5b73-4614-8e7c-49eaf34dafd9 None admin] PATH_INFO: `/v3/projects/247f737c65084693b19ed4a0ffb6f915/users/8f58f38b493d4323878d234e9c23ea40/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:51.056602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256eb12-5b73-4614-8e7c-49eaf34dafd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=247f737c65084693b19ed4a0ffb6f915, user_id=8f58f38b493d4323878d234e9c23ea40, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:51.058015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b256eb12-5b73-4614-8e7c-49eaf34dafd9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:51.070290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 582/1153] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:14:50 2022] PUT /identity/v3/projects/247f737c65084693b19ed4a0ffb6f915/users/8f58f38b493d4323878d234e9c23ea40/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:14:53.170440 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6efcf7-dc9c-43f9-a62b-b064db46c611 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:53.170991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6efcf7-dc9c-43f9-a62b-b064db46c611 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:53.170991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6efcf7-dc9c-43f9-a62b-b064db46c611 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:53.172358 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 572/1154] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:53.177675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd2905-dec3-4b8a-b4c9-1212b267e5fc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:53.178082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd2905-dec3-4b8a-b4c9-1212b267e5fc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:53.178233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52cd2905-dec3-4b8a-b4c9-1212b267e5fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:53.196527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-52cd2905-dec3-4b8a-b4c9-1212b267e5fc None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:53.197708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-52cd2905-dec3-4b8a-b4c9-1212b267e5fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:53.227181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:53.264596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 583/1155] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:14:53.539295 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6efcf7-dc9c-43f9-a62b-b064db46c611 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:53.638096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6efcf7-dc9c-43f9-a62b-b064db46c611 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:53.669196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13f2ee-5bbc-4807-8220-b308a8809cde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:53.669804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f2ee-5bbc-4807-8220-b308a8809cde None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:53.670079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f2ee-5bbc-4807-8220-b308a8809cde None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:53.670353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c13f2ee-5bbc-4807-8220-b308a8809cde None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:53.680357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c13f2ee-5bbc-4807-8220-b308a8809cde None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-5c13f2ee-5bbc-4807-8220-b308a8809cde None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:14:53.685540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:53.686541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:14:53.687402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 573/1156] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:14:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:53.692444 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd2905-dec3-4b8a-b4c9-1212b267e5fc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:53.790940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52cd2905-dec3-4b8a-b4c9-1212b267e5fc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:53.823653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2081192-593e-4198-8030-bf05b8a5221a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:53.824291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2081192-593e-4198-8030-bf05b8a5221a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:53.824568 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2081192-593e-4198-8030-bf05b8a5221a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:53.824835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2081192-593e-4198-8030-bf05b8a5221a None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:53.825480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2081192-593e-4198-8030-bf05b8a5221a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:53.825779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2081192-593e-4198-8030-bf05b8a5221a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:53.827123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2081192-593e-4198-8030-bf05b8a5221a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:53.834893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 584/1157] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:14:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:53.840684 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13f2ee-5bbc-4807-8220-b308a8809cde None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:53.897730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:53.937745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c13f2ee-5bbc-4807-8220-b308a8809cde None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:53.969152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc87c7-86fe-4786-b22e-18ec38274a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:53.969760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc87c7-86fe-4786-b22e-18ec38274a16 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:53.970041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc87c7-86fe-4786-b22e-18ec38274a16 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:53.970314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6dc87c7-86fe-4786-b22e-18ec38274a16 None admin] PATH_INFO: `/v3/users/8f58f38b493d4323878d234e9c23ea40` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:53.971408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc87c7-86fe-4786-b22e-18ec38274a16 None admin] RBAC: Authorizing `identity:get_user(user_id=8f58f38b493d4323878d234e9c23ea40)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:53.972860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6dc87c7-86fe-4786-b22e-18ec38274a16 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:53.974653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 574/1158] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:14:53 2022] GET /identity/v3/users/8f58f38b493d4323878d234e9c23ea40 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:53.980765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2081192-593e-4198-8030-bf05b8a5221a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:54.010544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:54.076704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2081192-593e-4198-8030-bf05b8a5221a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:54.108611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954744c-afce-4abe-be2f-060bf46c122c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:54.109190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954744c-afce-4abe-be2f-060bf46c122c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:54.109468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954744c-afce-4abe-be2f-060bf46c122c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:54.109737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3954744c-afce-4abe-be2f-060bf46c122c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:54.173143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954744c-afce-4abe-be2f-060bf46c122c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:54.174547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3954744c-afce-4abe-be2f-060bf46c122c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:54.202574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:54.269153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 585/1159] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:14:54.274968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc87c7-86fe-4786-b22e-18ec38274a16 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:54.372812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6dc87c7-86fe-4786-b22e-18ec38274a16 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:54.397661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:54.406372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34b3cac-28fa-4b38-9e31-b58c1ad67cb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:54.406990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b3cac-28fa-4b38-9e31-b58c1ad67cb7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:54.407268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b3cac-28fa-4b38-9e31-b58c1ad67cb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:54.407541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34b3cac-28fa-4b38-9e31-b58c1ad67cb7 None admin] PATH_INFO: `/v3/projects/247f737c65084693b19ed4a0ffb6f915` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:54.408698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b3cac-28fa-4b38-9e31-b58c1ad67cb7 None admin] RBAC: Authorizing `identity:get_project(project_id=247f737c65084693b19ed4a0ffb6f915)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:54.410134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34b3cac-28fa-4b38-9e31-b58c1ad67cb7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:54.411757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 575/1160] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:14:54 2022] GET /identity/v3/projects/247f737c65084693b19ed4a0ffb6f915 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:54.418484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954744c-afce-4abe-be2f-060bf46c122c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:54.514042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3954744c-afce-4abe-be2f-060bf46c122c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:54.541950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:54.548685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bf7be6-8afc-410a-aa81-08433d021637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:54.549279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf7be6-8afc-410a-aa81-08433d021637 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:54.549559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf7be6-8afc-410a-aa81-08433d021637 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:54.549836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bf7be6-8afc-410a-aa81-08433d021637 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:54.550549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf7be6-8afc-410a-aa81-08433d021637 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=247f737c65084693b19ed4a0ffb6f915, user.id=8f58f38b493d4323878d234e9c23ea40) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:54.550858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf7be6-8afc-410a-aa81-08433d021637 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:54.552289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bf7be6-8afc-410a-aa81-08433d021637 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:54.557858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 586/1161] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:14:54 2022] GET /identity/v3/role_assignments?user.id=8f58f38b493d4323878d234e9c23ea40&scope.project.id=247f737c65084693b19ed4a0ffb6f915&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:56.687204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3abe3-b069-4f14-907f-15bfc9c93c77 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:56.687775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3abe3-b069-4f14-907f-15bfc9c93c77 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:56.687775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf3abe3-b069-4f14-907f-15bfc9c93c77 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:56.689132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 576/1162] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:56.694337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba9bf-15f1-4e8d-a969-1cc1f211404e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:56.694779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba9bf-15f1-4e8d-a969-1cc1f211404e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:56.694882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56cba9bf-15f1-4e8d-a969-1cc1f211404e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:56.713051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-56cba9bf-15f1-4e8d-a969-1cc1f211404e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:56.714224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-56cba9bf-15f1-4e8d-a969-1cc1f211404e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:56.777984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 587/1163] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:56 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:14:57.044801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3abe3-b069-4f14-907f-15bfc9c93c77 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:57.141491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf3abe3-b069-4f14-907f-15bfc9c93c77 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:57.173006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dbecf-6a3a-41db-a239-ff63cb0c4a7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:57.174108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dbecf-6a3a-41db-a239-ff63cb0c4a7f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:57.174108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dbecf-6a3a-41db-a239-ff63cb0c4a7f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:57.174108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-238dbecf-6a3a-41db-a239-ff63cb0c4a7f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:57.236988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:57.243441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238dbecf-6a3a-41db-a239-ff63cb0c4a7f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:57.244913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-238dbecf-6a3a-41db-a239-ff63cb0c4a7f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:57.338442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 577/1164] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:14:57 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:14:57.344555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cba9bf-15f1-4e8d-a969-1cc1f211404e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:57.440144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56cba9bf-15f1-4e8d-a969-1cc1f211404e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:57.463018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:57.476304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da5bbe-36fa-4993-91a7-fd621edbd174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:57.476937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5bbe-36fa-4993-91a7-fd621edbd174 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:57.477216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5bbe-36fa-4993-91a7-fd621edbd174 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:57.477491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da5bbe-36fa-4993-91a7-fd621edbd174 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:57.485297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5bbe-36fa-4993-91a7-fd621edbd174 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:57.487539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53da5bbe-36fa-4993-91a7-fd621edbd174 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-53da5bbe-36fa-4993-91a7-fd621edbd174 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:14:57.500255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:14:57.501539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:14:57.502677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 588/1165] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 24 14:14:57 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:14:57.507413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dbecf-6a3a-41db-a239-ff63cb0c4a7f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:14:57.598256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:14:57.604362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-238dbecf-6a3a-41db-a239-ff63cb0c4a7f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:14:57.637908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4098ae33-60e1-4d77-9be1-240ae50d7e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:14:57.638497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098ae33-60e1-4d77-9be1-240ae50d7e3d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:57.638775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098ae33-60e1-4d77-9be1-240ae50d7e3d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:57.639046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4098ae33-60e1-4d77-9be1-240ae50d7e3d None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:57.639678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098ae33-60e1-4d77-9be1-240ae50d7e3d None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:14:57.639980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098ae33-60e1-4d77-9be1-240ae50d7e3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:14:57.641362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4098ae33-60e1-4d77-9be1-240ae50d7e3d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:14:57.648399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 578/1166] 10.222.0.16 () {56 vars in 1115 bytes} [Sat Sep 24 14:14:57 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:14:59.737233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce360a9f-f9a2-4341-91fe-a91575290ea8 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:59.737743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce360a9f-f9a2-4341-91fe-a91575290ea8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:59.737743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce360a9f-f9a2-4341-91fe-a91575290ea8 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:59.739010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 589/1167] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:14:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:14:59.744079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3aa2-9d28-4280-99a3-dbb3c77b5b7d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:14:59.744509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3aa2-9d28-4280-99a3-dbb3c77b5b7d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:14:59.744658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f74f3aa2-9d28-4280-99a3-dbb3c77b5b7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:14:59.763217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f74f3aa2-9d28-4280-99a3-dbb3c77b5b7d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:14:59.764476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f74f3aa2-9d28-4280-99a3-dbb3c77b5b7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:14:59.828349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 579/1168] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:14:59 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:15:00.094567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce360a9f-f9a2-4341-91fe-a91575290ea8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:00.192253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce360a9f-f9a2-4341-91fe-a91575290ea8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:00.224491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122d5dcd-0578-4137-ad09-02b0911b1a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:00.225080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5dcd-0578-4137-ad09-02b0911b1a4f None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:00.225356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5dcd-0578-4137-ad09-02b0911b1a4f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:00.225627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122d5dcd-0578-4137-ad09-02b0911b1a4f None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:00.226294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d5dcd-0578-4137-ad09-02b0911b1a4f None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:00.227635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122d5dcd-0578-4137-ad09-02b0911b1a4f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:00.243250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 590/1169] 10.222.0.16 () {60 vars in 1138 bytes} [Sat Sep 24 14:15:00 2022] POST /identity/v3/domains => generated 267 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:15:02.386700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685986b-b490-41e4-a570-42337be0d410 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:02.387229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685986b-b490-41e4-a570-42337be0d410 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:02.387229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2685986b-b490-41e4-a570-42337be0d410 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:02.388623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 580/1170] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:15:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:15:02.393791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b313f-51a4-42c1-9ef6-9ade08d6a1e9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:02.394187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b313f-51a4-42c1-9ef6-9ade08d6a1e9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:02.394348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58b313f-51a4-42c1-9ef6-9ade08d6a1e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:02.413057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b58b313f-51a4-42c1-9ef6-9ade08d6a1e9 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:15:02.414234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b58b313f-51a4-42c1-9ef6-9ade08d6a1e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:15:02.453235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:02.480066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 591/1171] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:15:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:15:02.746937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685986b-b490-41e4-a570-42337be0d410 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:02.834709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:02.848293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2685986b-b490-41e4-a570-42337be0d410 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:02.883101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fb561d-8461-41aa-818e-944e88199827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:02.883727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb561d-8461-41aa-818e-944e88199827 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:02.884010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb561d-8461-41aa-818e-944e88199827 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:02.884318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fb561d-8461-41aa-818e-944e88199827 None admin] PATH_INFO: `/v3/domains/9e6faf38c28a452fafc6293bbe911e51` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:02.894869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb561d-8461-41aa-818e-944e88199827 None admin] RBAC: Authorizing `identity:get_domain(domain_id=9e6faf38c28a452fafc6293bbe911e51)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:02.896337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fb561d-8461-41aa-818e-944e88199827 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:02.897918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 581/1172] 10.222.0.16 () {56 vars in 1183 bytes} [Sat Sep 24 14:15:02 2022] GET /identity/v3/domains/9e6faf38c28a452fafc6293bbe911e51 => generated 267 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:02.904380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b313f-51a4-42c1-9ef6-9ade08d6a1e9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:02.997986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58b313f-51a4-42c1-9ef6-9ade08d6a1e9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:03.030527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a8e53-877d-4e11-b1ec-a9c00b8061f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:03.031127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8e53-877d-4e11-b1ec-a9c00b8061f9 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:03.031408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8e53-877d-4e11-b1ec-a9c00b8061f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:03.031680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a8e53-877d-4e11-b1ec-a9c00b8061f9 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:03.032366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a8e53-877d-4e11-b1ec-a9c00b8061f9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:03.033791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a8e53-877d-4e11-b1ec-a9c00b8061f9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:03.061182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 592/1173] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:15:02 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:15:05.236508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1739d-1229-4810-aba9-88eb0a32bbc0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:05.237929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1739d-1229-4810-aba9-88eb0a32bbc0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:05.237929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f1739d-1229-4810-aba9-88eb0a32bbc0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:05.239091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 582/1174] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:15:05.245081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143e6ca-349d-4040-8878-f8be83872429 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:05.246021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143e6ca-349d-4040-8878-f8be83872429 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:05.246183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e143e6ca-349d-4040-8878-f8be83872429 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:05.263922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e143e6ca-349d-4040-8878-f8be83872429 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:15:05.265131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e143e6ca-349d-4040-8878-f8be83872429 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:15:05.284303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:05.329647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 593/1175] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:15:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:15:05.603338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1739d-1229-4810-aba9-88eb0a32bbc0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:05.701878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f1739d-1229-4810-aba9-88eb0a32bbc0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:05.734303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca9ec73-584b-4fd1-9c31-f94227c46c4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:05.734919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ec73-584b-4fd1-9c31-f94227c46c4e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:05.735201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ec73-584b-4fd1-9c31-f94227c46c4e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:05.735476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca9ec73-584b-4fd1-9c31-f94227c46c4e None admin] PATH_INFO: `/v3/domains/9e6faf38c28a452fafc6293bbe911e51` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:05.736607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9ec73-584b-4fd1-9c31-f94227c46c4e None admin] RBAC: Authorizing `identity:get_domain(domain_id=9e6faf38c28a452fafc6293bbe911e51)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:05.738038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca9ec73-584b-4fd1-9c31-f94227c46c4e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:05.739569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 583/1176] 10.222.0.16 () {56 vars in 1183 bytes} [Sat Sep 24 14:15:05 2022] GET /identity/v3/domains/9e6faf38c28a452fafc6293bbe911e51 => generated 267 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:05.745627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143e6ca-349d-4040-8878-f8be83872429 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:05.839961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e143e6ca-349d-4040-8878-f8be83872429 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:05.874390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d50c106d-c32c-4bb8-bcf1-a198289bf58a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:05.874921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c106d-c32c-4bb8-bcf1-a198289bf58a None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:05.875195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c106d-c32c-4bb8-bcf1-a198289bf58a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:05.875509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d50c106d-c32c-4bb8-bcf1-a198289bf58a None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:05.876144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c106d-c32c-4bb8-bcf1-a198289bf58a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:05.877572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d50c106d-c32c-4bb8-bcf1-a198289bf58a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:05.897930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 594/1177] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:15:05 2022] POST /identity/v3/users => generated 311 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:15:08.036640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278115-37bf-44bd-9f4f-806e1808d85a None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:08.037150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278115-37bf-44bd-9f4f-806e1808d85a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:08.037262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f278115-37bf-44bd-9f4f-806e1808d85a None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:08.038514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 584/1178] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:15:08.044433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f3dd7-fe9e-4b2f-a606-7c557349cb27 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:08.044801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f3dd7-fe9e-4b2f-a606-7c557349cb27 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:08.044985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0f3dd7-fe9e-4b2f-a606-7c557349cb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:08.062668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3b0f3dd7-fe9e-4b2f-a606-7c557349cb27 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:15:08.063850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3b0f3dd7-fe9e-4b2f-a606-7c557349cb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:15:08.070968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:08.128958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 595/1179] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:15:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:15:08.397266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f278115-37bf-44bd-9f4f-806e1808d85a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:08.416679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:08.497195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f278115-37bf-44bd-9f4f-806e1808d85a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:08.530588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f4461-1fa6-44d6-9b92-522543807060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:08.531208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f4461-1fa6-44d6-9b92-522543807060 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:08.531486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f4461-1fa6-44d6-9b92-522543807060 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:08.531758 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449f4461-1fa6-44d6-9b92-522543807060 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:08.541991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-449f4461-1fa6-44d6-9b92-522543807060 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-449f4461-1fa6-44d6-9b92-522543807060 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:15:08.546665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:15:08.547931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:15:08.548904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 585/1180] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:15:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:15:08.553791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f3dd7-fe9e-4b2f-a606-7c557349cb27 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:08.660437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0f3dd7-fe9e-4b2f-a606-7c557349cb27 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:08.692602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41834b4-1afb-46e5-ac7c-1b0d360560f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:08.693196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41834b4-1afb-46e5-ac7c-1b0d360560f2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:08.693470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41834b4-1afb-46e5-ac7c-1b0d360560f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:08.693737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41834b4-1afb-46e5-ac7c-1b0d360560f2 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:08.694386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41834b4-1afb-46e5-ac7c-1b0d360560f2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:15:08.694687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41834b4-1afb-46e5-ac7c-1b0d360560f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:08.696035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41834b4-1afb-46e5-ac7c-1b0d360560f2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:08.704252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 596/1181] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:15:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:08.710180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f4461-1fa6-44d6-9b92-522543807060 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:08.785329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:08.806737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449f4461-1fa6-44d6-9b92-522543807060 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:08.838855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e2c2f-a1ed-4206-abdb-10ae4e77d415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:08.839466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e2c2f-a1ed-4206-abdb-10ae4e77d415 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:08.839747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e2c2f-a1ed-4206-abdb-10ae4e77d415 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:08.840018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c8e2c2f-a1ed-4206-abdb-10ae4e77d415 None admin] PATH_INFO: `/v3/users/57400e1d94b64f6d9f8d43bb7a41f679` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:08.852715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e2c2f-a1ed-4206-abdb-10ae4e77d415 None admin] RBAC: Authorizing `identity:get_user(user_id=57400e1d94b64f6d9f8d43bb7a41f679)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:08.854139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c8e2c2f-a1ed-4206-abdb-10ae4e77d415 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:08.856210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 586/1182] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:15:08 2022] GET /identity/v3/users/57400e1d94b64f6d9f8d43bb7a41f679 => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:08.861956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41834b4-1afb-46e5-ac7c-1b0d360560f2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:08.865635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:08.962364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41834b4-1afb-46e5-ac7c-1b0d360560f2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:08.999184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6728-d493-4cb1-8b7e-e6c9b89a8036 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:08.999774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6728-d493-4cb1-8b7e-e6c9b89a8036 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:09.000047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6728-d493-4cb1-8b7e-e6c9b89a8036 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:09.000348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03a6728-d493-4cb1-8b7e-e6c9b89a8036 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:09.064192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a6728-d493-4cb1-8b7e-e6c9b89a8036 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:09.065618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03a6728-d493-4cb1-8b7e-e6c9b89a8036 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:09.068067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:09.158478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 597/1183] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:15:08 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 14:15:09.164417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e2c2f-a1ed-4206-abdb-10ae4e77d415 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:09.259302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c8e2c2f-a1ed-4206-abdb-10ae4e77d415 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:09.293759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e974f5a-a474-4cc9-bb00-473790f22727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:09.294374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e974f5a-a474-4cc9-bb00-473790f22727 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:09.294650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e974f5a-a474-4cc9-bb00-473790f22727 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:09.294921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e974f5a-a474-4cc9-bb00-473790f22727 None admin] PATH_INFO: `/v3/projects/da8b6410588d4e5784ce520dc87213a6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:09.296013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e974f5a-a474-4cc9-bb00-473790f22727 None admin] RBAC: Authorizing `identity:get_project(project_id=da8b6410588d4e5784ce520dc87213a6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:09.297466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e974f5a-a474-4cc9-bb00-473790f22727 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:09.299058 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 587/1184] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:15:09 2022] GET /identity/v3/projects/da8b6410588d4e5784ce520dc87213a6 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:09.305000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6728-d493-4cb1-8b7e-e6c9b89a8036 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:09.399818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03a6728-d493-4cb1-8b7e-e6c9b89a8036 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:09.402123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:09.432974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73a8e02a-cade-4e8e-a33b-d8b95f2c3bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:09.433556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8e02a-cade-4e8e-a33b-d8b95f2c3bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:09.433833 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8e02a-cade-4e8e-a33b-d8b95f2c3bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:09.434104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73a8e02a-cade-4e8e-a33b-d8b95f2c3bb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:09.434802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8e02a-cade-4e8e-a33b-d8b95f2c3bb8 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=da8b6410588d4e5784ce520dc87213a6, user.id=57400e1d94b64f6d9f8d43bb7a41f679) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:15:09.435111 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8e02a-cade-4e8e-a33b-d8b95f2c3bb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:09.436537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73a8e02a-cade-4e8e-a33b-d8b95f2c3bb8 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:09.441682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 598/1185] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:15:09 2022] GET /identity/v3/role_assignments?user.id=57400e1d94b64f6d9f8d43bb7a41f679&scope.project.id=da8b6410588d4e5784ce520dc87213a6&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:15:11.523821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930afe0c-e06b-43c3-9a25-d433e22806bf None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:11.524307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930afe0c-e06b-43c3-9a25-d433e22806bf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:11.524409 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-930afe0c-e06b-43c3-9a25-d433e22806bf None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:11.525734 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 588/1186] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:15:11.535349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18c1c7-e00d-46da-8372-5c7fd5f2a11f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:11.535803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18c1c7-e00d-46da-8372-5c7fd5f2a11f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:11.535902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f18c1c7-e00d-46da-8372-5c7fd5f2a11f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:11.553718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2f18c1c7-e00d-46da-8372-5c7fd5f2a11f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:15:11.554908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2f18c1c7-e00d-46da-8372-5c7fd5f2a11f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:15:11.618362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 599/1187] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:15:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:15:11.889950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930afe0c-e06b-43c3-9a25-d433e22806bf None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:11.893828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:11.987698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-930afe0c-e06b-43c3-9a25-d433e22806bf None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:12.019678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9125d-8aad-4d6d-ba71-47deb1036889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:12.020308 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9125d-8aad-4d6d-ba71-47deb1036889 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:12.020585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9125d-8aad-4d6d-ba71-47deb1036889 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:12.020852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9125d-8aad-4d6d-ba71-47deb1036889 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:12.030941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9125d-8aad-4d6d-ba71-47deb1036889 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1dd9125d-8aad-4d6d-ba71-47deb1036889 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:15:12.035586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:15:12.036749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:15:12.037657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 589/1188] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:15:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:15:12.042717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18c1c7-e00d-46da-8372-5c7fd5f2a11f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:12.134316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:12.138937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f18c1c7-e00d-46da-8372-5c7fd5f2a11f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:12.171743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa594d-b3d0-4059-a680-1187a1f8ef3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:12.172299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa594d-b3d0-4059-a680-1187a1f8ef3a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:12.172575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa594d-b3d0-4059-a680-1187a1f8ef3a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:12.172842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70aa594d-b3d0-4059-a680-1187a1f8ef3a None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:12.173497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa594d-b3d0-4059-a680-1187a1f8ef3a None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:15:12.173797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa594d-b3d0-4059-a680-1187a1f8ef3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:12.175136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70aa594d-b3d0-4059-a680-1187a1f8ef3a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:12.183331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 600/1189] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:15:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:12.189084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9125d-8aad-4d6d-ba71-47deb1036889 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:12.249906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:12.286086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9125d-8aad-4d6d-ba71-47deb1036889 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:12.318239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5d9f1-9139-45f1-bd73-810b26386d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:12.318843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5d9f1-9139-45f1-bd73-810b26386d83 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:12.319120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5d9f1-9139-45f1-bd73-810b26386d83 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:12.319391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab5d9f1-9139-45f1-bd73-810b26386d83 None admin] PATH_INFO: `/v3/users/57400e1d94b64f6d9f8d43bb7a41f679` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:12.320508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5d9f1-9139-45f1-bd73-810b26386d83 None admin] RBAC: Authorizing `identity:get_user(user_id=57400e1d94b64f6d9f8d43bb7a41f679)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:12.321921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab5d9f1-9139-45f1-bd73-810b26386d83 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:12.324027 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 590/1190] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:15:12 2022] GET /identity/v3/users/57400e1d94b64f6d9f8d43bb7a41f679 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:12.329685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa594d-b3d0-4059-a680-1187a1f8ef3a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:12.424859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70aa594d-b3d0-4059-a680-1187a1f8ef3a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:12.457520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa35044-9ff7-408f-9c99-d191df02df3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:12.458121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35044-9ff7-408f-9c99-d191df02df3f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:12.458396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35044-9ff7-408f-9c99-d191df02df3f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:12.458663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa35044-9ff7-408f-9c99-d191df02df3f None admin] PATH_INFO: `/v3/projects/da8b6410588d4e5784ce520dc87213a6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:12.459745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa35044-9ff7-408f-9c99-d191df02df3f None admin] RBAC: Authorizing `identity:get_project(project_id=da8b6410588d4e5784ce520dc87213a6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:12.461184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa35044-9ff7-408f-9c99-d191df02df3f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:12.462762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 601/1191] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:15:12 2022] GET /identity/v3/projects/da8b6410588d4e5784ce520dc87213a6 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:12.468395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5d9f1-9139-45f1-bd73-810b26386d83 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:12.563202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab5d9f1-9139-45f1-bd73-810b26386d83 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:12.590731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:12.595914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a345ab4-9f28-4197-ac23-8102bb7dba3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:12.596583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a345ab4-9f28-4197-ac23-8102bb7dba3f None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:12.596862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a345ab4-9f28-4197-ac23-8102bb7dba3f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:12.597132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a345ab4-9f28-4197-ac23-8102bb7dba3f None admin] PATH_INFO: `/v3/projects/da8b6410588d4e5784ce520dc87213a6/users/57400e1d94b64f6d9f8d43bb7a41f679/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:12.599249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a345ab4-9f28-4197-ac23-8102bb7dba3f None admin] RBAC: Authorizing `identity:create_grant(project_id=da8b6410588d4e5784ce520dc87213a6, user_id=57400e1d94b64f6d9f8d43bb7a41f679, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:12.600698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a345ab4-9f28-4197-ac23-8102bb7dba3f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:12.613028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 591/1192] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:15:12 2022] PUT /identity/v3/projects/da8b6410588d4e5784ce520dc87213a6/users/57400e1d94b64f6d9f8d43bb7a41f679/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:15:14.746668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ce19-3295-4ff4-a232-99a219e73ac5 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:14.747181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ce19-3295-4ff4-a232-99a219e73ac5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:14.747306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd3ce19-3295-4ff4-a232-99a219e73ac5 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:14.748581 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 602/1193] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:15:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:15:14.753688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bc38e-2e79-409b-89af-e2b05aa2a123 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:14.754121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bc38e-2e79-409b-89af-e2b05aa2a123 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:14.754232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe1bc38e-2e79-409b-89af-e2b05aa2a123 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:14.771895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fe1bc38e-2e79-409b-89af-e2b05aa2a123 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:15:14.773131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fe1bc38e-2e79-409b-89af-e2b05aa2a123 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:15:14.836840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 592/1194] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:15:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:15:15.103056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3ce19-3295-4ff4-a232-99a219e73ac5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:15.130891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:15.201316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd3ce19-3295-4ff4-a232-99a219e73ac5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:15.234529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3bb81-47f9-43a3-ab05-8de2974ac0f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:15.235140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3bb81-47f9-43a3-ab05-8de2974ac0f3 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:15.235418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3bb81-47f9-43a3-ab05-8de2974ac0f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:15.235686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c3bb81-47f9-43a3-ab05-8de2974ac0f3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:15.245358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c3bb81-47f9-43a3-ab05-8de2974ac0f3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-b9c3bb81-47f9-43a3-ab05-8de2974ac0f3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:15:15.250101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:15:15.251186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:15:15.252278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 603/1195] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:15:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:15:15.257288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bc38e-2e79-409b-89af-e2b05aa2a123 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:15.352939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe1bc38e-2e79-409b-89af-e2b05aa2a123 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:15.374910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:15.387115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68471-04f6-4ef4-a5f9-b6aef87ee62f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:15.387712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68471-04f6-4ef4-a5f9-b6aef87ee62f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:15.387992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68471-04f6-4ef4-a5f9-b6aef87ee62f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:15.388302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f68471-04f6-4ef4-a5f9-b6aef87ee62f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:15.388958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68471-04f6-4ef4-a5f9-b6aef87ee62f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:15:15.389261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68471-04f6-4ef4-a5f9-b6aef87ee62f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:15.390623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f68471-04f6-4ef4-a5f9-b6aef87ee62f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:15.398376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 593/1196] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:15:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:15.404754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3bb81-47f9-43a3-ab05-8de2974ac0f3 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:15.490225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:15.502384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c3bb81-47f9-43a3-ab05-8de2974ac0f3 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:15.534990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a23a0-6342-4634-9d94-188870887b20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:15.535600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a23a0-6342-4634-9d94-188870887b20 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:15.535877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a23a0-6342-4634-9d94-188870887b20 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:15.536147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52a23a0-6342-4634-9d94-188870887b20 None admin] PATH_INFO: `/v3/users/57400e1d94b64f6d9f8d43bb7a41f679` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:15.537255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a23a0-6342-4634-9d94-188870887b20 None admin] RBAC: Authorizing `identity:get_user(user_id=57400e1d94b64f6d9f8d43bb7a41f679)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:15.538670 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52a23a0-6342-4634-9d94-188870887b20 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:15.540237 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 604/1197] 10.222.0.16 () {56 vars in 1177 bytes} [Sat Sep 24 14:15:15 2022] GET /identity/v3/users/57400e1d94b64f6d9f8d43bb7a41f679 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:15.546640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68471-04f6-4ef4-a5f9-b6aef87ee62f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:15.643382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f68471-04f6-4ef4-a5f9-b6aef87ee62f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:15.675839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7b65c-b378-4ddd-a704-e19327ab1dce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:15.676455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7b65c-b378-4ddd-a704-e19327ab1dce None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:15.676731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7b65c-b378-4ddd-a704-e19327ab1dce None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:15.676998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3e7b65c-b378-4ddd-a704-e19327ab1dce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:15.726679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:15.742346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7b65c-b378-4ddd-a704-e19327ab1dce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:15.743797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3e7b65c-b378-4ddd-a704-e19327ab1dce None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:15.840177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 594/1198] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:15:15 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:15:15.846126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a23a0-6342-4634-9d94-188870887b20 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:15.942553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52a23a0-6342-4634-9d94-188870887b20 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:15.974572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efd9882-c2c4-435b-a6c8-b7f6b74fe297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:15.975178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd9882-c2c4-435b-a6c8-b7f6b74fe297 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:15.975456 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd9882-c2c4-435b-a6c8-b7f6b74fe297 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:15.975727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efd9882-c2c4-435b-a6c8-b7f6b74fe297 None admin] PATH_INFO: `/v3/projects/da8b6410588d4e5784ce520dc87213a6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:15.976856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd9882-c2c4-435b-a6c8-b7f6b74fe297 None admin] RBAC: Authorizing `identity:get_project(project_id=da8b6410588d4e5784ce520dc87213a6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:15.978266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efd9882-c2c4-435b-a6c8-b7f6b74fe297 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:15.979907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 605/1199] 10.222.0.16 () {56 vars in 1186 bytes} [Sat Sep 24 14:15:15 2022] GET /identity/v3/projects/da8b6410588d4e5784ce520dc87213a6 => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:15.985763 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7b65c-b378-4ddd-a704-e19327ab1dce None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:15:16.068419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:16.083850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3e7b65c-b378-4ddd-a704-e19327ab1dce None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:15:16.117757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde3aa4e-004a-4682-a275-b54d3d5d2f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:15:16.118354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3aa4e-004a-4682-a275-b54d3d5d2f40 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:15:16.118632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3aa4e-004a-4682-a275-b54d3d5d2f40 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:15:16.118906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde3aa4e-004a-4682-a275-b54d3d5d2f40 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:15:16.119644 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3aa4e-004a-4682-a275-b54d3d5d2f40 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=da8b6410588d4e5784ce520dc87213a6, user.id=57400e1d94b64f6d9f8d43bb7a41f679) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:15:16.119955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3aa4e-004a-4682-a275-b54d3d5d2f40 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:15:16.121424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde3aa4e-004a-4682-a275-b54d3d5d2f40 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:15:16.126994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 595/1200] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:15:15 2022] GET /identity/v3/role_assignments?user.id=57400e1d94b64f6d9f8d43bb7a41f679&scope.project.id=da8b6410588d4e5784ce520dc87213a6&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:15:25.970313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:15:26.124441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=26 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:11.185618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f10d06-cb32-441f-9863-467354432f5a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:11.186214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f10d06-cb32-441f-9863-467354432f5a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:11.186214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f10d06-cb32-441f-9863-467354432f5a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:11.187441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 606/1201] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:11.193186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e123c-619b-4e5c-a6f1-c3d1a0b320ec None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:11.193643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e123c-619b-4e5c-a6f1-c3d1a0b320ec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:11.193863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3e123c-619b-4e5c-a6f1-c3d1a0b320ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:11.218541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ed3e123c-619b-4e5c-a6f1-c3d1a0b320ec None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:11.219763 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed3e123c-619b-4e5c-a6f1-c3d1a0b320ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:11.312190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 596/1202] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:16:11.594307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f10d06-cb32-441f-9863-467354432f5a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:11.720686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f10d06-cb32-441f-9863-467354432f5a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:11.762539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263d758-203d-45b0-96ba-a89c13920c8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:11.763175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263d758-203d-45b0-96ba-a89c13920c8a None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:11.763455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263d758-203d-45b0-96ba-a89c13920c8a None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:11.763751 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1263d758-203d-45b0-96ba-a89c13920c8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:11.777082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263d758-203d-45b0-96ba-a89c13920c8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:11.778693 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1263d758-203d-45b0-96ba-a89c13920c8a None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-1263d758-203d-45b0-96ba-a89c13920c8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:11.801120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:11.802288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:11.803530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:11.803530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:11.803530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:11.807683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 607/1203] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:11.808825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e123c-619b-4e5c-a6f1-c3d1a0b320ec None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:11.932691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3e123c-619b-4e5c-a6f1-c3d1a0b320ec None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:11.970321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:11.981347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e097cb-ae58-4d21-9b7d-18b093d79d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:11.982052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e097cb-ae58-4d21-9b7d-18b093d79d07 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:11.982477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e097cb-ae58-4d21-9b7d-18b093d79d07 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:11.982790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e097cb-ae58-4d21-9b7d-18b093d79d07 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:11.983513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e097cb-ae58-4d21-9b7d-18b093d79d07 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:11.983853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e097cb-ae58-4d21-9b7d-18b093d79d07 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:11.985255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e097cb-ae58-4d21-9b7d-18b093d79d07 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:11.998863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 597/1204] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:16:12.004350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263d758-203d-45b0-96ba-a89c13920c8a None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:12.067469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:12.128990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1263d758-203d-45b0-96ba-a89c13920c8a None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:12.180960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f385d30d-d764-4d4d-bed2-f86a06f8064c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:12.181574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385d30d-d764-4d4d-bed2-f86a06f8064c None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:12.181850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385d30d-d764-4d4d-bed2-f86a06f8064c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:12.182444 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f385d30d-d764-4d4d-bed2-f86a06f8064c None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:12.183284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385d30d-d764-4d4d-bed2-f86a06f8064c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:12.184962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f385d30d-d764-4d4d-bed2-f86a06f8064c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:12.218662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 608/1205] 10.222.0.16 () {60 vars in 1132 bytes} [Sat Sep 24 14:16:12 2022] POST /identity/v3/users => generated 251 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:16:14.598120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4f718-e536-4795-b135-f389322b7ae6 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:14.598686 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4f718-e536-4795-b135-f389322b7ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:14.598686 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee4f718-e536-4795-b135-f389322b7ae6 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:14.601317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 598/1206] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:14.607130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49311-da61-43cb-8879-eb87c7428f47 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:14.607617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49311-da61-43cb-8879-eb87c7428f47 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:14.607737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e49311-da61-43cb-8879-eb87c7428f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:14.628692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d9e49311-da61-43cb-8879-eb87c7428f47 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:14.629946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d9e49311-da61-43cb-8879-eb87c7428f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:14.710475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 609/1207] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:16:14.985315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4f718-e536-4795-b135-f389322b7ae6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:15.118831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee4f718-e536-4795-b135-f389322b7ae6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:15.164017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf96d-78dd-4c0e-8406-402ee5096c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:15.164868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf96d-78dd-4c0e-8406-402ee5096c42 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:15.165148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf96d-78dd-4c0e-8406-402ee5096c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:15.165423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecacf96d-78dd-4c0e-8406-402ee5096c42 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:15.180169 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecacf96d-78dd-4c0e-8406-402ee5096c42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ecacf96d-78dd-4c0e-8406-402ee5096c42 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:16:15.186325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:15.187687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:15.193210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 599/1208] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:16:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:15.194182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e49311-da61-43cb-8879-eb87c7428f47 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:15.238697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:15.307155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e49311-da61-43cb-8879-eb87c7428f47 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:15.346725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f582629-e977-4aac-9752-e5a1d388e4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:15.346725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f582629-e977-4aac-9752-e5a1d388e4ae None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:15.347063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f582629-e977-4aac-9752-e5a1d388e4ae None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:15.347307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f582629-e977-4aac-9752-e5a1d388e4ae None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:15.347866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f582629-e977-4aac-9752-e5a1d388e4ae None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:15.348183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f582629-e977-4aac-9752-e5a1d388e4ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:15.349605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f582629-e977-4aac-9752-e5a1d388e4ae None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:15.358044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 610/1209] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:16:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:15.364507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf96d-78dd-4c0e-8406-402ee5096c42 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:15.427597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:15.494827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecacf96d-78dd-4c0e-8406-402ee5096c42 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:15.534842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336918-6ed6-4c24-b6f0-bd97264bd073 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:15.535573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336918-6ed6-4c24-b6f0-bd97264bd073 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:15.535956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336918-6ed6-4c24-b6f0-bd97264bd073 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:15.536290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47336918-6ed6-4c24-b6f0-bd97264bd073 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:15.548294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47336918-6ed6-4c24-b6f0-bd97264bd073 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:15.549854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47336918-6ed6-4c24-b6f0-bd97264bd073 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-47336918-6ed6-4c24-b6f0-bd97264bd073 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:15.566529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:15.567571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:15.573292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:15.573292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:15.573292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:15.573292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 600/1210] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:15.575950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f582629-e977-4aac-9752-e5a1d388e4ae None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:15.690288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:15.693689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f582629-e977-4aac-9752-e5a1d388e4ae None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:15.734090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3753b-3968-488e-a1b3-5dfba5c1dcfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:15.734789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3753b-3968-488e-a1b3-5dfba5c1dcfe None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:15.735084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3753b-3968-488e-a1b3-5dfba5c1dcfe None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:15.735385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87f3753b-3968-488e-a1b3-5dfba5c1dcfe None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:15.736060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3753b-3968-488e-a1b3-5dfba5c1dcfe None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:15.736393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3753b-3968-488e-a1b3-5dfba5c1dcfe None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:15.737756 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87f3753b-3968-488e-a1b3-5dfba5c1dcfe None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:15.752007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 611/1211] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:15.757775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336918-6ed6-4c24-b6f0-bd97264bd073 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:15.869075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47336918-6ed6-4c24-b6f0-bd97264bd073 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:15.870636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:15.905864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd763a0c-0858-4618-97bb-e8e09145c859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:15.906533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763a0c-0858-4618-97bb-e8e09145c859 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:15.906824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763a0c-0858-4618-97bb-e8e09145c859 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:15.907062 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd763a0c-0858-4618-97bb-e8e09145c859 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:15.915453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd763a0c-0858-4618-97bb-e8e09145c859 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:15.916955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd763a0c-0858-4618-97bb-e8e09145c859 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-fd763a0c-0858-4618-97bb-e8e09145c859 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:16:15.929530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:15.930588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:15.931580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 601/1212] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:15 2022] GET /identity/v3/users/placement => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:16:15.936755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3753b-3968-488e-a1b3-5dfba5c1dcfe None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:16.063765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87f3753b-3968-488e-a1b3-5dfba5c1dcfe None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:16.120890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f30f1-88e2-4d4f-a867-e0ce7bdc75c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:16.121621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f30f1-88e2-4d4f-a867-e0ce7bdc75c0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:16.121906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f30f1-88e2-4d4f-a867-e0ce7bdc75c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:16.122201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388f30f1-88e2-4d4f-a867-e0ce7bdc75c0 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:16.122951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f30f1-88e2-4d4f-a867-e0ce7bdc75c0 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:16.123256 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f30f1-88e2-4d4f-a867-e0ce7bdc75c0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:16.124725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388f30f1-88e2-4d4f-a867-e0ce7bdc75c0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:16.148253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 612/1213] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 24 14:16:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:16.150223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd763a0c-0858-4618-97bb-e8e09145c859 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:16.285029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd763a0c-0858-4618-97bb-e8e09145c859 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:16.326161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a333893-a9b5-4353-b618-9f13a877c692 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:16.327452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333893-a9b5-4353-b618-9f13a877c692 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:16.328184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333893-a9b5-4353-b618-9f13a877c692 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:16.328766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a333893-a9b5-4353-b618-9f13a877c692 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:16.365494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:16.410996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a333893-a9b5-4353-b618-9f13a877c692 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:16.413266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a333893-a9b5-4353-b618-9f13a877c692 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:16.526361 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 602/1214] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:16:16 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Sep 24 14:16:16.531988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f30f1-88e2-4d4f-a867-e0ce7bdc75c0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:16.551831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:16.638658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388f30f1-88e2-4d4f-a867-e0ce7bdc75c0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:16.676727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d810-465b-407a-a315-a046afb4ef57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:16.677362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d810-465b-407a-a315-a046afb4ef57 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:16.677644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d810-465b-407a-a315-a046afb4ef57 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:16.677934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3d810-465b-407a-a315-a046afb4ef57 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:16.692971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3d810-465b-407a-a315-a046afb4ef57 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:16.694967 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55c3d810-465b-407a-a315-a046afb4ef57 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-55c3d810-465b-407a-a315-a046afb4ef57 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:16.710211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:16.711183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:16.712127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:16.712127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:16.712127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:16.712127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 613/1215] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:16.717548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a333893-a9b5-4353-b618-9f13a877c692 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:16.787661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:16.830195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a333893-a9b5-4353-b618-9f13a877c692 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:16.874395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab0bb9-ad65-4a9c-ae5d-b7038d29334e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:16.875066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab0bb9-ad65-4a9c-ae5d-b7038d29334e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:16.875352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab0bb9-ad65-4a9c-ae5d-b7038d29334e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:16.875671 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ab0bb9-ad65-4a9c-ae5d-b7038d29334e None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:16.876444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab0bb9-ad65-4a9c-ae5d-b7038d29334e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:16.876758 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab0bb9-ad65-4a9c-ae5d-b7038d29334e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:16.878264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2ab0bb9-ad65-4a9c-ae5d-b7038d29334e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:16.901380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 603/1216] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:16.902650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d810-465b-407a-a315-a046afb4ef57 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:16.990406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:17.025438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55c3d810-465b-407a-a315-a046afb4ef57 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:17.061284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401df254-02be-4de4-b6b5-fee00fe196c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:17.061913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401df254-02be-4de4-b6b5-fee00fe196c9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:17.062193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401df254-02be-4de4-b6b5-fee00fe196c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:17.062466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401df254-02be-4de4-b6b5-fee00fe196c9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:17.069977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401df254-02be-4de4-b6b5-fee00fe196c9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:17.071352 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401df254-02be-4de4-b6b5-fee00fe196c9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-401df254-02be-4de4-b6b5-fee00fe196c9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:16:17.082664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:17.083797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:17.085082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:16:17.085082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:16:17.085082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:16:17.085082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:16:17.085082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:16:17.085082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:16:17.085082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:17.085082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:17.085082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 614/1217] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:16:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:16:17.089807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab0bb9-ad65-4a9c-ae5d-b7038d29334e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:17.200462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ab0bb9-ad65-4a9c-ae5d-b7038d29334e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:17.233246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:17.246656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750e8c1c-9fcf-41f3-b0df-3ea80d37cd8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:17.247262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e8c1c-9fcf-41f3-b0df-3ea80d37cd8c None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:17.247537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e8c1c-9fcf-41f3-b0df-3ea80d37cd8c None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:17.247808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750e8c1c-9fcf-41f3-b0df-3ea80d37cd8c None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:17.248554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e8c1c-9fcf-41f3-b0df-3ea80d37cd8c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:17.248853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e8c1c-9fcf-41f3-b0df-3ea80d37cd8c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:17.250373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750e8c1c-9fcf-41f3-b0df-3ea80d37cd8c None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:17.263539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 604/1218] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:16:17 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:17.269857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401df254-02be-4de4-b6b5-fee00fe196c9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:17.383193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401df254-02be-4de4-b6b5-fee00fe196c9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:17.413790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:17.420213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c78d8f2-b4dd-45aa-b755-197f18ec92cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:17.420805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78d8f2-b4dd-45aa-b755-197f18ec92cf None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:17.421086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78d8f2-b4dd-45aa-b755-197f18ec92cf None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:17.421359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c78d8f2-b4dd-45aa-b755-197f18ec92cf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:17.422085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78d8f2-b4dd-45aa-b755-197f18ec92cf None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=2bc00e6583d7424cbdc13732a962fc7b) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:17.422395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78d8f2-b4dd-45aa-b755-197f18ec92cf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:17.423819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c78d8f2-b4dd-45aa-b755-197f18ec92cf None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:17.429530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 615/1219] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:16:17 2022] GET /identity/v3/role_assignments?user.id=2bc00e6583d7424cbdc13732a962fc7b&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:19.612302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c382d09-e88a-4462-b0f9-2c8790008b5e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:19.612824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c382d09-e88a-4462-b0f9-2c8790008b5e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:19.612824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c382d09-e88a-4462-b0f9-2c8790008b5e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:19.614171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 605/1220] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:19.620070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc6d1-e8d7-482f-80a7-97907ee819b7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:19.620567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc6d1-e8d7-482f-80a7-97907ee819b7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:19.620818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cfc6d1-e8d7-482f-80a7-97907ee819b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:19.639986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e3cfc6d1-e8d7-482f-80a7-97907ee819b7 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:19.641714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e3cfc6d1-e8d7-482f-80a7-97907ee819b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:19.717126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 616/1221] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:19 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:16:19.999029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c382d09-e88a-4462-b0f9-2c8790008b5e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:20.120190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c382d09-e88a-4462-b0f9-2c8790008b5e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:20.159607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ffc4-4439-442c-863c-88d3c47e9ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:20.160258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ffc4-4439-442c-863c-88d3c47e9ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:20.160537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ffc4-4439-442c-863c-88d3c47e9ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:20.160812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b499ffc4-4439-442c-863c-88d3c47e9ab2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:20.172445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b499ffc4-4439-442c-863c-88d3c47e9ab2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-b499ffc4-4439-442c-863c-88d3c47e9ab2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:16:20.177133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:20.178357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:20.179371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 606/1222] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:16:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:20.184729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc6d1-e8d7-482f-80a7-97907ee819b7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:20.297236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cfc6d1-e8d7-482f-80a7-97907ee819b7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:20.330153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:20.342598 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03830de-212d-45cb-b2f2-66faa20f3eba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:20.343472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03830de-212d-45cb-b2f2-66faa20f3eba None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:20.343810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03830de-212d-45cb-b2f2-66faa20f3eba None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:20.344087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d03830de-212d-45cb-b2f2-66faa20f3eba None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:20.344897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03830de-212d-45cb-b2f2-66faa20f3eba None admin] RBAC: Adding query filter params (name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:20.345183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03830de-212d-45cb-b2f2-66faa20f3eba None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:20.346952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d03830de-212d-45cb-b2f2-66faa20f3eba None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:20.357277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 617/1223] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:16:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:20.363110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ffc4-4439-442c-863c-88d3c47e9ab2 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:20.409983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:20.476568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b499ffc4-4439-442c-863c-88d3c47e9ab2 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:20.523000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfb3d-82d8-484d-b47b-82f960dc8f76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:20.523638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfb3d-82d8-484d-b47b-82f960dc8f76 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:20.523940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfb3d-82d8-484d-b47b-82f960dc8f76 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:20.524217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfb3d-82d8-484d-b47b-82f960dc8f76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:20.534822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dfb3d-82d8-484d-b47b-82f960dc8f76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:20.536418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dfb3d-82d8-484d-b47b-82f960dc8f76 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-384dfb3d-82d8-484d-b47b-82f960dc8f76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:20.555581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:20.556871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:20.558128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:20.558128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:20.558128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:20.560332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 607/1224] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:20.562604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03830de-212d-45cb-b2f2-66faa20f3eba None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:20.666856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d03830de-212d-45cb-b2f2-66faa20f3eba None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:20.702545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc89ac0-0160-4bc0-bc83-917bbf920255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:20.703202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc89ac0-0160-4bc0-bc83-917bbf920255 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:20.703478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc89ac0-0160-4bc0-bc83-917bbf920255 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:20.703788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc89ac0-0160-4bc0-bc83-917bbf920255 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:20.704477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc89ac0-0160-4bc0-bc83-917bbf920255 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:20.704777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc89ac0-0160-4bc0-bc83-917bbf920255 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:20.706134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc89ac0-0160-4bc0-bc83-917bbf920255 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:20.718275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 618/1225] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:20.724330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfb3d-82d8-484d-b47b-82f960dc8f76 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:20.827372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:20.837728 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfb3d-82d8-484d-b47b-82f960dc8f76 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:20.876796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcdaa0-11b7-4dc7-b2f5-6de57a3021fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:20.877574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcdaa0-11b7-4dc7-b2f5-6de57a3021fd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:20.877896 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcdaa0-11b7-4dc7-b2f5-6de57a3021fd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:20.878161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6dcdaa0-11b7-4dc7-b2f5-6de57a3021fd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:20.890631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcdaa0-11b7-4dc7-b2f5-6de57a3021fd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:20.893132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6dcdaa0-11b7-4dc7-b2f5-6de57a3021fd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-d6dcdaa0-11b7-4dc7-b2f5-6de57a3021fd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:16:20.908443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:20.909456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:20.910749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 608/1226] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:20 2022] GET /identity/v3/users/placement => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:20.916555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc89ac0-0160-4bc0-bc83-917bbf920255 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:20.969342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:21.025708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc89ac0-0160-4bc0-bc83-917bbf920255 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:21.062084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c680fc-331d-4641-9ae5-4d99a2814e4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:21.062734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c680fc-331d-4641-9ae5-4d99a2814e4e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:21.063018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c680fc-331d-4641-9ae5-4d99a2814e4e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:21.063296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c680fc-331d-4641-9ae5-4d99a2814e4e None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:21.064019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c680fc-331d-4641-9ae5-4d99a2814e4e None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:21.064365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c680fc-331d-4641-9ae5-4d99a2814e4e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:21.065963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c680fc-331d-4641-9ae5-4d99a2814e4e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:21.083904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 619/1227] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 24 14:16:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:21.090021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcdaa0-11b7-4dc7-b2f5-6de57a3021fd None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:21.202541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6dcdaa0-11b7-4dc7-b2f5-6de57a3021fd None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:21.242442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90626060-bfa0-46d4-b3ca-7293e995e801 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:21.243086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90626060-bfa0-46d4-b3ca-7293e995e801 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:21.243422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90626060-bfa0-46d4-b3ca-7293e995e801 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:21.243718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90626060-bfa0-46d4-b3ca-7293e995e801 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:21.258299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90626060-bfa0-46d4-b3ca-7293e995e801 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:21.259760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90626060-bfa0-46d4-b3ca-7293e995e801 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-90626060-bfa0-46d4-b3ca-7293e995e801 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:21.274143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:21.275256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:21.276198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:21.276198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:21.276198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:21.276198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 609/1228] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Sep 24 14:16:21.280971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c680fc-331d-4641-9ae5-4d99a2814e4e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:21.394222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c680fc-331d-4641-9ae5-4d99a2814e4e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:21.396901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:21.430738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6857d3-289f-4ad5-8133-f42504e2abc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:21.431345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6857d3-289f-4ad5-8133-f42504e2abc9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:21.431650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6857d3-289f-4ad5-8133-f42504e2abc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:21.431903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6857d3-289f-4ad5-8133-f42504e2abc9 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:21.432583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6857d3-289f-4ad5-8133-f42504e2abc9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:21.432878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6857d3-289f-4ad5-8133-f42504e2abc9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:21.434267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad6857d3-289f-4ad5-8133-f42504e2abc9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:21.446076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 620/1229] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:16:21.451780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90626060-bfa0-46d4-b3ca-7293e995e801 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:21.461305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:21.566520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90626060-bfa0-46d4-b3ca-7293e995e801 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:21.605678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65185339-4c2b-4e32-95b9-9bac1d1c1cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:21.606280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65185339-4c2b-4e32-95b9-9bac1d1c1cb6 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:21.606516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65185339-4c2b-4e32-95b9-9bac1d1c1cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:21.606855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65185339-4c2b-4e32-95b9-9bac1d1c1cb6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:21.614856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65185339-4c2b-4e32-95b9-9bac1d1c1cb6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:21.616470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65185339-4c2b-4e32-95b9-9bac1d1c1cb6 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-65185339-4c2b-4e32-95b9-9bac1d1c1cb6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:16:21.629151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:21.630229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:21.631812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:16:21.631812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:16:21.631812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:16:21.631812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:16:21.631812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:16:21.631812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:16:21.631812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:21.631812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:21.631812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 610/1230] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:16:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:21.636965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6857d3-289f-4ad5-8133-f42504e2abc9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:21.751736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6857d3-289f-4ad5-8133-f42504e2abc9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:21.786204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb501dc-f96a-49b2-9946-136772b21449 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:21.786896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb501dc-f96a-49b2-9946-136772b21449 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:21.787247 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb501dc-f96a-49b2-9946-136772b21449 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:21.787613 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb501dc-f96a-49b2-9946-136772b21449 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:21.788394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb501dc-f96a-49b2-9946-136772b21449 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:21.788773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb501dc-f96a-49b2-9946-136772b21449 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:21.790245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb501dc-f96a-49b2-9946-136772b21449 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:21.802473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 621/1231] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:16:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:21.808737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65185339-4c2b-4e32-95b9-9bac1d1c1cb6 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:21.879715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:21.918091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65185339-4c2b-4e32-95b9-9bac1d1c1cb6 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:21.952773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9b211-d81b-421a-a472-d189e0c8d0fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:21.953545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9b211-d81b-421a-a472-d189e0c8d0fd None admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:21.953886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9b211-d81b-421a-a472-d189e0c8d0fd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:21.954226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9b211-d81b-421a-a472-d189e0c8d0fd None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/2bc00e6583d7424cbdc13732a962fc7b/roles/1020ec02ef4e4735be787d3b7d4a89b5` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:21.969081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9b211-d81b-421a-a472-d189e0c8d0fd None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=2bc00e6583d7424cbdc13732a962fc7b, role_id=1020ec02ef4e4735be787d3b7d4a89b5)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:21.970544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9b211-d81b-421a-a472-d189e0c8d0fd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:21.984375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 611/1232] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:16:21 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/2bc00e6583d7424cbdc13732a962fc7b/roles/1020ec02ef4e4735be787d3b7d4a89b5 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:16:24.261343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23e759-e462-4ab1-a471-63615af687f4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:24.261893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23e759-e462-4ab1-a471-63615af687f4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:24.262089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a23e759-e462-4ab1-a471-63615af687f4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:24.264037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 622/1233] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:24.269426 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19ff4f-fffe-42b1-897b-d15321da487a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:24.270008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19ff4f-fffe-42b1-897b-d15321da487a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:24.270008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc19ff4f-fffe-42b1-897b-d15321da487a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:24.289507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dc19ff4f-fffe-42b1-897b-d15321da487a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:24.290816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc19ff4f-fffe-42b1-897b-d15321da487a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:24.363280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 612/1234] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Sep 24 14:16:24.630872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23e759-e462-4ab1-a471-63615af687f4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:24.659295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:24.748467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a23e759-e462-4ab1-a471-63615af687f4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:24.789663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594f332-ccc6-4f1d-b4c3-7bb68b59b9f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:24.790288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594f332-ccc6-4f1d-b4c3-7bb68b59b9f9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:24.790602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594f332-ccc6-4f1d-b4c3-7bb68b59b9f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:24.790845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f594f332-ccc6-4f1d-b4c3-7bb68b59b9f9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:24.802014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f594f332-ccc6-4f1d-b4c3-7bb68b59b9f9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-f594f332-ccc6-4f1d-b4c3-7bb68b59b9f9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:16:24.807330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:24.812282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:24.813360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 623/1235] 10.222.0.16 () {56 vars in 1102 bytes} [Sat Sep 24 14:16:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:24.814421 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19ff4f-fffe-42b1-897b-d15321da487a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:24.862329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:24.922417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc19ff4f-fffe-42b1-897b-d15321da487a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:24.960735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8506d-64c8-4dd0-88ab-29e836f8619a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:24.961376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8506d-64c8-4dd0-88ab-29e836f8619a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:24.961654 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8506d-64c8-4dd0-88ab-29e836f8619a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:24.961925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a8506d-64c8-4dd0-88ab-29e836f8619a None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:24.962604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8506d-64c8-4dd0-88ab-29e836f8619a None admin] RBAC: Adding query filter params (name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:24.962930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8506d-64c8-4dd0-88ab-29e836f8619a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:24.964316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a8506d-64c8-4dd0-88ab-29e836f8619a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:24.973525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 613/1236] 10.222.0.16 () {56 vars in 1103 bytes} [Sat Sep 24 14:16:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:16:24.980492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594f332-ccc6-4f1d-b4c3-7bb68b59b9f9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:25.072492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:25.090071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f594f332-ccc6-4f1d-b4c3-7bb68b59b9f9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:25.125901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9d645-cb75-41a3-ba57-8a15182196b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:25.126532 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9d645-cb75-41a3-ba57-8a15182196b2 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:25.126807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9d645-cb75-41a3-ba57-8a15182196b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:25.127080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c9d645-cb75-41a3-ba57-8a15182196b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:25.137327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9d645-cb75-41a3-ba57-8a15182196b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:25.138834 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c9d645-cb75-41a3-ba57-8a15182196b2 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-21c9d645-cb75-41a3-ba57-8a15182196b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:25.155109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:25.156398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:25.157771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:25.157771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:25.157771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:25.157771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 624/1237] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:25.162081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8506d-64c8-4dd0-88ab-29e836f8619a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:25.275975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a8506d-64c8-4dd0-88ab-29e836f8619a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:25.284814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:25.310255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3fb6c-6245-4c00-91a8-fa55238e0333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:25.310975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3fb6c-6245-4c00-91a8-fa55238e0333 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:25.311242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3fb6c-6245-4c00-91a8-fa55238e0333 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:25.311622 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f3fb6c-6245-4c00-91a8-fa55238e0333 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:25.312395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3fb6c-6245-4c00-91a8-fa55238e0333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:25.312807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3fb6c-6245-4c00-91a8-fa55238e0333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:25.314303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f3fb6c-6245-4c00-91a8-fa55238e0333 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:25.327452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 614/1238] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:25.333475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9d645-cb75-41a3-ba57-8a15182196b2 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:25.445231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c9d645-cb75-41a3-ba57-8a15182196b2 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:25.485938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a936e-cb37-4b1d-91cf-2d7e0af61e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:25.486575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a936e-cb37-4b1d-91cf-2d7e0af61e73 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:25.486854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a936e-cb37-4b1d-91cf-2d7e0af61e73 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:25.487123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715a936e-cb37-4b1d-91cf-2d7e0af61e73 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:25.490299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:25.495254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a936e-cb37-4b1d-91cf-2d7e0af61e73 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:25.496958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-715a936e-cb37-4b1d-91cf-2d7e0af61e73 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-715a936e-cb37-4b1d-91cf-2d7e0af61e73 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:16:25.508817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:25.510296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:25.511583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 625/1239] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:25 2022] GET /identity/v3/users/placement => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:25.515943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3fb6c-6245-4c00-91a8-fa55238e0333 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:25.622422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f3fb6c-6245-4c00-91a8-fa55238e0333 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:25.656873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad1d3b-64ee-49c8-be9b-974f4f4f421a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:25.657488 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad1d3b-64ee-49c8-be9b-974f4f4f421a None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:25.657785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad1d3b-64ee-49c8-be9b-974f4f4f421a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:25.658038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acad1d3b-64ee-49c8-be9b-974f4f4f421a None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:25.658757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad1d3b-64ee-49c8-be9b-974f4f4f421a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:25.659065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad1d3b-64ee-49c8-be9b-974f4f4f421a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:25.660518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acad1d3b-64ee-49c8-be9b-974f4f4f421a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:25.678291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 615/1240] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 24 14:16:25 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:25.684736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a936e-cb37-4b1d-91cf-2d7e0af61e73 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:25.794026 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715a936e-cb37-4b1d-91cf-2d7e0af61e73 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:25.831911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc266c4-e76f-45f9-a1e9-fd58f59b4f0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:25.832626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc266c4-e76f-45f9-a1e9-fd58f59b4f0e None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:25.832904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc266c4-e76f-45f9-a1e9-fd58f59b4f0e None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:25.833178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc266c4-e76f-45f9-a1e9-fd58f59b4f0e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:25.902948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:25.910671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc266c4-e76f-45f9-a1e9-fd58f59b4f0e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:25.912259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc266c4-e76f-45f9-a1e9-fd58f59b4f0e None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:26.017796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 626/1241] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:16:25 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:16:26.024222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad1d3b-64ee-49c8-be9b-974f4f4f421a None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:26.054436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:26.135145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acad1d3b-64ee-49c8-be9b-974f4f4f421a None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:26.170860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b160f1-f2ff-48a2-8260-866207940071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:26.171424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b160f1-f2ff-48a2-8260-866207940071 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:26.171704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b160f1-f2ff-48a2-8260-866207940071 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:26.171981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b160f1-f2ff-48a2-8260-866207940071 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:26.183500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b160f1-f2ff-48a2-8260-866207940071 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:26.184983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b160f1-f2ff-48a2-8260-866207940071 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-84b160f1-f2ff-48a2-8260-866207940071 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:26.202093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:26.203611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:26.204565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:26.204565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:26.204565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:26.204565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 616/1242] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:26.209992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc266c4-e76f-45f9-a1e9-fd58f59b4f0e None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:26.322222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:26.328692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc266c4-e76f-45f9-a1e9-fd58f59b4f0e None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:26.366114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffed45-c346-467a-9569-b18e9e0d2627 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:26.366767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffed45-c346-467a-9569-b18e9e0d2627 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:26.366979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffed45-c346-467a-9569-b18e9e0d2627 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:26.367251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcffed45-c346-467a-9569-b18e9e0d2627 None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:26.367882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffed45-c346-467a-9569-b18e9e0d2627 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:26.368202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffed45-c346-467a-9569-b18e9e0d2627 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:26.369672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcffed45-c346-467a-9569-b18e9e0d2627 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:26.382294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 627/1243] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:26.388539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b160f1-f2ff-48a2-8260-866207940071 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:26.481905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:26.509714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b160f1-f2ff-48a2-8260-866207940071 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:26.546906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276e23f-e4da-4c8c-a19d-b1ee748ada29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:26.547548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276e23f-e4da-4c8c-a19d-b1ee748ada29 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:26.547841 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276e23f-e4da-4c8c-a19d-b1ee748ada29 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:26.548102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7276e23f-e4da-4c8c-a19d-b1ee748ada29 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:26.554874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276e23f-e4da-4c8c-a19d-b1ee748ada29 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:26.556350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7276e23f-e4da-4c8c-a19d-b1ee748ada29 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-7276e23f-e4da-4c8c-a19d-b1ee748ada29 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:16:26.569464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:26.570555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:26.571457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:16:26.571457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:16:26.571457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:16:26.571457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:16:26.571457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:16:26.571457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:16:26.571457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:26.571457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:26.571457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 617/1244] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:16:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:26.576822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffed45-c346-467a-9569-b18e9e0d2627 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:26.690046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcffed45-c346-467a-9569-b18e9e0d2627 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:26.734230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fea7b2-daf9-4037-9a72-2a27c9367466 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:26.734876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fea7b2-daf9-4037-9a72-2a27c9367466 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:26.735202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fea7b2-daf9-4037-9a72-2a27c9367466 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:26.735563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fea7b2-daf9-4037-9a72-2a27c9367466 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:26.736511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fea7b2-daf9-4037-9a72-2a27c9367466 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:26.736871 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fea7b2-daf9-4037-9a72-2a27c9367466 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:26.741087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fea7b2-daf9-4037-9a72-2a27c9367466 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:26.756586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 628/1245] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:16:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:16:26.761537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276e23f-e4da-4c8c-a19d-b1ee748ada29 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:26.870429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7276e23f-e4da-4c8c-a19d-b1ee748ada29 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:26.907672 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea81eff-a120-4def-95af-757b544962da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:26.908395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea81eff-a120-4def-95af-757b544962da None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:26.908630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea81eff-a120-4def-95af-757b544962da None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:26.908944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea81eff-a120-4def-95af-757b544962da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:26.909704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea81eff-a120-4def-95af-757b544962da None admin] RBAC: Adding query filter params (role.id=1020ec02ef4e4735be787d3b7d4a89b5, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=2bc00e6583d7424cbdc13732a962fc7b) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:26.910012 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea81eff-a120-4def-95af-757b544962da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:26.911537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea81eff-a120-4def-95af-757b544962da None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:26.918152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 618/1246] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:16:26 2022] GET /identity/v3/role_assignments?user.id=2bc00e6583d7424cbdc13732a962fc7b&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=1020ec02ef4e4735be787d3b7d4a89b5 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:29.337584 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e30985-f6be-400e-821a-7b7026204e47 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:29.338310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e30985-f6be-400e-821a-7b7026204e47 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:29.338310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e30985-f6be-400e-821a-7b7026204e47 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:29.339886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 629/1247] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:29.345822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529d0e-c0fe-4f5b-81ac-898efc9fd2c5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:29.346309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529d0e-c0fe-4f5b-81ac-898efc9fd2c5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:29.346585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a529d0e-c0fe-4f5b-81ac-898efc9fd2c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:29.353997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:29.367751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5a529d0e-c0fe-4f5b-81ac-898efc9fd2c5 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:29.369111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5a529d0e-c0fe-4f5b-81ac-898efc9fd2c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:29.443117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 619/1248] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:16:29.725152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e30985-f6be-400e-821a-7b7026204e47 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:29.743284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:29.834562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e30985-f6be-400e-821a-7b7026204e47 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:29.875200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc293dbf-1085-48b4-9a02-13e087cd25c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:29.875993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc293dbf-1085-48b4-9a02-13e087cd25c8 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:29.876319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc293dbf-1085-48b4-9a02-13e087cd25c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:29.876651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc293dbf-1085-48b4-9a02-13e087cd25c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:29.892766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc293dbf-1085-48b4-9a02-13e087cd25c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-cc293dbf-1085-48b4-9a02-13e087cd25c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:16:29.898574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:29.899797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:29.901098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 630/1249] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:16:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:29.906864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a529d0e-c0fe-4f5b-81ac-898efc9fd2c5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:30.009699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a529d0e-c0fe-4f5b-81ac-898efc9fd2c5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:30.039976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:30.045762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea15efc-2a60-4e6c-bd9a-44181cd68e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:30.046363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea15efc-2a60-4e6c-bd9a-44181cd68e99 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:30.046637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea15efc-2a60-4e6c-bd9a-44181cd68e99 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:30.046905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bea15efc-2a60-4e6c-bd9a-44181cd68e99 None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:30.047557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea15efc-2a60-4e6c-bd9a-44181cd68e99 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:30.047860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea15efc-2a60-4e6c-bd9a-44181cd68e99 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:30.049270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bea15efc-2a60-4e6c-bd9a-44181cd68e99 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:30.058836 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 620/1250] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:16:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:16:30.064643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc293dbf-1085-48b4-9a02-13e087cd25c8 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:30.150622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:30.174269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc293dbf-1085-48b4-9a02-13e087cd25c8 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:30.214069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9f36c-4b8f-4483-926c-83f8d1ec3bd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:30.214805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9f36c-4b8f-4483-926c-83f8d1ec3bd5 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:30.215162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9f36c-4b8f-4483-926c-83f8d1ec3bd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:30.215490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb9f36c-4b8f-4483-926c-83f8d1ec3bd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:30.228120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9f36c-4b8f-4483-926c-83f8d1ec3bd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:30.229782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb9f36c-4b8f-4483-926c-83f8d1ec3bd5 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-0eb9f36c-4b8f-4483-926c-83f8d1ec3bd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:30.248392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:30.249502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:30.250729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:30.250729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:30.250729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:30.250729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 631/1251] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:30.255741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea15efc-2a60-4e6c-bd9a-44181cd68e99 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:30.368008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bea15efc-2a60-4e6c-bd9a-44181cd68e99 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:30.402782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc09b-11ec-4795-a322-040f9fac374f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:30.403386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc09b-11ec-4795-a322-040f9fac374f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:30.403698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc09b-11ec-4795-a322-040f9fac374f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:30.403971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7bc09b-11ec-4795-a322-040f9fac374f None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:30.404658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bc09b-11ec-4795-a322-040f9fac374f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:30.404964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bc09b-11ec-4795-a322-040f9fac374f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:30.406353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7bc09b-11ec-4795-a322-040f9fac374f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:30.418651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 621/1252] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:16:30.425024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9f36c-4b8f-4483-926c-83f8d1ec3bd5 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:30.541933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb9f36c-4b8f-4483-926c-83f8d1ec3bd5 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:30.571705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:30.580608 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b01c-3093-419f-bd01-a205b6531dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:30.581265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b01c-3093-419f-bd01-a205b6531dbd None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:30.581548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b01c-3093-419f-bd01-a205b6531dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:30.581826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b8b01c-3093-419f-bd01-a205b6531dbd None admin] PATH_INFO: `/v3/users/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:30.590888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b01c-3093-419f-bd01-a205b6531dbd None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:30.592374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b8b01c-3093-419f-bd01-a205b6531dbd None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-58b8b01c-3093-419f-bd01-a205b6531dbd None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:16:30.605470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:30.611919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:30.613012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 632/1253] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:30 2022] GET /identity/v3/users/placement => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:30.613645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc09b-11ec-4795-a322-040f9fac374f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:30.672363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:30.719401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7bc09b-11ec-4795-a322-040f9fac374f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:30.754609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820982b-e6dd-445e-b377-79c7b35cb776 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:30.755224 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820982b-e6dd-445e-b377-79c7b35cb776 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:30.755507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820982b-e6dd-445e-b377-79c7b35cb776 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:30.756332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7820982b-e6dd-445e-b377-79c7b35cb776 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:30.757067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820982b-e6dd-445e-b377-79c7b35cb776 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:30.757375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820982b-e6dd-445e-b377-79c7b35cb776 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:30.758823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7820982b-e6dd-445e-b377-79c7b35cb776 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:30.779305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 622/1254] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 24 14:16:30 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:30.785158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b01c-3093-419f-bd01-a205b6531dbd None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:30.889963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b8b01c-3093-419f-bd01-a205b6531dbd None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:30.924837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152a130-66f9-43a2-88d2-5c86e6dcfac7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:30.925361 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152a130-66f9-43a2-88d2-5c86e6dcfac7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:30.925644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152a130-66f9-43a2-88d2-5c86e6dcfac7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:30.925921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8152a130-66f9-43a2-88d2-5c86e6dcfac7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:30.982990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:30.995608 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152a130-66f9-43a2-88d2-5c86e6dcfac7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:30.997076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8152a130-66f9-43a2-88d2-5c86e6dcfac7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:31.096030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 633/1255] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:16:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:16:31.102004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820982b-e6dd-445e-b377-79c7b35cb776 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:31.201538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7820982b-e6dd-445e-b377-79c7b35cb776 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:31.217298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:31.245192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a9c7c-f9ac-4731-941c-a2559547285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:31.245885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a9c7c-f9ac-4731-941c-a2559547285f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:31.246203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a9c7c-f9ac-4731-941c-a2559547285f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:31.246477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-006a9c7c-f9ac-4731-941c-a2559547285f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:31.257078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a9c7c-f9ac-4731-941c-a2559547285f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:31.258527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-006a9c7c-f9ac-4731-941c-a2559547285f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-006a9c7c-f9ac-4731-941c-a2559547285f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:31.273189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:31.274347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:31.275292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:31.275292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:31.275292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:31.275292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 623/1256] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:31.280040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152a130-66f9-43a2-88d2-5c86e6dcfac7 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:31.364684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:31.376641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8152a130-66f9-43a2-88d2-5c86e6dcfac7 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:31.409778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113be8c6-af3f-4a8f-90a5-fcafee59e58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:31.410366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113be8c6-af3f-4a8f-90a5-fcafee59e58d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:31.410648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113be8c6-af3f-4a8f-90a5-fcafee59e58d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:31.410922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113be8c6-af3f-4a8f-90a5-fcafee59e58d None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:31.411553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113be8c6-af3f-4a8f-90a5-fcafee59e58d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:31.412395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113be8c6-af3f-4a8f-90a5-fcafee59e58d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:31.413756 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113be8c6-af3f-4a8f-90a5-fcafee59e58d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:31.424589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 634/1257] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:31.430737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a9c7c-f9ac-4731-941c-a2559547285f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:31.526622 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-006a9c7c-f9ac-4731-941c-a2559547285f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:31.559420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301da5c6-30e9-4083-a687-7444055db61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:31.560032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301da5c6-30e9-4083-a687-7444055db61d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:31.560343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301da5c6-30e9-4083-a687-7444055db61d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:31.560619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-301da5c6-30e9-4083-a687-7444055db61d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:31.567025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301da5c6-30e9-4083-a687-7444055db61d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:31.568528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-301da5c6-30e9-4083-a687-7444055db61d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-301da5c6-30e9-4083-a687-7444055db61d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:16:31.579385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:31.580489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:31.581595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:16:31.581595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:16:31.581595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:16:31.581595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:16:31.581595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:16:31.581595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:16:31.581595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:31.581595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:31.581595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 624/1258] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:16:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:31.586347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113be8c6-af3f-4a8f-90a5-fcafee59e58d None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:31.684639 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113be8c6-af3f-4a8f-90a5-fcafee59e58d None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:31.716107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a0f1d2-47bb-4e40-b85d-25c4a24db3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:31.716719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0f1d2-47bb-4e40-b85d-25c4a24db3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:31.717023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0f1d2-47bb-4e40-b85d-25c4a24db3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:31.717297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a0f1d2-47bb-4e40-b85d-25c4a24db3c7 None admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:31.717975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0f1d2-47bb-4e40-b85d-25c4a24db3c7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:31.718279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0f1d2-47bb-4e40-b85d-25c4a24db3c7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:31.719683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a0f1d2-47bb-4e40-b85d-25c4a24db3c7 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:31.731981 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 635/1259] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:16:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:31.737876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301da5c6-30e9-4083-a687-7444055db61d None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:31.762847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:31.835812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-301da5c6-30e9-4083-a687-7444055db61d None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:31.868759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-810ef26f-94e4-4e01-802a-1a0768a2d042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:31.869347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef26f-94e4-4e01-802a-1a0768a2d042 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:31.869628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef26f-94e4-4e01-802a-1a0768a2d042 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:31.869911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-810ef26f-94e4-4e01-802a-1a0768a2d042 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:31.870631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ef26f-94e4-4e01-802a-1a0768a2d042 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=2bc00e6583d7424cbdc13732a962fc7b) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:31.870945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ef26f-94e4-4e01-802a-1a0768a2d042 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:31.872403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-810ef26f-94e4-4e01-802a-1a0768a2d042 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:31.877586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 625/1260] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:16:31 2022] GET /identity/v3/role_assignments?user.id=2bc00e6583d7424cbdc13732a962fc7b&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:33.969461 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a323bb-0ec3-4ed3-be26-e9ee2e4db059 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:33.969993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a323bb-0ec3-4ed3-be26-e9ee2e4db059 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:33.969993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a323bb-0ec3-4ed3-be26-e9ee2e4db059 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:33.971643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 636/1261] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:33.977299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4b4e0-f2cd-4199-943d-823d2c6824ed None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:33.977714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4b4e0-f2cd-4199-943d-823d2c6824ed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:33.977850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce4b4e0-f2cd-4199-943d-823d2c6824ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:33.996305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3ce4b4e0-f2cd-4199-943d-823d2c6824ed None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:33.997489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3ce4b4e0-f2cd-4199-943d-823d2c6824ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:34.061574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 626/1262] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:16:34.351322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a323bb-0ec3-4ed3-be26-e9ee2e4db059 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:34.362137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:34.449289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a323bb-0ec3-4ed3-be26-e9ee2e4db059 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:34.481909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d5b91-e876-4da8-a85a-7408dbe844cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:34.482520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d5b91-e876-4da8-a85a-7408dbe844cb None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:34.482796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d5b91-e876-4da8-a85a-7408dbe844cb None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:34.483066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700d5b91-e876-4da8-a85a-7408dbe844cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:34.493770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700d5b91-e876-4da8-a85a-7408dbe844cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-700d5b91-e876-4da8-a85a-7408dbe844cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:16:34.498506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:34.499636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:34.500533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 637/1263] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:16:34 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:34.505520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4b4e0-f2cd-4199-943d-823d2c6824ed None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:34.522971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:34.600496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce4b4e0-f2cd-4199-943d-823d2c6824ed None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:34.633906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b254ac-0f8f-478a-8e71-951632f50c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:34.634437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b254ac-0f8f-478a-8e71-951632f50c9f None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:34.634712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b254ac-0f8f-478a-8e71-951632f50c9f None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:34.634981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b254ac-0f8f-478a-8e71-951632f50c9f None admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:34.635625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b254ac-0f8f-478a-8e71-951632f50c9f None admin] RBAC: Adding query filter params (name=admin) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:34.635924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b254ac-0f8f-478a-8e71-951632f50c9f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:34.637310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b254ac-0f8f-478a-8e71-951632f50c9f None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:34.644983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 627/1264] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:16:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:34.650655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d5b91-e876-4da8-a85a-7408dbe844cb None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:34.715157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:34.748205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700d5b91-e876-4da8-a85a-7408dbe844cb None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:34.781104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d85465-43d7-4d30-adc9-c2b760742200 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:34.781735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d85465-43d7-4d30-adc9-c2b760742200 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:34.782015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d85465-43d7-4d30-adc9-c2b760742200 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:34.782289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d85465-43d7-4d30-adc9-c2b760742200 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:34.792615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d85465-43d7-4d30-adc9-c2b760742200 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:34.794041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d85465-43d7-4d30-adc9-c2b760742200 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-27d85465-43d7-4d30-adc9-c2b760742200 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:34.808109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:34.809255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:34.810393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:34.810393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:34.810393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:34.810393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 638/1265] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:34.814803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b254ac-0f8f-478a-8e71-951632f50c9f None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:34.892035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:34.910909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b254ac-0f8f-478a-8e71-951632f50c9f None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:34.943133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e37b-5d25-4157-8797-e3868582c370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:34.943726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e37b-5d25-4157-8797-e3868582c370 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:34.944001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e37b-5d25-4157-8797-e3868582c370 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:34.944303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e2e37b-5d25-4157-8797-e3868582c370 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:34.944934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e37b-5d25-4157-8797-e3868582c370 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:34.945235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e37b-5d25-4157-8797-e3868582c370 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:34.946594 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e2e37b-5d25-4157-8797-e3868582c370 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:34.957767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 628/1266] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:34.963911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d85465-43d7-4d30-adc9-c2b760742200 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:35.059016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d85465-43d7-4d30-adc9-c2b760742200 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:35.078239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:35.092652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f923dbb-2e69-40a0-be69-2785f0eb6f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:35.093262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f923dbb-2e69-40a0-be69-2785f0eb6f34 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:35.093542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f923dbb-2e69-40a0-be69-2785f0eb6f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:35.093814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f923dbb-2e69-40a0-be69-2785f0eb6f34 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:35.101738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f923dbb-2e69-40a0-be69-2785f0eb6f34 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:35.103158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f923dbb-2e69-40a0-be69-2785f0eb6f34 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-6f923dbb-2e69-40a0-be69-2785f0eb6f34 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:16:35.114154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:35.115798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:35.117048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 639/1267] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:34 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:35.121482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e37b-5d25-4157-8797-e3868582c370 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:35.222560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e2e37b-5d25-4157-8797-e3868582c370 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:35.256696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd09ed-0592-4d38-9369-ef8f018b2e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:35.257286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd09ed-0592-4d38-9369-ef8f018b2e23 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:35.257562 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd09ed-0592-4d38-9369-ef8f018b2e23 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:35.257829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fd09ed-0592-4d38-9369-ef8f018b2e23 None admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:35.258537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd09ed-0592-4d38-9369-ef8f018b2e23 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:35.258837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd09ed-0592-4d38-9369-ef8f018b2e23 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:35.260300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fd09ed-0592-4d38-9369-ef8f018b2e23 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:35.268623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:35.276978 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 629/1268] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 24 14:16:35 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:35.282788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f923dbb-2e69-40a0-be69-2785f0eb6f34 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:35.382051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f923dbb-2e69-40a0-be69-2785f0eb6f34 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:35.414865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef44d47-2abb-430b-8c9d-c4718d71e651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:35.415468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef44d47-2abb-430b-8c9d-c4718d71e651 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:35.415749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef44d47-2abb-430b-8c9d-c4718d71e651 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:35.416022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef44d47-2abb-430b-8c9d-c4718d71e651 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:35.426165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef44d47-2abb-430b-8c9d-c4718d71e651 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:35.427642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef44d47-2abb-430b-8c9d-c4718d71e651 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-9ef44d47-2abb-430b-8c9d-c4718d71e651 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:35.441313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:35.442423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:35.443823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:35.443823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:35.443823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:35.443823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 640/1269] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:35.448410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd09ed-0592-4d38-9369-ef8f018b2e23 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:35.547416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fd09ed-0592-4d38-9369-ef8f018b2e23 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:35.589245 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e782c11-c1d9-456a-b6b9-bd061276f935 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:35.589835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782c11-c1d9-456a-b6b9-bd061276f935 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:35.590111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782c11-c1d9-456a-b6b9-bd061276f935 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:35.590379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e782c11-c1d9-456a-b6b9-bd061276f935 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:35.591005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e782c11-c1d9-456a-b6b9-bd061276f935 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:35.591304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e782c11-c1d9-456a-b6b9-bd061276f935 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:35.592692 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e782c11-c1d9-456a-b6b9-bd061276f935 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:35.603544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 630/1270] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:35.609247 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef44d47-2abb-430b-8c9d-c4718d71e651 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:35.640414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:35.705841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef44d47-2abb-430b-8c9d-c4718d71e651 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:35.738704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edcc94-269b-4c78-b9a0-8d04089d4e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:35.739251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edcc94-269b-4c78-b9a0-8d04089d4e3b None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:35.739526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edcc94-269b-4c78-b9a0-8d04089d4e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:35.739822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57edcc94-269b-4c78-b9a0-8d04089d4e3b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:35.746175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edcc94-269b-4c78-b9a0-8d04089d4e3b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:35.747581 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57edcc94-269b-4c78-b9a0-8d04089d4e3b None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-57edcc94-269b-4c78-b9a0-8d04089d4e3b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:16:35.758380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:35.759443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:35.760621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:16:35.760621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:16:35.760621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:16:35.760621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:16:35.760621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:16:35.760621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:16:35.760621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:35.760621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:35.760621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 641/1271] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:16:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:35.765196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e782c11-c1d9-456a-b6b9-bd061276f935 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:35.820787 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:35.865319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e782c11-c1d9-456a-b6b9-bd061276f935 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:35.898631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-733b20ea-d583-465f-bebe-d3d095f83ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:35.899227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b20ea-d583-465f-bebe-d3d095f83ffd None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:35.899507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b20ea-d583-465f-bebe-d3d095f83ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:35.899779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-733b20ea-d583-465f-bebe-d3d095f83ffd None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:35.900489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b20ea-d583-465f-bebe-d3d095f83ffd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:35.900798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b20ea-d583-465f-bebe-d3d095f83ffd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:35.902226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-733b20ea-d583-465f-bebe-d3d095f83ffd None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:35.914328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 631/1272] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:16:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:35.920296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edcc94-269b-4c78-b9a0-8d04089d4e3b None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:36.008409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:36.017005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57edcc94-269b-4c78-b9a0-8d04089d4e3b None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:36.049093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad21bdac-d0f4-42e7-b97a-79f2a6596bae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:36.049733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21bdac-d0f4-42e7-b97a-79f2a6596bae None admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:36.050013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21bdac-d0f4-42e7-b97a-79f2a6596bae None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:36.050290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad21bdac-d0f4-42e7-b97a-79f2a6596bae None admin] PATH_INFO: `/v3/projects/4c7108fdf18f40539f06723be34a9255/users/2bc00e6583d7424cbdc13732a962fc7b/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:36.052167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21bdac-d0f4-42e7-b97a-79f2a6596bae None admin] RBAC: Authorizing `identity:create_grant(project_id=4c7108fdf18f40539f06723be34a9255, user_id=2bc00e6583d7424cbdc13732a962fc7b, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:36.054138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad21bdac-d0f4-42e7-b97a-79f2a6596bae None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:36.066000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 642/1273] 10.222.0.16 () {58 vars in 1439 bytes} [Sat Sep 24 14:16:35 2022] PUT /identity/v3/projects/4c7108fdf18f40539f06723be34a9255/users/2bc00e6583d7424cbdc13732a962fc7b/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:16:38.178237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f69be-4468-4152-992e-0db80be6c5ab None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:38.178798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f69be-4468-4152-992e-0db80be6c5ab None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:38.178798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-136f69be-4468-4152-992e-0db80be6c5ab None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:38.180113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 632/1274] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:38.185368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277f878-d190-41bd-864a-5852d2aeda9e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:38.185736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277f878-d190-41bd-864a-5852d2aeda9e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:38.185909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2277f878-d190-41bd-864a-5852d2aeda9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:38.205544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2277f878-d190-41bd-864a-5852d2aeda9e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:38.206923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2277f878-d190-41bd-864a-5852d2aeda9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:38.286363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 643/1275] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:16:38.556364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f69be-4468-4152-992e-0db80be6c5ab None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:38.654154 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-136f69be-4468-4152-992e-0db80be6c5ab None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:38.671011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:38.688000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb329-efc7-4315-848c-62269c84de50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:38.688632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb329-efc7-4315-848c-62269c84de50 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:38.688908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb329-efc7-4315-848c-62269c84de50 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:38.689177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3bb329-efc7-4315-848c-62269c84de50 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:38.699376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3bb329-efc7-4315-848c-62269c84de50 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-2f3bb329-efc7-4315-848c-62269c84de50 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(role_id) Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Sep 24 14:16:38.704015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:38.705151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:38.706417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 633/1276] 10.222.0.16 () {56 vars in 1096 bytes} [Sat Sep 24 14:16:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:38.710951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277f878-d190-41bd-864a-5852d2aeda9e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:38.787660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:38.806028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2277f878-d190-41bd-864a-5852d2aeda9e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:38.838384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1fa05-079b-4941-9b15-ae894e9bb897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:38.838969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1fa05-079b-4941-9b15-ae894e9bb897 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:38.839244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1fa05-079b-4941-9b15-ae894e9bb897 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:38.839511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1fa05-079b-4941-9b15-ae894e9bb897 None admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:38.840177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1fa05-079b-4941-9b15-ae894e9bb897 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:38.840476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1fa05-079b-4941-9b15-ae894e9bb897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:38.841811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1fa05-079b-4941-9b15-ae894e9bb897 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:38.850272 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 644/1277] 10.222.0.16 () {56 vars in 1099 bytes} [Sat Sep 24 14:16:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:38.855853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb329-efc7-4315-848c-62269c84de50 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:38.950210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3bb329-efc7-4315-848c-62269c84de50 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:38.983398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59d708-50de-40a5-b106-d16e74c1dfca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:38.984008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59d708-50de-40a5-b106-d16e74c1dfca None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:38.984321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59d708-50de-40a5-b106-d16e74c1dfca None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:38.984596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef59d708-50de-40a5-b106-d16e74c1dfca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:38.995019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59d708-50de-40a5-b106-d16e74c1dfca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:38.996490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef59d708-50de-40a5-b106-d16e74c1dfca None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-ef59d708-50de-40a5-b106-d16e74c1dfca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:39.010474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:39.011599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:39.012752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:39.012752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:39.012752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:39.012752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 634/1278] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:39.017196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1fa05-079b-4941-9b15-ae894e9bb897 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:39.113248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1fa05-079b-4941-9b15-ae894e9bb897 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:39.145179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f28ec-4662-4878-abe2-1bd69cf08c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:39.145787 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f28ec-4662-4878-abe2-1bd69cf08c5c None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:39.146070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f28ec-4662-4878-abe2-1bd69cf08c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:39.146349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24f28ec-4662-4878-abe2-1bd69cf08c5c None admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:39.146984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f28ec-4662-4878-abe2-1bd69cf08c5c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:39.147288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f28ec-4662-4878-abe2-1bd69cf08c5c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:39.148663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24f28ec-4662-4878-abe2-1bd69cf08c5c None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:39.159882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 645/1279] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:39.165953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59d708-50de-40a5-b106-d16e74c1dfca None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:39.196108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:39.263179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef59d708-50de-40a5-b106-d16e74c1dfca None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:39.295190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef34b5-6afd-462c-937e-b97c458ef3c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:39.295801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef34b5-6afd-462c-937e-b97c458ef3c7 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:39.296073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef34b5-6afd-462c-937e-b97c458ef3c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:39.296368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ef34b5-6afd-462c-937e-b97c458ef3c7 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:39.303920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef34b5-6afd-462c-937e-b97c458ef3c7 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:39.305374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ef34b5-6afd-462c-937e-b97c458ef3c7 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-93ef34b5-6afd-462c-937e-b97c458ef3c7 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_user(user_id) Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Sep 24 14:16:39.316687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:39.318396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:39.319466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 635/1280] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:39 2022] GET /identity/v3/users/placement => generated 87 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:39.324118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f28ec-4662-4878-abe2-1bd69cf08c5c None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:39.327970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:39.421388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24f28ec-4662-4878-abe2-1bd69cf08c5c None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:39.453559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c4f85-8f98-4e8c-9dfc-039116be3ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:39.454145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c4f85-8f98-4e8c-9dfc-039116be3ac9 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:39.454422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c4f85-8f98-4e8c-9dfc-039116be3ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:39.454692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c4f85-8f98-4e8c-9dfc-039116be3ac9 None admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:39.455401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c4f85-8f98-4e8c-9dfc-039116be3ac9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:39.455707 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c4f85-8f98-4e8c-9dfc-039116be3ac9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:39.457146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c4f85-8f98-4e8c-9dfc-039116be3ac9 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:39.474731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 646/1281] 10.222.0.16 () {56 vars in 1143 bytes} [Sat Sep 24 14:16:39 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:39.480423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef34b5-6afd-462c-937e-b97c458ef3c7 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:39.566342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:39.576409 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ef34b5-6afd-462c-937e-b97c458ef3c7 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:39.607989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f05f82-116c-4fb9-a761-c17b11230b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:39.608599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f05f82-116c-4fb9-a761-c17b11230b80 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:39.608874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f05f82-116c-4fb9-a761-c17b11230b80 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:39.609141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f05f82-116c-4fb9-a761-c17b11230b80 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:39.675919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f05f82-116c-4fb9-a761-c17b11230b80 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:39.678883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f05f82-116c-4fb9-a761-c17b11230b80 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:39.769856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:39.780048 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 636/1282] 10.222.0.16 () {58 vars in 1282 bytes} [Sat Sep 24 14:16:39 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Sep 24 14:16:39.785954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c4f85-8f98-4e8c-9dfc-039116be3ac9 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:39.845888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:39.883295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c4f85-8f98-4e8c-9dfc-039116be3ac9 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:39.915949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6f937-afb9-42c6-847e-a30a54ef46b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:39.916589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6f937-afb9-42c6-847e-a30a54ef46b0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:39.916873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6f937-afb9-42c6-847e-a30a54ef46b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:39.917149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def6f937-afb9-42c6-847e-a30a54ef46b0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:39.926918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6f937-afb9-42c6-847e-a30a54ef46b0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:39.928875 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def6f937-afb9-42c6-847e-a30a54ef46b0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-def6f937-afb9-42c6-847e-a30a54ef46b0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Sep 24 14:16:39.942975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:39.944091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Sep 24 14:16:39.945060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Sep 24 14:16:39.945060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Sep 24 14:16:39.945060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:39.945060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 647/1283] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:16:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:39.949813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f05f82-116c-4fb9-a761-c17b11230b80 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:40.048395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f05f82-116c-4fb9-a761-c17b11230b80 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:40.080879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7555e-e70e-49b0-a25e-dfc7d2732183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:40.081467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7555e-e70e-49b0-a25e-dfc7d2732183 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:40.081742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7555e-e70e-49b0-a25e-dfc7d2732183 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:40.082012 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff7555e-e70e-49b0-a25e-dfc7d2732183 None admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:40.082642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7555e-e70e-49b0-a25e-dfc7d2732183 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:40.082940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7555e-e70e-49b0-a25e-dfc7d2732183 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:40.084867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff7555e-e70e-49b0-a25e-dfc7d2732183 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:40.095796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 637/1284] 10.222.0.16 () {56 vars in 1109 bytes} [Sat Sep 24 14:16:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:40.102040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6f937-afb9-42c6-847e-a30a54ef46b0 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:40.204299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def6f937-afb9-42c6-847e-a30a54ef46b0 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:40.218445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:40.239381 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb37d61-218a-406c-af76-fea03760c931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:40.240027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb37d61-218a-406c-af76-fea03760c931 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:40.240343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb37d61-218a-406c-af76-fea03760c931 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:40.240616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb37d61-218a-406c-af76-fea03760c931 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:40.247100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb37d61-218a-406c-af76-fea03760c931 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:40.248740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb37d61-218a-406c-af76-fea03760c931 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application [None req-7fb37d61-218a-406c-af76-fea03760c931 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(project_id) Sep 24 14:16:40.259795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:40.260894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:40.261850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Sep 24 14:16:40.261850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Sep 24 14:16:40.261850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Sep 24 14:16:40.261850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Sep 24 14:16:40.261850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Sep 24 14:16:40.261850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Sep 24 14:16:40.261850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Sep 24 14:16:40.261850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: ERROR keystone.server.flask.application Sep 24 14:16:40.261850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 648/1285] 10.222.0.16 () {56 vars in 1111 bytes} [Sat Sep 24 14:16:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:40.266777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7555e-e70e-49b0-a25e-dfc7d2732183 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:40.315761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:40.365967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff7555e-e70e-49b0-a25e-dfc7d2732183 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:40.398201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a680083d-62b7-4415-a0f0-230dd5ad3be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:40.398789 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680083d-62b7-4415-a0f0-230dd5ad3be0 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:40.399067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680083d-62b7-4415-a0f0-230dd5ad3be0 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:40.399335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a680083d-62b7-4415-a0f0-230dd5ad3be0 None admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:40.400008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680083d-62b7-4415-a0f0-230dd5ad3be0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:40.400338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680083d-62b7-4415-a0f0-230dd5ad3be0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:40.401746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a680083d-62b7-4415-a0f0-230dd5ad3be0 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:40.413564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 638/1286] 10.222.0.16 () {56 vars in 1148 bytes} [Sat Sep 24 14:16:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:16:40.419580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb37d61-218a-406c-af76-fea03760c931 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:40.516231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb37d61-218a-406c-af76-fea03760c931 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:40.548591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12274df4-fe27-4e34-a58a-997d32e24ea0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:40.549174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12274df4-fe27-4e34-a58a-997d32e24ea0 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:40.549451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12274df4-fe27-4e34-a58a-997d32e24ea0 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:40.549720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12274df4-fe27-4e34-a58a-997d32e24ea0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:40.550427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12274df4-fe27-4e34-a58a-997d32e24ea0 None admin] RBAC: Adding query filter params (role.id=d44d12ec4ce44b38acc5e93dcd4f91ff, scope.project.id=4c7108fdf18f40539f06723be34a9255, user.id=2bc00e6583d7424cbdc13732a962fc7b) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:40.550733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12274df4-fe27-4e34-a58a-997d32e24ea0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:40.552679 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12274df4-fe27-4e34-a58a-997d32e24ea0 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:40.558125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 649/1287] 10.222.0.16 () {56 vars in 1374 bytes} [Sat Sep 24 14:16:40 2022] GET /identity/v3/role_assignments?user.id=2bc00e6583d7424cbdc13732a962fc7b&scope.project.id=4c7108fdf18f40539f06723be34a9255&role.id=d44d12ec4ce44b38acc5e93dcd4f91ff => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:42.701880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c870c5-7595-4d9c-a317-d264720aa3fd None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:42.702408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c870c5-7595-4d9c-a317-d264720aa3fd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:42.702408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42c870c5-7595-4d9c-a317-d264720aa3fd None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:42.703795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 639/1288] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:42.709735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503caf68-1711-4298-b4dc-d766b817a430 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:42.710144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503caf68-1711-4298-b4dc-d766b817a430 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:42.710283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503caf68-1711-4298-b4dc-d766b817a430 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:42.728287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-503caf68-1711-4298-b4dc-d766b817a430 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:42.729472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-503caf68-1711-4298-b4dc-d766b817a430 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:42.757974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:42.794805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 650/1289] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:16:43.058986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c870c5-7595-4d9c-a317-d264720aa3fd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:43.157107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42c870c5-7595-4d9c-a317-d264720aa3fd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:43.167794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:43.190813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f91e27-e4b4-406d-bbde-88cd97ff006e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:43.191427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f91e27-e4b4-406d-bbde-88cd97ff006e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:43.191787 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f91e27-e4b4-406d-bbde-88cd97ff006e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:43.192052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f91e27-e4b4-406d-bbde-88cd97ff006e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:43.192956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f91e27-e4b4-406d-bbde-88cd97ff006e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:43.194365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f91e27-e4b4-406d-bbde-88cd97ff006e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-46f91e27-e4b4-406d-bbde-88cd97ff006e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:43.204528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:43.206470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:43.207425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 640/1290] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 24 14:16:43 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:43.213133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503caf68-1711-4298-b4dc-d766b817a430 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:43.317254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503caf68-1711-4298-b4dc-d766b817a430 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:43.350619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ffff1a-35d7-44f9-935c-b2869601052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:43.351222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffff1a-35d7-44f9-935c-b2869601052f None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:43.351503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffff1a-35d7-44f9-935c-b2869601052f None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:43.351780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ffff1a-35d7-44f9-935c-b2869601052f None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:43.352438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffff1a-35d7-44f9-935c-b2869601052f None admin] RBAC: Adding query filter params (name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:43.352745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffff1a-35d7-44f9-935c-b2869601052f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:43.354100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ffff1a-35d7-44f9-935c-b2869601052f None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:43.358749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 651/1291] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 24 14:16:43 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:43.364518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f91e27-e4b4-406d-bbde-88cd97ff006e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:43.460113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f91e27-e4b4-406d-bbde-88cd97ff006e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:43.501715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174a2f36-b366-4fa0-8cc4-ed8714880dc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:43.502321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2f36-b366-4fa0-8cc4-ed8714880dc9 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:43.502604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2f36-b366-4fa0-8cc4-ed8714880dc9 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:43.502880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174a2f36-b366-4fa0-8cc4-ed8714880dc9 None admin] PATH_INFO: `/v3/services` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:43.503503 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a2f36-b366-4fa0-8cc4-ed8714880dc9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:43.503810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a2f36-b366-4fa0-8cc4-ed8714880dc9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:43.505236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174a2f36-b366-4fa0-8cc4-ed8714880dc9 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:43.509586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 641/1292] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 24 14:16:43 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:45.623028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeaff4-c230-48cc-a032-8f14cc344375 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:45.623544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeaff4-c230-48cc-a032-8f14cc344375 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:45.623661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdeaff4-c230-48cc-a032-8f14cc344375 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:45.624953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 652/1293] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:45.630661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb22186-ff95-4dbc-8a69-bd10106da4c8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:45.631059 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb22186-ff95-4dbc-8a69-bd10106da4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:45.631207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb22186-ff95-4dbc-8a69-bd10106da4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:45.649064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ceb22186-ff95-4dbc-8a69-bd10106da4c8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:45.650248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ceb22186-ff95-4dbc-8a69-bd10106da4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:45.679076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:45.716362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 642/1294] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:16:45.982698 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeaff4-c230-48cc-a032-8f14cc344375 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:46.012923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:46.081066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdeaff4-c230-48cc-a032-8f14cc344375 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:46.114621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb634ce-c081-413a-8c18-41fc2b1ae4b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:46.115217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb634ce-c081-413a-8c18-41fc2b1ae4b4 None admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:46.115498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb634ce-c081-413a-8c18-41fc2b1ae4b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:46.115772 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb634ce-c081-413a-8c18-41fc2b1ae4b4 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:46.116457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb634ce-c081-413a-8c18-41fc2b1ae4b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:46.117808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb634ce-c081-413a-8c18-41fc2b1ae4b4 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:46.131599 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 653/1295] 10.222.0.16 () {60 vars in 1141 bytes} [Sat Sep 24 14:16:45 2022] POST /identity/v3/services => generated 246 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:16:48.282915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fda9e-5ce3-4b75-8c0b-7e1cbc615467 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:48.283934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fda9e-5ce3-4b75-8c0b-7e1cbc615467 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:48.284429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672fda9e-5ce3-4b75-8c0b-7e1cbc615467 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:48.285863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 643/1296] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:48.292094 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8723c1-8486-46d9-89da-8ce9fb3b0008 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:48.292526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8723c1-8486-46d9-89da-8ce9fb3b0008 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:48.292774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8723c1-8486-46d9-89da-8ce9fb3b0008 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:48.313518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ea8723c1-8486-46d9-89da-8ce9fb3b0008 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:48.314859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ea8723c1-8486-46d9-89da-8ce9fb3b0008 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:48.385939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 654/1297] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:48 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:16:48.648244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fda9e-5ce3-4b75-8c0b-7e1cbc615467 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:48.746441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672fda9e-5ce3-4b75-8c0b-7e1cbc615467 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:48.779350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe555b-08e1-4f9b-8fb5-28d4ad52be91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:48.779962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe555b-08e1-4f9b-8fb5-28d4ad52be91 None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:48.780288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe555b-08e1-4f9b-8fb5-28d4ad52be91 None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:48.780560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efe555b-08e1-4f9b-8fb5-28d4ad52be91 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:48.781133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe555b-08e1-4f9b-8fb5-28d4ad52be91 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:48.782497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efe555b-08e1-4f9b-8fb5-28d4ad52be91 None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-1efe555b-08e1-4f9b-8fb5-28d4ad52be91 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:48.791079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:48.792381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:48.793545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 644/1298] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 24 14:16:48 2022] GET /identity/v3/services/placement => generated 90 bytes in 144 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:48.798006 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8723c1-8486-46d9-89da-8ce9fb3b0008 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:48.815566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:48.895175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8723c1-8486-46d9-89da-8ce9fb3b0008 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:48.927822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef253-8b9d-4c4f-9fb5-a78850eedd76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:48.928383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef253-8b9d-4c4f-9fb5-a78850eedd76 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:48.928664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef253-8b9d-4c4f-9fb5-a78850eedd76 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:48.928937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993ef253-8b9d-4c4f-9fb5-a78850eedd76 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:48.929563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef253-8b9d-4c4f-9fb5-a78850eedd76 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:48.929867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef253-8b9d-4c4f-9fb5-a78850eedd76 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:48.931209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993ef253-8b9d-4c4f-9fb5-a78850eedd76 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:48.936108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 655/1299] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 24 14:16:48 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:48.941873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe555b-08e1-4f9b-8fb5-28d4ad52be91 None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:48.973165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:49.039046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efe555b-08e1-4f9b-8fb5-28d4ad52be91 None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:49.071654 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b08ce6-baa9-4442-bdf9-d46451cf4f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:49.072266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08ce6-baa9-4442-bdf9-d46451cf4f5d None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:49.072546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08ce6-baa9-4442-bdf9-d46451cf4f5d None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:49.072819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b08ce6-baa9-4442-bdf9-d46451cf4f5d None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:49.073509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b08ce6-baa9-4442-bdf9-d46451cf4f5d None admin] RBAC: Adding query filter params (interface=public, service_id=607cf80821f34b0fbb340899722bfc39, region_id=RegionOne) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:49.073817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b08ce6-baa9-4442-bdf9-d46451cf4f5d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:49.075167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b08ce6-baa9-4442-bdf9-d46451cf4f5d None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:49.079910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 645/1300] 10.222.0.16 () {56 vars in 1251 bytes} [Sat Sep 24 14:16:48 2022] GET /identity/v3/endpoints?service_id=607cf80821f34b0fbb340899722bfc39&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:49.085394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef253-8b9d-4c4f-9fb5-a78850eedd76 None admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:49.164988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:49.183275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993ef253-8b9d-4c4f-9fb5-a78850eedd76 None admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:49.217501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79996218-efa3-4702-a0eb-38d3d1c5871d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:49.218088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996218-efa3-4702-a0eb-38d3d1c5871d None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:49.218364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996218-efa3-4702-a0eb-38d3d1c5871d None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:49.218630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79996218-efa3-4702-a0eb-38d3d1c5871d None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:49.219217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79996218-efa3-4702-a0eb-38d3d1c5871d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:49.220846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79996218-efa3-4702-a0eb-38d3d1c5871d None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:49.227927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 656/1301] 10.222.0.16 () {56 vars in 1087 bytes} [Sat Sep 24 14:16:49 2022] GET /identity/v3/services => generated 2191 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:16:51.347676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667af356-612a-4b05-9519-849cf9276dac None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:51.348235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667af356-612a-4b05-9519-849cf9276dac None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:51.348235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667af356-612a-4b05-9519-849cf9276dac None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:51.349603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 646/1302] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:16:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:16:51.354665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa845-08a3-4897-8be6-39b649a72c4d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:51.355045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa845-08a3-4897-8be6-39b649a72c4d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:51.355219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91fa845-08a3-4897-8be6-39b649a72c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:51.373379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b91fa845-08a3-4897-8be6-39b649a72c4d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:16:51.374554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b91fa845-08a3-4897-8be6-39b649a72c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:16:51.439879 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 657/1303] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:16:51 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Sep 24 14:16:51.712314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667af356-612a-4b05-9519-849cf9276dac None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:51.805441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:51.813336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667af356-612a-4b05-9519-849cf9276dac None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:51.845494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8677-e977-44cc-b1b7-7faf77b9ec7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:51.846105 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8677-e977-44cc-b1b7-7faf77b9ec7e None admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:51.846379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8677-e977-44cc-b1b7-7faf77b9ec7e None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:51.846645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d8677-e977-44cc-b1b7-7faf77b9ec7e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:51.847210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8677-e977-44cc-b1b7-7faf77b9ec7e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:51.849121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d8677-e977-44cc-b1b7-7faf77b9ec7e None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application [None req-e00d8677-e977-44cc-b1b7-7faf77b9ec7e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Traceback (most recent call last): Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application rv = self.dispatch_request() Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Sep 24 14:16:51.857482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._get_service(service_id) Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Sep 24 14:16:51.858691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.get_or_create( Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application with Lock( Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self._enter() Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application return self.creator() Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application created_value = creator( Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: ERROR keystone.server.flask.application Sep 24 14:16:51.859830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 647/1304] 10.222.0.16 () {56 vars in 1117 bytes} [Sat Sep 24 14:16:51 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Sep 24 14:16:51.865098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa845-08a3-4897-8be6-39b649a72c4d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:51.937475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:16:51.960376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91fa845-08a3-4897-8be6-39b649a72c4d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:51.992625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f945d8a4-4c28-4419-96ec-417a34e70570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:51.993158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945d8a4-4c28-4419-96ec-417a34e70570 None admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:51.993437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945d8a4-4c28-4419-96ec-417a34e70570 None admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:51.993709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f945d8a4-4c28-4419-96ec-417a34e70570 None admin] PATH_INFO: `/v3/services` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:51.994332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945d8a4-4c28-4419-96ec-417a34e70570 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:16:51.994635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945d8a4-4c28-4419-96ec-417a34e70570 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:51.995979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f945d8a4-4c28-4419-96ec-417a34e70570 None admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:52.000929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 658/1305] 10.222.0.16 () {56 vars in 1116 bytes} [Sat Sep 24 14:16:51 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:16:52.007014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8677-e977-44cc-b1b7-7faf77b9ec7e None admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:16:52.102133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d8677-e977-44cc-b1b7-7faf77b9ec7e None admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:16:52.136476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91f3e3a-2a6d-4fed-992b-a6c5806ee43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:16:52.137073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3e3a-2a6d-4fed-992b-a6c5806ee43a None admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:16:52.137351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3e3a-2a6d-4fed-992b-a6c5806ee43a None admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:16:52.137620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91f3e3a-2a6d-4fed-992b-a6c5806ee43a None admin] PATH_INFO: `/v3/endpoints` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:16:52.138293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f3e3a-2a6d-4fed-992b-a6c5806ee43a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:16:52.139644 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91f3e3a-2a6d-4fed-992b-a6c5806ee43a None admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:16:52.158272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 648/1306] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:16:52 2022] POST /identity/v3/endpoints => generated 331 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:17:02.001662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=30 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:17:02.154138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:17:55.598371 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b6c18-8413-4db1-b121-be6c795d2d70 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:17:55.598918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b6c18-8413-4db1-b121-be6c795d2d70 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:17:55.598918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551b6c18-8413-4db1-b121-be6c795d2d70 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:17:55.604222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 659/1307] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:17:55 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:17:55.605455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d6ed-5fc5-488d-aa6f-21ea347c1e7c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:17:55.606018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d6ed-5fc5-488d-aa6f-21ea347c1e7c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:17:55.606018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e5d6ed-5fc5-488d-aa6f-21ea347c1e7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:17:55.705124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-33e5d6ed-5fc5-488d-aa6f-21ea347c1e7c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:17:55.706441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-33e5d6ed-5fc5-488d-aa6f-21ea347c1e7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:17:55.822021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 649/1308] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:17:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:17:56.116890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de57f9-9ef7-429a-8138-9bde74dddf93 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:17:56.117560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de57f9-9ef7-429a-8138-9bde74dddf93 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:17:56.117842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de57f9-9ef7-429a-8138-9bde74dddf93 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:17:56.119410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 660/1309] 10.222.0.16 () {54 vars in 964 bytes} [Sat Sep 24 14:17:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:17:56.126575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1537ee0-b2ef-421e-9353-4a389b780ce7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:17:56.126942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1537ee0-b2ef-421e-9353-4a389b780ce7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:17:56.127423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1537ee0-b2ef-421e-9353-4a389b780ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:17:56.211403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f1537ee0-b2ef-421e-9353-4a389b780ce7 None None] MFA Rules not processed for user `7014b2868d4b4acea242d068f247c21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:17:56.212650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f1537ee0-b2ef-421e-9353-4a389b780ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:17:56.237447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:17:56.298330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 650/1310] 10.222.0.16 () {58 vars in 1061 bytes} [Sat Sep 24 14:17:56 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:17:56.307435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de57f9-9ef7-429a-8138-9bde74dddf93 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:17:56.309219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-27de57f9-9ef7-429a-8138-9bde74dddf93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:17:56.429967 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de57f9-9ef7-429a-8138-9bde74dddf93 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:17:56.514129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09231d77-d74e-4def-8172-b2cbfe038a39 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:17:56.514837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09231d77-d74e-4def-8172-b2cbfe038a39 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:17:56.515181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09231d77-d74e-4def-8172-b2cbfe038a39 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:17:56.515519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09231d77-d74e-4def-8172-b2cbfe038a39 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:17:56.517709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-09231d77-d74e-4def-8172-b2cbfe038a39 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:17:56.580764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:17:56.641058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09231d77-d74e-4def-8172-b2cbfe038a39 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:17:56.642493 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09231d77-d74e-4def-8172-b2cbfe038a39 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:17:56.662982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 661/1311] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:17:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:17:59.117816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd684-b289-4d51-bea0-18c718d2c426 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:17:59.118347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd684-b289-4d51-bea0-18c718d2c426 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:17:59.118347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3fd684-b289-4d51-bea0-18c718d2c426 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:17:59.119613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 651/1312] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:17:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:17:59.124698 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645b05b-dd74-40e0-8c42-6eb578508060 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:17:59.125080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645b05b-dd74-40e0-8c42-6eb578508060 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:17:59.125823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4645b05b-dd74-40e0-8c42-6eb578508060 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:17:59.205893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4645b05b-dd74-40e0-8c42-6eb578508060 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:17:59.207084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4645b05b-dd74-40e0-8c42-6eb578508060 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:17:59.304299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 662/1313] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:17:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:17:59.591349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fd684-b289-4d51-bea0-18c718d2c426 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:17:59.593230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5d3fd684-b289-4d51-bea0-18c718d2c426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:17:59.693537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3fd684-b289-4d51-bea0-18c718d2c426 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:17:59.764006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:17:59.767161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3772ac-acd4-4434-a7d2-5a30005dfcec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:17:59.767772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3772ac-acd4-4434-a7d2-5a30005dfcec service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:17:59.768340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3772ac-acd4-4434-a7d2-5a30005dfcec service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:17:59.768654 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3772ac-acd4-4434-a7d2-5a30005dfcec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:17:59.770655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1d3772ac-acd4-4434-a7d2-5a30005dfcec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:17:59.877726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3772ac-acd4-4434-a7d2-5a30005dfcec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:17:59.879083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3772ac-acd4-4434-a7d2-5a30005dfcec service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:17:59.896916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 652/1314] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:17:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:02.382230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b1bb2-550f-4dac-8033-0fd4ae569c84 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:02.382798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b1bb2-550f-4dac-8033-0fd4ae569c84 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:02.382798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b1bb2-550f-4dac-8033-0fd4ae569c84 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:02.384118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 663/1315] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:02.389199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0236-22f2-42aa-9272-cb8963f69756 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:02.389618 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0236-22f2-42aa-9272-cb8963f69756 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:02.389753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468e0236-22f2-42aa-9272-cb8963f69756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:02.454537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-468e0236-22f2-42aa-9272-cb8963f69756 None None] MFA Rules not processed for user `e2c14d578d004e15b160825c91ab523c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:02.455742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-468e0236-22f2-42aa-9272-cb8963f69756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:02.506559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:02.550951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 653/1316] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:02 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:02.840212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b1bb2-550f-4dac-8033-0fd4ae569c84 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:02.841773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-378b1bb2-550f-4dac-8033-0fd4ae569c84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:02.853432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:02.945660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b1bb2-550f-4dac-8033-0fd4ae569c84 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:03.019607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a15d8c-b73f-45de-9070-f0ea6363e0db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:03.020227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15d8c-b73f-45de-9070-f0ea6363e0db service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:03.020507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15d8c-b73f-45de-9070-f0ea6363e0db service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:03.020777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a15d8c-b73f-45de-9070-f0ea6363e0db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:03.022358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-71a15d8c-b73f-45de-9070-f0ea6363e0db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:03.082552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:03.128861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a15d8c-b73f-45de-9070-f0ea6363e0db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:03.130279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a15d8c-b73f-45de-9070-f0ea6363e0db service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:03.148132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 664/1317] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:02 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:05.898697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290f4af-3be6-4b69-8992-3e437f771201 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:05.899246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290f4af-3be6-4b69-8992-3e437f771201 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:05.899246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5290f4af-3be6-4b69-8992-3e437f771201 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:05.900603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 654/1318] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:05.905733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3738f-4c26-4c5c-928a-2656f17a2f9b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:05.906705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3738f-4c26-4c5c-928a-2656f17a2f9b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:05.906847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d3738f-4c26-4c5c-928a-2656f17a2f9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:05.972024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-15d3738f-4c26-4c5c-928a-2656f17a2f9b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:05.973255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-15d3738f-4c26-4c5c-928a-2656f17a2f9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:06.070600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 665/1319] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:05 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:18:06.351552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290f4af-3be6-4b69-8992-3e437f771201 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:06.353138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5290f4af-3be6-4b69-8992-3e437f771201 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:06.454943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5290f4af-3be6-4b69-8992-3e437f771201 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:06.528071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c82e2a-9b4e-44de-b18a-9aad906b4467 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:06.528703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c82e2a-9b4e-44de-b18a-9aad906b4467 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:06.528983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c82e2a-9b4e-44de-b18a-9aad906b4467 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:06.529258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c82e2a-9b4e-44de-b18a-9aad906b4467 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:06.530850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-87c82e2a-9b4e-44de-b18a-9aad906b4467 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:06.537681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:06.643721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c82e2a-9b4e-44de-b18a-9aad906b4467 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:06.645100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c82e2a-9b4e-44de-b18a-9aad906b4467 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:06.663033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 655/1320] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:06 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:09.454287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69978c4e-34ec-4e4b-b579-d15324f8a9e8 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:09.454820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69978c4e-34ec-4e4b-b579-d15324f8a9e8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:09.454820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69978c4e-34ec-4e4b-b579-d15324f8a9e8 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:09.456195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 666/1321] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:09.461544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62b558-bd8b-412c-a8bf-c50910d3563d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:09.461951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62b558-bd8b-412c-a8bf-c50910d3563d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:09.462100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62b558-bd8b-412c-a8bf-c50910d3563d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:09.536132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3e62b558-bd8b-412c-a8bf-c50910d3563d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:09.537419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3e62b558-bd8b-412c-a8bf-c50910d3563d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:09.600218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:09.646653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 656/1322] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:09.925049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69978c4e-34ec-4e4b-b579-d15324f8a9e8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:09.926592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-69978c4e-34ec-4e4b-b579-d15324f8a9e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:09.946650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:10.033409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69978c4e-34ec-4e4b-b579-d15324f8a9e8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:10.106520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-517dd2ad-4b65-434c-8353-ff93d22e7296 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:10.107116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dd2ad-4b65-434c-8353-ff93d22e7296 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:10.107393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dd2ad-4b65-434c-8353-ff93d22e7296 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:10.107664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-517dd2ad-4b65-434c-8353-ff93d22e7296 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:10.109819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-517dd2ad-4b65-434c-8353-ff93d22e7296 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:10.181043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:10.227942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dd2ad-4b65-434c-8353-ff93d22e7296 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:10.229424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-517dd2ad-4b65-434c-8353-ff93d22e7296 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:10.248093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 667/1323] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:12.477310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ff98b-339f-4075-ba05-c90eb12031ae None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:12.477857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ff98b-339f-4075-ba05-c90eb12031ae None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:12.477857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3ff98b-339f-4075-ba05-c90eb12031ae None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:12.479170 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 657/1324] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:12.485267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ed23-b2ac-4874-9667-f5926f55628d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:12.485748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ed23-b2ac-4874-9667-f5926f55628d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:12.486302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb0ed23-b2ac-4874-9667-f5926f55628d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:12.558322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3bb0ed23-b2ac-4874-9667-f5926f55628d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:12.559550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3bb0ed23-b2ac-4874-9667-f5926f55628d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:12.657637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 668/1325] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:12.954330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ff98b-339f-4075-ba05-c90eb12031ae None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:12.955916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bf3ff98b-339f-4075-ba05-c90eb12031ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:13.059596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3ff98b-339f-4075-ba05-c90eb12031ae None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:13.132666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e010f0-50d2-4406-96c4-e956db673e25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:13.133281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e010f0-50d2-4406-96c4-e956db673e25 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:13.133560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e010f0-50d2-4406-96c4-e956db673e25 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:13.133833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e010f0-50d2-4406-96c4-e956db673e25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:13.135433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-88e010f0-50d2-4406-96c4-e956db673e25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:13.159996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:13.255189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e010f0-50d2-4406-96c4-e956db673e25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:13.256689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e010f0-50d2-4406-96c4-e956db673e25 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:13.275203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 658/1326] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:15.493926 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad9a8-ae04-42ef-996e-55965b0a0d31 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:15.494376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad9a8-ae04-42ef-996e-55965b0a0d31 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:15.494472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6ad9a8-ae04-42ef-996e-55965b0a0d31 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:15.495832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 669/1327] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:15.501300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38c94-0c6e-4e6f-808f-73a6d59eef3d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:15.501731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38c94-0c6e-4e6f-808f-73a6d59eef3d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:15.501828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d38c94-0c6e-4e6f-808f-73a6d59eef3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:15.566271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b2d38c94-0c6e-4e6f-808f-73a6d59eef3d None None] MFA Rules not processed for user `e2c14d578d004e15b160825c91ab523c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:15.567473 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b2d38c94-0c6e-4e6f-808f-73a6d59eef3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:15.631742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:15.662818 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 659/1328] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:15 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:15.946297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad9a8-ae04-42ef-996e-55965b0a0d31 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:15.947767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8b6ad9a8-ae04-42ef-996e-55965b0a0d31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:15.980076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:16.052755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6ad9a8-ae04-42ef-996e-55965b0a0d31 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:16.129905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce8840c9-35f7-469e-8962-ad4be5aef303 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:16.130502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8840c9-35f7-469e-8962-ad4be5aef303 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:16.130779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8840c9-35f7-469e-8962-ad4be5aef303 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:16.131050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce8840c9-35f7-469e-8962-ad4be5aef303 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:16.132667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ce8840c9-35f7-469e-8962-ad4be5aef303 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:16.210812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:16.243715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8840c9-35f7-469e-8962-ad4be5aef303 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:16.245202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce8840c9-35f7-469e-8962-ad4be5aef303 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:16.263022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 670/1329] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:15 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:18.608932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cfa5e-5933-4e79-8ec2-d75c644a726c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:18.609476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cfa5e-5933-4e79-8ec2-d75c644a726c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:18.609476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84cfa5e-5933-4e79-8ec2-d75c644a726c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:18.610826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 660/1330] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:18:18.616095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2b5af-db63-4449-907d-71b4fd29d76a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:18.616539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2b5af-db63-4449-907d-71b4fd29d76a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:18.616677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc2b5af-db63-4449-907d-71b4fd29d76a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:18.681942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4cc2b5af-db63-4449-907d-71b4fd29d76a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:18.683122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4cc2b5af-db63-4449-907d-71b4fd29d76a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:18.780014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 671/1331] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:19.064128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cfa5e-5933-4e79-8ec2-d75c644a726c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:19.065782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f84cfa5e-5933-4e79-8ec2-d75c644a726c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:19.166720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84cfa5e-5933-4e79-8ec2-d75c644a726c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:19.239244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13826c-7013-46c1-b90a-a8a1c85235ec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:19.239843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13826c-7013-46c1-b90a-a8a1c85235ec service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:19.240122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13826c-7013-46c1-b90a-a8a1c85235ec service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:19.240427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13826c-7013-46c1-b90a-a8a1c85235ec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:19.242003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-db13826c-7013-46c1-b90a-a8a1c85235ec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:19.268488 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:19.348781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13826c-7013-46c1-b90a-a8a1c85235ec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:19.350140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13826c-7013-46c1-b90a-a8a1c85235ec service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:19.368246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 661/1332] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:21.540613 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b2c2f-ed0a-4c84-b7a2-31c8920ef90d None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:21.541133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b2c2f-ed0a-4c84-b7a2-31c8920ef90d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:21.541133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb7b2c2f-ed0a-4c84-b7a2-31c8920ef90d None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:21.542484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 672/1333] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:21.548291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a008f-4cec-4b37-a317-00e915a93852 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:21.548676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a008f-4cec-4b37-a317-00e915a93852 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:21.548832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05a008f-4cec-4b37-a317-00e915a93852 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:21.613561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b05a008f-4cec-4b37-a317-00e915a93852 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:21.614768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b05a008f-4cec-4b37-a317-00e915a93852 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:21.688803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:21.710419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 662/1334] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:21.994759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b2c2f-ed0a-4c84-b7a2-31c8920ef90d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:21.996366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-eb7b2c2f-ed0a-4c84-b7a2-31c8920ef90d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:22.037095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:22.107762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb7b2c2f-ed0a-4c84-b7a2-31c8920ef90d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:22.180366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed07614e-573f-415f-8c00-a6e7030b331d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:22.180968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07614e-573f-415f-8c00-a6e7030b331d service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:22.181246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07614e-573f-415f-8c00-a6e7030b331d service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:22.181522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed07614e-573f-415f-8c00-a6e7030b331d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:22.183124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ed07614e-573f-415f-8c00-a6e7030b331d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:22.270982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:22.296944 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07614e-573f-415f-8c00-a6e7030b331d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:22.298387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed07614e-573f-415f-8c00-a6e7030b331d service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:22.315946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 673/1335] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:24.769658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175136a-5d7a-4812-82d7-4e6ac79143d5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:24.770206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175136a-5d7a-4812-82d7-4e6ac79143d5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:24.770206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c175136a-5d7a-4812-82d7-4e6ac79143d5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:24.771554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 663/1336] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:24.776660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841305a-b5c9-484d-ba5b-314b68ac32d1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:24.777074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841305a-b5c9-484d-ba5b-314b68ac32d1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:24.777212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841305a-b5c9-484d-ba5b-314b68ac32d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:24.849157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d841305a-b5c9-484d-ba5b-314b68ac32d1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:24.850377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d841305a-b5c9-484d-ba5b-314b68ac32d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:24.947613 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 674/1337] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:24 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:25.230423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175136a-5d7a-4812-82d7-4e6ac79143d5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:25.232052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c175136a-5d7a-4812-82d7-4e6ac79143d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:25.332930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c175136a-5d7a-4812-82d7-4e6ac79143d5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:25.407123 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bf6d9e-c010-4061-b9b0-3c776d52305c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:25.407727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6d9e-c010-4061-b9b0-3c776d52305c service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:25.408006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6d9e-c010-4061-b9b0-3c776d52305c service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:25.408305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bf6d9e-c010-4061-b9b0-3c776d52305c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:25.409901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-62bf6d9e-c010-4061-b9b0-3c776d52305c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:25.445299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:25.518715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf6d9e-c010-4061-b9b0-3c776d52305c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:25.520168 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62bf6d9e-c010-4061-b9b0-3c776d52305c service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:25.538513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 664/1338] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:25 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:29.569741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6c7dc-e607-4b5c-a0dc-1b1da70b67a3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:29.570264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6c7dc-e607-4b5c-a0dc-1b1da70b67a3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:29.570264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba6c7dc-e607-4b5c-a0dc-1b1da70b67a3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:29.571574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 675/1339] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:29.577022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb555e07-6b6d-4b28-8ad3-f613f7199a29 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:29.577438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb555e07-6b6d-4b28-8ad3-f613f7199a29 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:29.577565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb555e07-6b6d-4b28-8ad3-f613f7199a29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:29.643419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-eb555e07-6b6d-4b28-8ad3-f613f7199a29 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:29.644589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-eb555e07-6b6d-4b28-8ad3-f613f7199a29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:29.730099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:29.741546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 665/1340] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:30.021158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6c7dc-e607-4b5c-a0dc-1b1da70b67a3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:30.022678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5ba6c7dc-e607-4b5c-a0dc-1b1da70b67a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:30.078211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:30.136856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba6c7dc-e607-4b5c-a0dc-1b1da70b67a3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:30.211128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bbb226e-7113-403d-a922-c5f6835607b6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:30.211729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb226e-7113-403d-a922-c5f6835607b6 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:30.212021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb226e-7113-403d-a922-c5f6835607b6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:30.212305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bbb226e-7113-403d-a922-c5f6835607b6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:30.213882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3bbb226e-7113-403d-a922-c5f6835607b6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:30.307326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:30.324398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb226e-7113-403d-a922-c5f6835607b6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:30.325845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bbb226e-7113-403d-a922-c5f6835607b6 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:30.344884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 676/1341] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:33.130769 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9943b-5dd9-490b-8b67-218a4d81ae0c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:33.131321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9943b-5dd9-490b-8b67-218a4d81ae0c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:33.131321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9943b-5dd9-490b-8b67-218a4d81ae0c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:33.132601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 666/1342] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:33.137628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300214d-54d5-408f-9d87-7b9b8e855caf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:33.138075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300214d-54d5-408f-9d87-7b9b8e855caf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:33.138326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1300214d-54d5-408f-9d87-7b9b8e855caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:33.205014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1300214d-54d5-408f-9d87-7b9b8e855caf None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:33.206265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1300214d-54d5-408f-9d87-7b9b8e855caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:33.310261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 677/1343] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:33.591149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9943b-5dd9-490b-8b67-218a4d81ae0c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:33.593075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-95f9943b-5dd9-490b-8b67-218a4d81ae0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:33.703093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9943b-5dd9-490b-8b67-218a4d81ae0c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:33.777043 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6bf692-0b5d-47ca-bb13-b1a7174f6c30 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:33.777786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bf692-0b5d-47ca-bb13-b1a7174f6c30 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:33.778062 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bf692-0b5d-47ca-bb13-b1a7174f6c30 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:33.778332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6bf692-0b5d-47ca-bb13-b1a7174f6c30 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:33.780453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8a6bf692-0b5d-47ca-bb13-b1a7174f6c30 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:33.822424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:33.890852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6bf692-0b5d-47ca-bb13-b1a7174f6c30 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:33.892331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6bf692-0b5d-47ca-bb13-b1a7174f6c30 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:33.912187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 667/1344] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:33 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:38.025942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb840-7030-4b46-af4e-2100bc25afec None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:38.026439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb840-7030-4b46-af4e-2100bc25afec None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:38.026533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5eb840-7030-4b46-af4e-2100bc25afec None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:38.027825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 678/1345] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:38.033113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94e92-6e8f-4a6e-ab53-5e4369c54d0f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:38.033528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94e92-6e8f-4a6e-ab53-5e4369c54d0f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:38.033623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b94e92-6e8f-4a6e-ab53-5e4369c54d0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:38.099189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-24b94e92-6e8f-4a6e-ab53-5e4369c54d0f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:38.100436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-24b94e92-6e8f-4a6e-ab53-5e4369c54d0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:38.193056 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:38.195232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 668/1346] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:38.474414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb840-7030-4b46-af4e-2100bc25afec None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:38.475955 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ae5eb840-7030-4b46-af4e-2100bc25afec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:38.533934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:38.579365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5eb840-7030-4b46-af4e-2100bc25afec None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:38.651380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2416c1b-7faf-483f-805b-afdcd17b9b6b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:38.651977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2416c1b-7faf-483f-805b-afdcd17b9b6b service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:38.652285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2416c1b-7faf-483f-805b-afdcd17b9b6b service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:38.652560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2416c1b-7faf-483f-805b-afdcd17b9b6b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:38.654709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a2416c1b-7faf-483f-805b-afdcd17b9b6b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:38.764482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:38.767880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2416c1b-7faf-483f-805b-afdcd17b9b6b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:38.769882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2416c1b-7faf-483f-805b-afdcd17b9b6b service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:38.788909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 679/1347] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:43.717741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fd476-586d-4036-823b-0212f9c6fc3b None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:43.717741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fd476-586d-4036-823b-0212f9c6fc3b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:43.717741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2fd476-586d-4036-823b-0212f9c6fc3b None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:43.719677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 669/1348] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:18:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:43.724562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e083da-2c57-44ce-9e81-2f5c9229c3de None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:43.724977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e083da-2c57-44ce-9e81-2f5c9229c3de None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:43.725150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e083da-2c57-44ce-9e81-2f5c9229c3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:43.810485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d7e083da-2c57-44ce-9e81-2f5c9229c3de None None] MFA Rules not processed for user `2bc00e6583d7424cbdc13732a962fc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:43.811899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d7e083da-2c57-44ce-9e81-2f5c9229c3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:43.974575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 680/1349] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:18:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:18:48.027910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac3b7-7640-4133-9364-4e8326efadbf None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:48.029008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac3b7-7640-4133-9364-4e8326efadbf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:48.029008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28eac3b7-7640-4133-9364-4e8326efadbf None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:48.030336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 670/1350] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:18:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:48.035152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2443d-72c4-41e5-94fe-eb5ec3304f45 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:48.035569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2443d-72c4-41e5-94fe-eb5ec3304f45 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:48.035772 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b2443d-72c4-41e5-94fe-eb5ec3304f45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:48.089103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:48.114454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-86b2443d-72c4-41e5-94fe-eb5ec3304f45 None None] MFA Rules not processed for user `2bc00e6583d7424cbdc13732a962fc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:48.115650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-86b2443d-72c4-41e5-94fe-eb5ec3304f45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:48.228649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 681/1351] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:18:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:49.768011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f24aa-9b9a-4de4-bdb5-39b6ab84a3ed None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:49.768563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f24aa-9b9a-4de4-bdb5-39b6ab84a3ed None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:49.768711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f24aa-9b9a-4de4-bdb5-39b6ab84a3ed None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:49.770246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 671/1352] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:18:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:49.776453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373326b-8d46-4365-9489-38bb5dff62a6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:49.776863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373326b-8d46-4365-9489-38bb5dff62a6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:49.777003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1373326b-8d46-4365-9489-38bb5dff62a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:49.854016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1373326b-8d46-4365-9489-38bb5dff62a6 None None] MFA Rules not processed for user `2bc00e6583d7424cbdc13732a962fc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:49.855201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1373326b-8d46-4365-9489-38bb5dff62a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:49.897219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:49.962825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 682/1353] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:18:49 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:53.454248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5717-1f6c-4631-b7f1-69045d9337a8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:53.454765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5717-1f6c-4631-b7f1-69045d9337a8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:53.454765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92c5717-1f6c-4631-b7f1-69045d9337a8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:53.456039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 672/1354] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:53.461553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfdf6a-0997-4b85-91a5-6a31fa35af89 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:53.461959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfdf6a-0997-4b85-91a5-6a31fa35af89 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:53.462116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7dfdf6a-0997-4b85-91a5-6a31fa35af89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:53.546219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b7dfdf6a-0997-4b85-91a5-6a31fa35af89 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:53.547344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b7dfdf6a-0997-4b85-91a5-6a31fa35af89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:53.650833 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 683/1355] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:53.961508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527015b-ed3c-4314-bbe4-29d1bf832cba None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:53.962138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527015b-ed3c-4314-bbe4-29d1bf832cba None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:53.962726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e527015b-ed3c-4314-bbe4-29d1bf832cba None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:53.964754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 673/1356] 10.222.0.16 () {54 vars in 961 bytes} [Sat Sep 24 14:18:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:53.973611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee82916-dbf0-4324-a00f-a009e124128d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:53.974174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee82916-dbf0-4324-a00f-a009e124128d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:53.974939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee82916-dbf0-4324-a00f-a009e124128d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:54.003611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:54.073794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fee82916-dbf0-4324-a00f-a009e124128d None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:54.075132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fee82916-dbf0-4324-a00f-a009e124128d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:54.200558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 684/1357] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Sep 24 14:18:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:18:54.208595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527015b-ed3c-4314-bbe4-29d1bf832cba None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:54.210399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e527015b-ed3c-4314-bbe4-29d1bf832cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:54.369814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e527015b-ed3c-4314-bbe4-29d1bf832cba None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:54.446636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:54.505774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e746f85e-6c77-40ef-a98b-e38235c68d4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:54.506376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746f85e-6c77-40ef-a98b-e38235c68d4d service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:54.506658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746f85e-6c77-40ef-a98b-e38235c68d4d service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:54.507140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e746f85e-6c77-40ef-a98b-e38235c68d4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:54.508744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e746f85e-6c77-40ef-a98b-e38235c68d4d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:54.616052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746f85e-6c77-40ef-a98b-e38235c68d4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:54.617923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e746f85e-6c77-40ef-a98b-e38235c68d4d service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:54.637847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 674/1358] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:18:57.034331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c461a-0841-48a3-8e0b-1d26a3402bc4 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:57.034991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c461a-0841-48a3-8e0b-1d26a3402bc4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:57.034991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c461a-0841-48a3-8e0b-1d26a3402bc4 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:57.041630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd9af5-47a4-443d-818a-115cb20157b2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:57.041630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd9af5-47a4-443d-818a-115cb20157b2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:57.042435 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fd9af5-47a4-443d-818a-115cb20157b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:57.044687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 685/1359] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:18:57 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:18:57.111979 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-20fd9af5-47a4-443d-818a-115cb20157b2 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:18:57.113246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-20fd9af5-47a4-443d-818a-115cb20157b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:57.163239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:57.232753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 675/1360] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:18:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:18:57.524693 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c461a-0841-48a3-8e0b-1d26a3402bc4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:18:57.526235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d86c461a-0841-48a3-8e0b-1d26a3402bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:57.602642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:57.706699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c461a-0841-48a3-8e0b-1d26a3402bc4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:18:57.837792 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec6e9a9-1254-4993-a42d-4f2825efcb5a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:18:57.838396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6e9a9-1254-4993-a42d-4f2825efcb5a service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:18:57.838677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6e9a9-1254-4993-a42d-4f2825efcb5a service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:18:57.838952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec6e9a9-1254-4993-a42d-4f2825efcb5a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:18:57.840617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0ec6e9a9-1254-4993-a42d-4f2825efcb5a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:18:57.863353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:18:57.933406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6e9a9-1254-4993-a42d-4f2825efcb5a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:18:57.935566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ec6e9a9-1254-4993-a42d-4f2825efcb5a service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:18:57.953816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 686/1361] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:18:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:00.474137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd213df5-398b-43ea-ac19-82d99c8c5753 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:00.474627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd213df5-398b-43ea-ac19-82d99c8c5753 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:00.474627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd213df5-398b-43ea-ac19-82d99c8c5753 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:00.476215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 676/1362] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:00.484443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c3aa6-ed2d-430e-b4f7-e62978eeddee None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:00.484443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c3aa6-ed2d-430e-b4f7-e62978eeddee None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:00.484443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b86c3aa6-ed2d-430e-b4f7-e62978eeddee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:00.554258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b86c3aa6-ed2d-430e-b4f7-e62978eeddee None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:00.555774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b86c3aa6-ed2d-430e-b4f7-e62978eeddee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:00.658356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:00.665786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 687/1363] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:19:00.968776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5a5e-c895-4ad1-940c-c61242c1fd6d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:00.969055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5a5e-c895-4ad1-940c-c61242c1fd6d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:00.969333 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67e5a5e-c895-4ad1-940c-c61242c1fd6d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:00.970668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 677/1364] 10.222.0.16 () {54 vars in 961 bytes} [Sat Sep 24 14:19:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:00.976384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad03781-ebaf-4ce6-81a5-55720d3ff991 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:00.976734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad03781-ebaf-4ce6-81a5-55720d3ff991 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:00.977080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ad03781-ebaf-4ce6-81a5-55720d3ff991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:01.056101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8ad03781-ebaf-4ce6-81a5-55720d3ff991 None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:01.057326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8ad03781-ebaf-4ce6-81a5-55720d3ff991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:01.179953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 688/1365] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Sep 24 14:19:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:01.187500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e5a5e-c895-4ad1-940c-c61242c1fd6d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:01.189055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b67e5a5e-c895-4ad1-940c-c61242c1fd6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:01.342773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b67e5a5e-c895-4ad1-940c-c61242c1fd6d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:01.365757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:01.465327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd017d7-4069-44c0-a0bc-d9bf15771b3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:01.466127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd017d7-4069-44c0-a0bc-d9bf15771b3f service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:01.466403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd017d7-4069-44c0-a0bc-d9bf15771b3f service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:01.466671 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd017d7-4069-44c0-a0bc-d9bf15771b3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:01.468274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7dd017d7-4069-44c0-a0bc-d9bf15771b3f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:01.578202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd017d7-4069-44c0-a0bc-d9bf15771b3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:01.579910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd017d7-4069-44c0-a0bc-d9bf15771b3f service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:01.599206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 678/1366] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:01.639468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae5240-e86d-458c-bc93-b0277308239e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:01.639992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae5240-e86d-458c-bc93-b0277308239e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:01.640128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ae5240-e86d-458c-bc93-b0277308239e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:01.641564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 689/1367] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:01.646711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508b96-e7a3-46d9-a31a-de80feaad63f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:01.647000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508b96-e7a3-46d9-a31a-de80feaad63f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:01.647273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c508b96-e7a3-46d9-a31a-de80feaad63f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:01.681005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:01.725007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9c508b96-e7a3-46d9-a31a-de80feaad63f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:01.725007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9c508b96-e7a3-46d9-a31a-de80feaad63f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:01.844529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 679/1368] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:02.179136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d5ef3-2f00-44ef-a593-ea64388733ba None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:02.179136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d5ef3-2f00-44ef-a593-ea64388733ba None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:02.179383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52d5ef3-2f00-44ef-a593-ea64388733ba None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:02.180932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 690/1369] 10.222.0.16 () {54 vars in 963 bytes} [Sat Sep 24 14:19:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:02.185879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c675-4a9e-47d1-8deb-1bb0b1634977 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:02.186240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c675-4a9e-47d1-8deb-1bb0b1634977 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:02.186588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1c675-4a9e-47d1-8deb-1bb0b1634977 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:02.267099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-efa1c675-4a9e-47d1-8deb-1bb0b1634977 None None] MFA Rules not processed for user `c1152b27494941deae022b8a3eb48802`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:02.268464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-efa1c675-4a9e-47d1-8deb-1bb0b1634977 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:02.319563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:02.364314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 680/1370] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Sep 24 14:19:02 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:02.368343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d5ef3-2f00-44ef-a593-ea64388733ba None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:02.369985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d52d5ef3-2f00-44ef-a593-ea64388733ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:02.424190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:02.500948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52d5ef3-2f00-44ef-a593-ea64388733ba None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:02.587293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2526ec4-a6e5-44f6-89c6-fd77b1ddd010 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:02.588080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2526ec4-a6e5-44f6-89c6-fd77b1ddd010 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:02.588505 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2526ec4-a6e5-44f6-89c6-fd77b1ddd010 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:02.588858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2526ec4-a6e5-44f6-89c6-fd77b1ddd010 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:02.591083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b2526ec4-a6e5-44f6-89c6-fd77b1ddd010 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:02.859603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:02.874653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2526ec4-a6e5-44f6-89c6-fd77b1ddd010 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:02.875898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2526ec4-a6e5-44f6-89c6-fd77b1ddd010 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:02.896686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 691/1371] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:03.880667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd02d1f-577c-40a2-be7e-16856c913ca8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:03.881209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd02d1f-577c-40a2-be7e-16856c913ca8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:03.881209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd02d1f-577c-40a2-be7e-16856c913ca8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:03.882656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 681/1372] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:19:03.888664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7094c5-7b23-4790-96bf-4f9c76d47c5f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:03.889099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7094c5-7b23-4790-96bf-4f9c76d47c5f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:03.889204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7094c5-7b23-4790-96bf-4f9c76d47c5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:03.954934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-be7094c5-7b23-4790-96bf-4f9c76d47c5f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:03.956145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-be7094c5-7b23-4790-96bf-4f9c76d47c5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:04.050844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 692/1373] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:04.347073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd02d1f-577c-40a2-be7e-16856c913ca8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:04.348667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fcd02d1f-577c-40a2-be7e-16856c913ca8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:04.509374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd02d1f-577c-40a2-be7e-16856c913ca8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:04.562230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:04.625572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9885b9e8-8b4b-4d37-99b0-2037e99a10af service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:04.626203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885b9e8-8b4b-4d37-99b0-2037e99a10af service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:04.626474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885b9e8-8b4b-4d37-99b0-2037e99a10af service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:04.626740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9885b9e8-8b4b-4d37-99b0-2037e99a10af service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:04.628417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9885b9e8-8b4b-4d37-99b0-2037e99a10af service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:04.721532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885b9e8-8b4b-4d37-99b0-2037e99a10af service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:04.723135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9885b9e8-8b4b-4d37-99b0-2037e99a10af service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:04.741395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 682/1374] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 395 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:07.125310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be788-0f60-4b72-94e7-3dcaabd8dfcc None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:07.125847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be788-0f60-4b72-94e7-3dcaabd8dfcc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:07.125847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960be788-0f60-4b72-94e7-3dcaabd8dfcc None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:07.127265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 693/1375] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:07.132453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea56ee-ebbc-4f85-9985-3f931741311e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:07.132910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea56ee-ebbc-4f85-9985-3f931741311e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:07.133225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea56ee-ebbc-4f85-9985-3f931741311e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:07.213752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f2ea56ee-ebbc-4f85-9985-3f931741311e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:07.215606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f2ea56ee-ebbc-4f85-9985-3f931741311e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:07.223660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:07.328199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 683/1376] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:07.612363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960be788-0f60-4b72-94e7-3dcaabd8dfcc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:07.613975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-960be788-0f60-4b72-94e7-3dcaabd8dfcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:07.681109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:07.777117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960be788-0f60-4b72-94e7-3dcaabd8dfcc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:07.909582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9917ae-081c-47a3-8d7d-bfca379b3d5f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:07.910374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9917ae-081c-47a3-8d7d-bfca379b3d5f service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:07.910774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9917ae-081c-47a3-8d7d-bfca379b3d5f service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:07.911053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9917ae-081c-47a3-8d7d-bfca379b3d5f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:07.912656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1b9917ae-081c-47a3-8d7d-bfca379b3d5f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:07.933979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:08.019120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9917ae-081c-47a3-8d7d-bfca379b3d5f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:08.020880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9917ae-081c-47a3-8d7d-bfca379b3d5f service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:08.041444 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 694/1377] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:10.260720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e18a5-e7eb-4584-bff5-5e44dc96a3d6 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:10.261268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e18a5-e7eb-4584-bff5-5e44dc96a3d6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:10.261268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc8e18a5-e7eb-4584-bff5-5e44dc96a3d6 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:10.263774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 684/1378] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:10.268111 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae12d2-cd1e-45a4-915a-ac46907bd31b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:10.268827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae12d2-cd1e-45a4-915a-ac46907bd31b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:10.268827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ae12d2-cd1e-45a4-915a-ac46907bd31b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:10.372288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-36ae12d2-cd1e-45a4-915a-ac46907bd31b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:10.374149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-36ae12d2-cd1e-45a4-915a-ac46907bd31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:10.469002 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:10.476170 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 695/1379] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:10.770145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e18a5-e7eb-4584-bff5-5e44dc96a3d6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:10.771698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bc8e18a5-e7eb-4584-bff5-5e44dc96a3d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:10.916282 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:10.927698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc8e18a5-e7eb-4584-bff5-5e44dc96a3d6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:11.051830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674efa20-1aa1-4736-a3b7-62db02a43726 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:11.052390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674efa20-1aa1-4736-a3b7-62db02a43726 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:11.052674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674efa20-1aa1-4736-a3b7-62db02a43726 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:11.052947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674efa20-1aa1-4736-a3b7-62db02a43726 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:11.054572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-674efa20-1aa1-4736-a3b7-62db02a43726 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:11.161056 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674efa20-1aa1-4736-a3b7-62db02a43726 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:11.162701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674efa20-1aa1-4736-a3b7-62db02a43726 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:11.173106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:11.182648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 685/1380] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:13.392309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c33b3-0ab4-4ce9-bd8e-ee0387e99822 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:13.392852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c33b3-0ab4-4ce9-bd8e-ee0387e99822 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:13.393314 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-708c33b3-0ab4-4ce9-bd8e-ee0387e99822 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:13.395210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 696/1381] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:13.400729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1a5b1-baaa-49b0-b86d-af1ffc01faa8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:13.401168 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1a5b1-baaa-49b0-b86d-af1ffc01faa8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:13.401395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d1a5b1-baaa-49b0-b86d-af1ffc01faa8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:13.468392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-42d1a5b1-baaa-49b0-b86d-af1ffc01faa8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:13.469661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-42d1a5b1-baaa-49b0-b86d-af1ffc01faa8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:13.591023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 686/1382] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:19:13.879463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c33b3-0ab4-4ce9-bd8e-ee0387e99822 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:13.881501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-708c33b3-0ab4-4ce9-bd8e-ee0387e99822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:14.037952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-708c33b3-0ab4-4ce9-bd8e-ee0387e99822 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:14.107615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:14.154095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e6f2cf-247e-4a93-98e9-2284c6b00ade service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:14.154630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f2cf-247e-4a93-98e9-2284c6b00ade service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:14.154892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f2cf-247e-4a93-98e9-2284c6b00ade service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:14.155160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e6f2cf-247e-4a93-98e9-2284c6b00ade service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:14.156799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-89e6f2cf-247e-4a93-98e9-2284c6b00ade service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:14.267046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6f2cf-247e-4a93-98e9-2284c6b00ade service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:14.269116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e6f2cf-247e-4a93-98e9-2284c6b00ade service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:14.292307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 697/1383] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 413 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:16.907092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cdff8-ff56-4b46-8c4c-b386f6113ef2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:16.907610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cdff8-ff56-4b46-8c4c-b386f6113ef2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:16.907692 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2cdff8-ff56-4b46-8c4c-b386f6113ef2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:16.909016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 687/1384] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:16.914201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615d3d8-dd40-46d9-9d11-a06f4b2440b8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:16.914647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615d3d8-dd40-46d9-9d11-a06f4b2440b8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:16.914851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615d3d8-dd40-46d9-9d11-a06f4b2440b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:16.981696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4615d3d8-dd40-46d9-9d11-a06f4b2440b8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:16.982894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4615d3d8-dd40-46d9-9d11-a06f4b2440b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:17.016398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:17.080727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 698/1385] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:17.373586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cdff8-ff56-4b46-8c4c-b386f6113ef2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:17.375249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5b2cdff8-ff56-4b46-8c4c-b386f6113ef2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:17.457670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:17.532342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b2cdff8-ff56-4b46-8c4c-b386f6113ef2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:17.643940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04597f6f-f395-4bb8-807c-705af99d0f9d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:17.644486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04597f6f-f395-4bb8-807c-705af99d0f9d service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:17.644764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04597f6f-f395-4bb8-807c-705af99d0f9d service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:17.645032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04597f6f-f395-4bb8-807c-705af99d0f9d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:17.646623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-04597f6f-f395-4bb8-807c-705af99d0f9d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:17.685838 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:17.737132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04597f6f-f395-4bb8-807c-705af99d0f9d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:17.738749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04597f6f-f395-4bb8-807c-705af99d0f9d service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:17.756313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 688/1386] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:18.698728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6e100-26e3-40a0-822a-ffda89ebd0c8 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:18.699296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6e100-26e3-40a0-822a-ffda89ebd0c8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:18.699296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec6e100-26e3-40a0-822a-ffda89ebd0c8 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:18.700696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 699/1387] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:18.706115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28ec3-eaca-48d3-bca2-984c8929ad0f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:18.706581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28ec3-eaca-48d3-bca2-984c8929ad0f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:18.706725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff28ec3-eaca-48d3-bca2-984c8929ad0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:18.771280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cff28ec3-eaca-48d3-bca2-984c8929ad0f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:18.772525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cff28ec3-eaca-48d3-bca2-984c8929ad0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:18.871726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 689/1388] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:19.171530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d680e3-2ed8-4781-84eb-eda1c08a1968 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:19.171938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d680e3-2ed8-4781-84eb-eda1c08a1968 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:19.172321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d680e3-2ed8-4781-84eb-eda1c08a1968 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:19.173721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 700/1389] 10.222.0.16 () {54 vars in 962 bytes} [Sat Sep 24 14:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:19.179070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01f9c-c49f-4e81-9e77-040816906151 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:19.179424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01f9c-c49f-4e81-9e77-040816906151 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:19.179770 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab01f9c-c49f-4e81-9e77-040816906151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:19.195997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:19.269187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6ab01f9c-c49f-4e81-9e77-040816906151 None None] MFA Rules not processed for user `0ece8645e0954e1d81837cdcaa2ef1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:19.270398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6ab01f9c-c49f-4e81-9e77-040816906151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:19.354123 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 690/1390] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Sep 24 14:19:19 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:19:19.364201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d680e3-2ed8-4781-84eb-eda1c08a1968 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:19.365924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-53d680e3-2ed8-4781-84eb-eda1c08a1968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:19.524409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d680e3-2ed8-4781-84eb-eda1c08a1968 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:19.584929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:19.600629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1fecde-6cdc-4563-b591-a458f39938e4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ece8645e0954e1d81837cdcaa2ef1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:19.601231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fecde-6cdc-4563-b591-a458f39938e4 service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:19.601538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fecde-6cdc-4563-b591-a458f39938e4 service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:19.601813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1fecde-6cdc-4563-b591-a458f39938e4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:19.603398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-af1fecde-6cdc-4563-b591-a458f39938e4 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:19.712625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fecde-6cdc-4563-b591-a458f39938e4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:19.713996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1fecde-6cdc-4563-b591-a458f39938e4 service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:19.731888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 701/1391] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:19.936553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79381c-288f-4361-b93d-20b8429ff575 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:19.937120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79381c-288f-4361-b93d-20b8429ff575 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:19.937120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f79381c-288f-4361-b93d-20b8429ff575 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:19.938455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 691/1392] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:19.944408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fde9ea-0ab5-48b5-b434-becf64d85086 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:19.944839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fde9ea-0ab5-48b5-b434-becf64d85086 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:19.945211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fde9ea-0ab5-48b5-b434-becf64d85086 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:20.017303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-07fde9ea-0ab5-48b5-b434-becf64d85086 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:20.018511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-07fde9ea-0ab5-48b5-b434-becf64d85086 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:20.059644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:20.122319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 702/1393] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:20.410139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79381c-288f-4361-b93d-20b8429ff575 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:20.411648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6f79381c-288f-4361-b93d-20b8429ff575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:20.475670 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0727908-1918-48b1-9c5c-8ff2abce622d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:20.476313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0727908-1918-48b1-9c5c-8ff2abce622d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:20.476630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0727908-1918-48b1-9c5c-8ff2abce622d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:20.527751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:20.544764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e0727908-1918-48b1-9c5c-8ff2abce622d None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:20.546025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e0727908-1918-48b1-9c5c-8ff2abce622d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:20.574895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f79381c-288f-4361-b93d-20b8429ff575 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:20.635251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 703/1394] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:19:20 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:19:20.681919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b353f-3a5b-45ca-a1ed-f77e1e5faeab None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:20.682206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b353f-3a5b-45ca-a1ed-f77e1e5faeab None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:20.682564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20b353f-3a5b-45ca-a1ed-f77e1e5faeab None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:20.684477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 704/1395] 10.222.0.16 () {54 vars in 943 bytes} [Sat Sep 24 14:19:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:19:20.690767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4956c-90f6-4d69-a84b-ee815e2a81d9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:20.691052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4956c-90f6-4d69-a84b-ee815e2a81d9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:20.691336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e4956c-90f6-4d69-a84b-ee815e2a81d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:20.692165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571fa2e-2fdf-48f0-ac09-cc2a52339821 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:20.692798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571fa2e-2fdf-48f0-ac09-cc2a52339821 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:20.693075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571fa2e-2fdf-48f0-ac09-cc2a52339821 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:20.693348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3571fa2e-2fdf-48f0-ac09-cc2a52339821 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:20.694936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3571fa2e-2fdf-48f0-ac09-cc2a52339821 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:20.733501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:20.766796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:20.771941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-19e4956c-90f6-4d69-a84b-ee815e2a81d9 None None] MFA Rules not processed for user `100d19cd9f1742b7ae913376eb75bbd9`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:20.773195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-19e4956c-90f6-4d69-a84b-ee815e2a81d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:20.786803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571fa2e-2fdf-48f0-ac09-cc2a52339821 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:20.789103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3571fa2e-2fdf-48f0-ac09-cc2a52339821 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:20.807453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 692/1396] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:20.882745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 705/1397] 10.222.0.16 () {58 vars in 1040 bytes} [Sat Sep 24 14:19:20 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:19:20.893104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571fa2e-2fdf-48f0-ac09-cc2a52339821 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:20.894349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3571fa2e-2fdf-48f0-ac09-cc2a52339821 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:20.990552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3571fa2e-2fdf-48f0-ac09-cc2a52339821 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:21.097919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:21.099779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a3e9cc-5413-4ad3-a9f4-498855dd37e5 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:21.100524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3e9cc-5413-4ad3-a9f4-498855dd37e5 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:21.101050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3e9cc-5413-4ad3-a9f4-498855dd37e5 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:21.101373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a3e9cc-5413-4ad3-a9f4-498855dd37e5 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:21.103421 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a3a3e9cc-5413-4ad3-a9f4-498855dd37e5 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:21.185824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3e9cc-5413-4ad3-a9f4-498855dd37e5 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:21.187418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a3e9cc-5413-4ad3-a9f4-498855dd37e5 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:21.195481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 693/1398] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:19:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:19:23.018613 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec1b8-678d-499c-8c8d-4f30d88eb167 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:23.019211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec1b8-678d-499c-8c8d-4f30d88eb167 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:23.019211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bec1b8-678d-499c-8c8d-4f30d88eb167 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:23.020687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 706/1399] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:23.025988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc46fe-80b9-4fb9-adc0-9cb1852091e8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:23.026486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc46fe-80b9-4fb9-adc0-9cb1852091e8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:23.026651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2dc46fe-80b9-4fb9-adc0-9cb1852091e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:23.101703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a2dc46fe-80b9-4fb9-adc0-9cb1852091e8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:23.102848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a2dc46fe-80b9-4fb9-adc0-9cb1852091e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:23.208069 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:23.218300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 694/1400] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:23.508997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bec1b8-678d-499c-8c8d-4f30d88eb167 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:23.510576 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f8bec1b8-678d-499c-8c8d-4f30d88eb167 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:23.610751 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:23.673639 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bec1b8-678d-499c-8c8d-4f30d88eb167 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:23.813797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bbadb2-78fc-4584-880c-a98907d96626 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:23.814963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbadb2-78fc-4584-880c-a98907d96626 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:23.815249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbadb2-78fc-4584-880c-a98907d96626 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:23.815524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bbadb2-78fc-4584-880c-a98907d96626 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:23.817239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c6bbadb2-78fc-4584-880c-a98907d96626 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:23.880654 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:23.919209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbadb2-78fc-4584-880c-a98907d96626 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:23.920916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6bbadb2-78fc-4584-880c-a98907d96626 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:23.939740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 707/1401] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:26.193691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb42833-0608-4404-8456-d3d637300859 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:26.194229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb42833-0608-4404-8456-d3d637300859 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:26.194229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb42833-0608-4404-8456-d3d637300859 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:26.199544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 695/1402] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:26.201355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321b23-12d6-47ed-9b37-bc60903a63cb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:26.201791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321b23-12d6-47ed-9b37-bc60903a63cb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:26.201919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c321b23-12d6-47ed-9b37-bc60903a63cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:26.280536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7c321b23-12d6-47ed-9b37-bc60903a63cb None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:26.281774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7c321b23-12d6-47ed-9b37-bc60903a63cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:26.417477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 708/1403] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:26.713400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb42833-0608-4404-8456-d3d637300859 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:26.716206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-beb42833-0608-4404-8456-d3d637300859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:26.882668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb42833-0608-4404-8456-d3d637300859 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:26.954663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:27.006615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56dcdc86-7b61-4895-8c03-abe69ce33530 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:27.007439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcdc86-7b61-4895-8c03-abe69ce33530 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:27.007735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcdc86-7b61-4895-8c03-abe69ce33530 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:27.007998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56dcdc86-7b61-4895-8c03-abe69ce33530 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:27.009646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-56dcdc86-7b61-4895-8c03-abe69ce33530 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:27.114146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcdc86-7b61-4895-8c03-abe69ce33530 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:27.115755 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56dcdc86-7b61-4895-8c03-abe69ce33530 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:27.138507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 696/1404] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:29.349909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98440a3e-3729-41de-a48d-5b75d1bb48a0 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:29.350503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98440a3e-3729-41de-a48d-5b75d1bb48a0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:29.350841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98440a3e-3729-41de-a48d-5b75d1bb48a0 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:29.352378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 709/1405] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:19:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:29.357902 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b419-188d-4264-b0cb-16a282550e4c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:29.358324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b419-188d-4264-b0cb-16a282550e4c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:29.358484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d3b419-188d-4264-b0cb-16a282550e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:29.429284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-32d3b419-188d-4264-b0cb-16a282550e4c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:29.430793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-32d3b419-188d-4264-b0cb-16a282550e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:29.467251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:29.553422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 697/1406] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:19:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:29.853131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98440a3e-3729-41de-a48d-5b75d1bb48a0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:29.854716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-98440a3e-3729-41de-a48d-5b75d1bb48a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:29.892964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:30.016475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98440a3e-3729-41de-a48d-5b75d1bb48a0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:30.148722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:30.156291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996faa4c-50c0-4859-b5ed-71b0fdab3547 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:30.156898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996faa4c-50c0-4859-b5ed-71b0fdab3547 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:30.157177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996faa4c-50c0-4859-b5ed-71b0fdab3547 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:30.157449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996faa4c-50c0-4859-b5ed-71b0fdab3547 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:30.159046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-996faa4c-50c0-4859-b5ed-71b0fdab3547 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:30.261947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996faa4c-50c0-4859-b5ed-71b0fdab3547 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:30.263082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996faa4c-50c0-4859-b5ed-71b0fdab3547 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:30.284200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 710/1407] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:39.550970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=30 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:40.280854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=48 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:43.732317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b69d4-98ad-4ff9-9024-4ce5fed382bc None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:43.732888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b69d4-98ad-4ff9-9024-4ce5fed382bc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:43.732888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663b69d4-98ad-4ff9-9024-4ce5fed382bc None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:43.734209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 698/1408] 10.222.0.16 () {54 vars in 918 bytes} [Sat Sep 24 14:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:43.739364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a8359-565b-4bd4-9718-a7120457a6f7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:43.739752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a8359-565b-4bd4-9718-a7120457a6f7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:43.739927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6a8359-565b-4bd4-9718-a7120457a6f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:43.816851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8f6a8359-565b-4bd4-9718-a7120457a6f7 None None] MFA Rules not processed for user `2bc00e6583d7424cbdc13732a962fc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:43.818053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8f6a8359-565b-4bd4-9718-a7120457a6f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:43.922192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 711/1409] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Sep 24 14:19:43 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:19:43.936794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c87cc5-9d7f-4238-bee6-5911f81d5f26 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:43.937081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c87cc5-9d7f-4238-bee6-5911f81d5f26 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:43.937389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c87cc5-9d7f-4238-bee6-5911f81d5f26 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:43.938761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 699/1410] 10.222.0.16 () {54 vars in 918 bytes} [Sat Sep 24 14:19:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:43.943346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ddbe-fbec-4ea9-bb0b-b0db1162a0db None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:43.943636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ddbe-fbec-4ea9-bb0b-b0db1162a0db None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:43.943912 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2ddbe-fbec-4ea9-bb0b-b0db1162a0db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:44.015914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:44.018385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d9e2ddbe-fbec-4ea9-bb0b-b0db1162a0db None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:44.020122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d9e2ddbe-fbec-4ea9-bb0b-b0db1162a0db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:44.133866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 712/1411] 10.222.0.16 () {58 vars in 1015 bytes} [Sat Sep 24 14:19:43 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:46.667243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476e75-607f-427c-8137-9aa91dc2de2f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:46.667828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476e75-607f-427c-8137-9aa91dc2de2f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:46.667828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d476e75-607f-427c-8137-9aa91dc2de2f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:46.669182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 700/1412] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:19:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:46.674340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12439fe0-1ade-4d77-94eb-eb2f30d631b1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:46.674799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12439fe0-1ade-4d77-94eb-eb2f30d631b1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:46.674918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12439fe0-1ade-4d77-94eb-eb2f30d631b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:46.740917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-12439fe0-1ade-4d77-94eb-eb2f30d631b1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:46.742042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-12439fe0-1ade-4d77-94eb-eb2f30d631b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:46.797429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:46.838124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 713/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:19:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:47.124995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d476e75-607f-427c-8137-9aa91dc2de2f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:47.126822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0d476e75-607f-427c-8137-9aa91dc2de2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:47.270725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d476e75-607f-427c-8137-9aa91dc2de2f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:47.343684 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:47.384104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b80c5b6-63ec-4c02-95c2-40686c33fae5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:47.384667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c5b6-63ec-4c02-95c2-40686c33fae5 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:47.384940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c5b6-63ec-4c02-95c2-40686c33fae5 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:47.385206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b80c5b6-63ec-4c02-95c2-40686c33fae5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:47.386848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3b80c5b6-63ec-4c02-95c2-40686c33fae5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:47.474480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c5b6-63ec-4c02-95c2-40686c33fae5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:47.476133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b80c5b6-63ec-4c02-95c2-40686c33fae5 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:47.496087 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 701/1414] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:48.632344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2f43-eb1e-4ac2-90cc-aaedbe63dee9 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:48.632902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2f43-eb1e-4ac2-90cc-aaedbe63dee9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:48.632902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0c2f43-eb1e-4ac2-90cc-aaedbe63dee9 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:48.634234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 714/1415] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:19:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:48.641121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f1d3f-604f-4288-91a5-a836fa7c00c0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:48.641585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f1d3f-604f-4288-91a5-a836fa7c00c0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:48.641684 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796f1d3f-604f-4288-91a5-a836fa7c00c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:48.715315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-796f1d3f-604f-4288-91a5-a836fa7c00c0 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:48.716806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-796f1d3f-604f-4288-91a5-a836fa7c00c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:48.742788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:48.812670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 702/1416] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:19:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:48.967162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c2f43-eb1e-4ac2-90cc-aaedbe63dee9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:48.968709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a0c2f43-eb1e-4ac2-90cc-aaedbe63dee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:49.113167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0c2f43-eb1e-4ac2-90cc-aaedbe63dee9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:49.152904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:49.227664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5defa19b-2248-43ac-ba33-a97b1296ec84 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:49.228293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defa19b-2248-43ac-ba33-a97b1296ec84 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:49.228575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defa19b-2248-43ac-ba33-a97b1296ec84 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:49.228851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5defa19b-2248-43ac-ba33-a97b1296ec84 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:49.230463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5defa19b-2248-43ac-ba33-a97b1296ec84 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:49.319514 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defa19b-2248-43ac-ba33-a97b1296ec84 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:49.321120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5defa19b-2248-43ac-ba33-a97b1296ec84 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:49.339744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 715/1417] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:50.466983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4291232-ba93-4226-bd34-2517c019429c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:50.467556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4291232-ba93-4226-bd34-2517c019429c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:50.467556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4291232-ba93-4226-bd34-2517c019429c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:50.468903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 703/1418] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:19:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:50.475179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be900e-5109-41ca-8097-bf8a5da8db26 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:50.475616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be900e-5109-41ca-8097-bf8a5da8db26 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:50.475734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37be900e-5109-41ca-8097-bf8a5da8db26 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:50.529912 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:50.551517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-37be900e-5109-41ca-8097-bf8a5da8db26 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:50.552738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-37be900e-5109-41ca-8097-bf8a5da8db26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:50.646757 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 716/1419] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:19:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:50.797492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4291232-ba93-4226-bd34-2517c019429c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:50.799016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f4291232-ba93-4226-bd34-2517c019429c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:50.944990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4291232-ba93-4226-bd34-2517c019429c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:50.957316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:51.056517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89449538-0f88-44fc-bc5e-a6f33cf0dd8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:51.057038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89449538-0f88-44fc-bc5e-a6f33cf0dd8c service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:51.057822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89449538-0f88-44fc-bc5e-a6f33cf0dd8c service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:51.058089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89449538-0f88-44fc-bc5e-a6f33cf0dd8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:51.059673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-89449538-0f88-44fc-bc5e-a6f33cf0dd8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:51.146980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89449538-0f88-44fc-bc5e-a6f33cf0dd8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:51.148596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89449538-0f88-44fc-bc5e-a6f33cf0dd8c service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:51.165983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 704/1420] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:52.272365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117939-dd00-4964-b8cd-fd66a81a99a3 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:52.272947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117939-dd00-4964-b8cd-fd66a81a99a3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:52.272947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3117939-dd00-4964-b8cd-fd66a81a99a3 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:52.276317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 717/1421] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:19:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:52.282734 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44823e-286e-4518-95c5-4d440c0fd9bc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:52.283172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44823e-286e-4518-95c5-4d440c0fd9bc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:52.283307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e44823e-286e-4518-95c5-4d440c0fd9bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:52.303466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:52.360059 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9e44823e-286e-4518-95c5-4d440c0fd9bc None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:52.361300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9e44823e-286e-4518-95c5-4d440c0fd9bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:52.456267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 705/1422] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:19:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:52.614098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117939-dd00-4964-b8cd-fd66a81a99a3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:52.615603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e3117939-dd00-4964-b8cd-fd66a81a99a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:52.723125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:52.759194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3117939-dd00-4964-b8cd-fd66a81a99a3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:52.874529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42246bd2-7b51-455b-988e-c9cd023dce5c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:52.875122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42246bd2-7b51-455b-988e-c9cd023dce5c service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:52.875398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42246bd2-7b51-455b-988e-c9cd023dce5c service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:52.875669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42246bd2-7b51-455b-988e-c9cd023dce5c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:52.877282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-42246bd2-7b51-455b-988e-c9cd023dce5c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:52.952380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:52.967159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42246bd2-7b51-455b-988e-c9cd023dce5c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:52.968789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42246bd2-7b51-455b-988e-c9cd023dce5c service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:52.987168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 718/1423] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:54.101805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe1993-6aea-4c70-b891-717079ceb40d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:54.102339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe1993-6aea-4c70-b891-717079ceb40d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:54.102339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2fe1993-6aea-4c70-b891-717079ceb40d None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:54.103613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 706/1424] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:54.110519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321bcc7-364c-4fba-8cc1-acdaf8d1a04e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:54.110948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321bcc7-364c-4fba-8cc1-acdaf8d1a04e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:54.111059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1321bcc7-364c-4fba-8cc1-acdaf8d1a04e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:54.185647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1321bcc7-364c-4fba-8cc1-acdaf8d1a04e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:54.186844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1321bcc7-364c-4fba-8cc1-acdaf8d1a04e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:54.283490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 719/1425] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:19:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:19:54.432147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe1993-6aea-4c70-b891-717079ceb40d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:54.433624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c2fe1993-6aea-4c70-b891-717079ceb40d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:54.519291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:54.580909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2fe1993-6aea-4c70-b891-717079ceb40d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:54.693042 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1a60975-ff4a-4d69-a6f8-63d09c42408b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:54.693574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a60975-ff4a-4d69-a6f8-63d09c42408b service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:54.693855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a60975-ff4a-4d69-a6f8-63d09c42408b service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:54.694127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1a60975-ff4a-4d69-a6f8-63d09c42408b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:54.695726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d1a60975-ff4a-4d69-a6f8-63d09c42408b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:54.744144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:54.785105 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a60975-ff4a-4d69-a6f8-63d09c42408b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:54.786725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1a60975-ff4a-4d69-a6f8-63d09c42408b service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:54.804363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 707/1426] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:55.870613 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd5f77-3896-47b4-9b58-d076ce556b3e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:55.871294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd5f77-3896-47b4-9b58-d076ce556b3e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:55.871294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bd5f77-3896-47b4-9b58-d076ce556b3e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:55.872510 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 720/1427] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:19:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:55.879000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861caf7-d543-442d-adbf-3f7df93092e9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:55.879478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861caf7-d543-442d-adbf-3f7df93092e9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:55.879586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4861caf7-d543-442d-adbf-3f7df93092e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:55.954415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4861caf7-d543-442d-adbf-3f7df93092e9 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:55.955550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4861caf7-d543-442d-adbf-3f7df93092e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:56.050746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 708/1428] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:19:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:56.203621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd5f77-3896-47b4-9b58-d076ce556b3e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:56.205219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-42bd5f77-3896-47b4-9b58-d076ce556b3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:56.255453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:56.350699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bd5f77-3896-47b4-9b58-d076ce556b3e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:56.460804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf42d03b-d1df-4db4-b663-c845ebd7dfd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:56.461331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d03b-d1df-4db4-b663-c845ebd7dfd9 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:56.461606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d03b-d1df-4db4-b663-c845ebd7dfd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:56.461877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf42d03b-d1df-4db4-b663-c845ebd7dfd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:56.463951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bf42d03b-d1df-4db4-b663-c845ebd7dfd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:56.471257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:56.554949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42d03b-d1df-4db4-b663-c845ebd7dfd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:56.556561 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf42d03b-d1df-4db4-b663-c845ebd7dfd9 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:56.574530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 721/1429] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:57.636485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac083c7-a243-453f-abef-1a64f0db6544 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:57.637020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac083c7-a243-453f-abef-1a64f0db6544 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:57.637020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac083c7-a243-453f-abef-1a64f0db6544 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:57.638378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 709/1430] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:19:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:57.644742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9205f-37f7-46c1-8968-df95375ecc7f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:57.645186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9205f-37f7-46c1-8968-df95375ecc7f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:57.645293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd9205f-37f7-46c1-8968-df95375ecc7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:57.719951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1bd9205f-37f7-46c1-8968-df95375ecc7f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:57.721178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1bd9205f-37f7-46c1-8968-df95375ecc7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:57.787794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:57.816830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 722/1431] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:19:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:57.971999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac083c7-a243-453f-abef-1a64f0db6544 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:57.973537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0ac083c7-a243-453f-abef-1a64f0db6544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:57.991201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:58.117047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac083c7-a243-453f-abef-1a64f0db6544 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:58.202395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:58.234028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef40df9-b942-4497-9054-4a6a11720844 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:58.234656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40df9-b942-4497-9054-4a6a11720844 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:58.234933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40df9-b942-4497-9054-4a6a11720844 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:58.235206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef40df9-b942-4497-9054-4a6a11720844 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:58.236839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8ef40df9-b942-4497-9054-4a6a11720844 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:58.324510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef40df9-b942-4497-9054-4a6a11720844 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:19:58.326109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ef40df9-b942-4497-9054-4a6a11720844 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:19:58.344481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 710/1432] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:19:59.391190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae42d3-dfac-4d46-a295-f2054cf9fcfd None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:59.391737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae42d3-dfac-4d46-a295-f2054cf9fcfd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:59.391737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caae42d3-dfac-4d46-a295-f2054cf9fcfd None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:59.393117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 723/1433] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:19:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:19:59.399084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdc126-ffae-4c01-a789-b09db3898e7a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:59.399532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdc126-ffae-4c01-a789-b09db3898e7a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:59.399630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fdc126-ffae-4c01-a789-b09db3898e7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:59.476324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f0fdc126-ffae-4c01-a789-b09db3898e7a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:19:59.477556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f0fdc126-ffae-4c01-a789-b09db3898e7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:59.520360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:59.576064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 711/1434] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:19:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:19:59.724922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae42d3-dfac-4d46-a295-f2054cf9fcfd None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:19:59.726395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-caae42d3-dfac-4d46-a295-f2054cf9fcfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:19:59.873503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caae42d3-dfac-4d46-a295-f2054cf9fcfd None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:19:59.926304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:19:59.984385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09e76cf-0268-4c57-8243-1eeb8e21cc09 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:19:59.985037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e76cf-0268-4c57-8243-1eeb8e21cc09 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:19:59.985317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e76cf-0268-4c57-8243-1eeb8e21cc09 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:19:59.985590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09e76cf-0268-4c57-8243-1eeb8e21cc09 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:19:59.987608 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e09e76cf-0268-4c57-8243-1eeb8e21cc09 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:00.077390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e76cf-0268-4c57-8243-1eeb8e21cc09 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:00.078974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09e76cf-0268-4c57-8243-1eeb8e21cc09 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:00.096999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 724/1435] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:19:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:01.135844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588cd01-5c41-4ae6-a877-eaf81a39cffa None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:01.136386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588cd01-5c41-4ae6-a877-eaf81a39cffa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:01.136386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f588cd01-5c41-4ae6-a877-eaf81a39cffa None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:01.137685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 712/1436] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:20:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:01.144113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaa2e0-ec94-40bc-9356-d04bb387f7e1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:01.144548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaa2e0-ec94-40bc-9356-d04bb387f7e1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:01.144729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfaa2e0-ec94-40bc-9356-d04bb387f7e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:01.225472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5cfaa2e0-ec94-40bc-9356-d04bb387f7e1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:01.226675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5cfaa2e0-ec94-40bc-9356-d04bb387f7e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:01.228708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:01.323854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 725/1437] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:20:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:01.471785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588cd01-5c41-4ae6-a877-eaf81a39cffa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:01.473399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f588cd01-5c41-4ae6-a877-eaf81a39cffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:01.617069 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f588cd01-5c41-4ae6-a877-eaf81a39cffa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:01.645331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:01.730943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abda4d11-92fe-41cc-afa3-e23dc505584e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:01.731474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda4d11-92fe-41cc-afa3-e23dc505584e service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:01.731759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda4d11-92fe-41cc-afa3-e23dc505584e service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:01.732020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abda4d11-92fe-41cc-afa3-e23dc505584e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:01.733641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-abda4d11-92fe-41cc-afa3-e23dc505584e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:01.820843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda4d11-92fe-41cc-afa3-e23dc505584e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:01.822438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abda4d11-92fe-41cc-afa3-e23dc505584e service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:01.839786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 713/1438] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:03.893017 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0af5a-a431-484d-b1ca-6d92455748b9 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:03.893606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0af5a-a431-484d-b1ca-6d92455748b9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:03.893606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a0af5a-a431-484d-b1ca-6d92455748b9 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:03.894957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 726/1439] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:20:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:03.900366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42a0f3-f039-4afa-8313-e3590fc8bcd7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:03.901291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42a0f3-f039-4afa-8313-e3590fc8bcd7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:03.901434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de42a0f3-f039-4afa-8313-e3590fc8bcd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:03.941876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:03.967220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-de42a0f3-f039-4afa-8313-e3590fc8bcd7 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:03.968458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-de42a0f3-f039-4afa-8313-e3590fc8bcd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:04.063041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 714/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:20:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:04.362823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0af5a-a431-484d-b1ca-6d92455748b9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:04.364422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f0a0af5a-a431-484d-b1ca-6d92455748b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:04.467471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a0af5a-a431-484d-b1ca-6d92455748b9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:04.500814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:04.542407 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a038d7c-8c4b-4f4d-a945-7e3b5729c49a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:04.543012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038d7c-8c4b-4f4d-a945-7e3b5729c49a service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:04.543294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038d7c-8c4b-4f4d-a945-7e3b5729c49a service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:04.543570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a038d7c-8c4b-4f4d-a945-7e3b5729c49a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:04.545201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7a038d7c-8c4b-4f4d-a945-7e3b5729c49a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:04.653214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a038d7c-8c4b-4f4d-a945-7e3b5729c49a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:04.654571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a038d7c-8c4b-4f4d-a945-7e3b5729c49a service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:04.672267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 727/1441] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:06.969091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcd850-b892-49e6-8ae4-abc663b18cf5 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:06.969685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcd850-b892-49e6-8ae4-abc663b18cf5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:06.969685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bcd850-b892-49e6-8ae4-abc663b18cf5 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:06.970962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 715/1442] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:20:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:06.976255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74106c54-acf3-429c-a30e-21256cdcd9c4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:06.976657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74106c54-acf3-429c-a30e-21256cdcd9c4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:06.976808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74106c54-acf3-429c-a30e-21256cdcd9c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:07.042467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-74106c54-acf3-429c-a30e-21256cdcd9c4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:07.043675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-74106c54-acf3-429c-a30e-21256cdcd9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:07.056248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:07.148912 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 728/1443] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:20:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:07.442960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcd850-b892-49e6-8ae4-abc663b18cf5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:07.444534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-39bcd850-b892-49e6-8ae4-abc663b18cf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:07.562139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39bcd850-b892-49e6-8ae4-abc663b18cf5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:07.575853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:07.642199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042230a3-d70d-42ff-871d-344ff006bba2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:07.642798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042230a3-d70d-42ff-871d-344ff006bba2 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:07.643074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042230a3-d70d-42ff-871d-344ff006bba2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:07.643342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042230a3-d70d-42ff-871d-344ff006bba2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:07.644975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-042230a3-d70d-42ff-871d-344ff006bba2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:07.758393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042230a3-d70d-42ff-871d-344ff006bba2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:07.759843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-042230a3-d70d-42ff-871d-344ff006bba2 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:07.778180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 716/1444] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:10.240268 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f76687-4942-4029-98d0-cdaf0fddbd9f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:10.240886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f76687-4942-4029-98d0-cdaf0fddbd9f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:10.240886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f76687-4942-4029-98d0-cdaf0fddbd9f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:10.242182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 729/1445] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:20:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:10.247614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb43be-21ed-4e1e-99d9-b1bff8564711 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:10.248036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb43be-21ed-4e1e-99d9-b1bff8564711 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:10.248186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffb43be-21ed-4e1e-99d9-b1bff8564711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:10.296101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:10.313626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dffb43be-21ed-4e1e-99d9-b1bff8564711 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:10.314835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dffb43be-21ed-4e1e-99d9-b1bff8564711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:10.421862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 717/1446] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:10.709051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f76687-4942-4029-98d0-cdaf0fddbd9f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:10.710601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-61f76687-4942-4029-98d0-cdaf0fddbd9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:10.818869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f76687-4942-4029-98d0-cdaf0fddbd9f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:10.859666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:10.893818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f03da9-0f87-46e9-9f38-7dc78734ea1e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:10.894414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03da9-0f87-46e9-9f38-7dc78734ea1e service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:10.894690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03da9-0f87-46e9-9f38-7dc78734ea1e service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:10.894961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f03da9-0f87-46e9-9f38-7dc78734ea1e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:10.896558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-10f03da9-0f87-46e9-9f38-7dc78734ea1e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:11.003283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f03da9-0f87-46e9-9f38-7dc78734ea1e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:11.004738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f03da9-0f87-46e9-9f38-7dc78734ea1e service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:11.024611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 730/1447] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:13.287481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0a08e-16c4-47cc-8668-357872ef78bc None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:13.288052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0a08e-16c4-47cc-8668-357872ef78bc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:13.288052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff0a08e-16c4-47cc-8668-357872ef78bc None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:13.289386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 718/1448] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:20:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:13.295141 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb39dff-6518-4aa0-936e-8cc695364b2b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:13.295553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb39dff-6518-4aa0-936e-8cc695364b2b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:13.295689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb39dff-6518-4aa0-936e-8cc695364b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:13.360722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5bb39dff-6518-4aa0-936e-8cc695364b2b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:13.361904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5bb39dff-6518-4aa0-936e-8cc695364b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:13.383156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:13.458758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 731/1449] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:20:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:13.745507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0a08e-16c4-47cc-8668-357872ef78bc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:13.747041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3ff0a08e-16c4-47cc-8668-357872ef78bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:13.850433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff0a08e-16c4-47cc-8668-357872ef78bc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:13.870636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:13.923094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-152257c0-738c-420e-9082-2694f45f4ce2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:13.923696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152257c0-738c-420e-9082-2694f45f4ce2 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:13.923974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152257c0-738c-420e-9082-2694f45f4ce2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:13.924285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-152257c0-738c-420e-9082-2694f45f4ce2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:13.925879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-152257c0-738c-420e-9082-2694f45f4ce2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:14.036281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152257c0-738c-420e-9082-2694f45f4ce2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:14.037726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-152257c0-738c-420e-9082-2694f45f4ce2 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:14.055311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 719/1450] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:16.347623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de900b-1b83-4e4c-8cf7-83f2cbdd058e None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:16.348211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de900b-1b83-4e4c-8cf7-83f2cbdd058e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:16.348211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4de900b-1b83-4e4c-8cf7-83f2cbdd058e None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:16.349548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 732/1451] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:20:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:16.355566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71167-0631-4595-a386-99018bfcdfc1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:16.356006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71167-0631-4595-a386-99018bfcdfc1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:16.356111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a71167-0631-4595-a386-99018bfcdfc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:16.418872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:16.421610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-90a71167-0631-4595-a386-99018bfcdfc1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:16.423425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-90a71167-0631-4595-a386-99018bfcdfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:16.522362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 720/1452] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:20:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:16.808712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de900b-1b83-4e4c-8cf7-83f2cbdd058e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:16.810288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c4de900b-1b83-4e4c-8cf7-83f2cbdd058e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:16.913275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4de900b-1b83-4e4c-8cf7-83f2cbdd058e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:16.962476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:16.987408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb2b3c3-f83e-4a66-9ce2-3c3c5318e7fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:16.988000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2b3c3-f83e-4a66-9ce2-3c3c5318e7fa service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:16.988313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2b3c3-f83e-4a66-9ce2-3c3c5318e7fa service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:16.988582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb2b3c3-f83e-4a66-9ce2-3c3c5318e7fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:16.990149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6fb2b3c3-f83e-4a66-9ce2-3c3c5318e7fa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:17.096019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2b3c3-f83e-4a66-9ce2-3c3c5318e7fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:17.097416 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb2b3c3-f83e-4a66-9ce2-3c3c5318e7fa service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:17.115460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 733/1453] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:19.288128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83c0d3-95f3-4b6d-ac2c-44cee69441bd None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:19.288678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83c0d3-95f3-4b6d-ac2c-44cee69441bd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:19.288778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b83c0d3-95f3-4b6d-ac2c-44cee69441bd None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:19.290058 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 721/1454] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:20:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:19.295778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aafc3-57d6-4503-b89d-593825937265 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:19.296275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aafc3-57d6-4503-b89d-593825937265 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:19.296393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d53aafc3-57d6-4503-b89d-593825937265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:19.361622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d53aafc3-57d6-4503-b89d-593825937265 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:19.362830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d53aafc3-57d6-4503-b89d-593825937265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:19.391992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:19.458486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 734/1455] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:19.746708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83c0d3-95f3-4b6d-ac2c-44cee69441bd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:19.748274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6b83c0d3-95f3-4b6d-ac2c-44cee69441bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:19.868882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b83c0d3-95f3-4b6d-ac2c-44cee69441bd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:19.897441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:19.941911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702dfe90-1424-4c64-b13b-ac417538a617 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:19.942511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dfe90-1424-4c64-b13b-ac417538a617 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:19.942790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dfe90-1424-4c64-b13b-ac417538a617 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:19.943067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702dfe90-1424-4c64-b13b-ac417538a617 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:19.944682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-702dfe90-1424-4c64-b13b-ac417538a617 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:20.051837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dfe90-1424-4c64-b13b-ac417538a617 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:20.053327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702dfe90-1424-4c64-b13b-ac417538a617 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:20.071067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 722/1456] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:22.255427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e96d07-5c01-4f5b-b16a-642bda7842bb None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:22.255976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e96d07-5c01-4f5b-b16a-642bda7842bb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:22.255976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e96d07-5c01-4f5b-b16a-642bda7842bb None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:22.257327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 735/1457] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:20:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:22.263320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51912082-ae02-41a1-9bec-c242dccb76fb None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:22.263770 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51912082-ae02-41a1-9bec-c242dccb76fb None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:22.263877 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51912082-ae02-41a1-9bec-c242dccb76fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:22.329182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-51912082-ae02-41a1-9bec-c242dccb76fb None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:22.330416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-51912082-ae02-41a1-9bec-c242dccb76fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:22.339278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:22.426406 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 723/1458] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:22.708581 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e96d07-5c01-4f5b-b16a-642bda7842bb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:22.710176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-84e96d07-5c01-4f5b-b16a-642bda7842bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:22.814269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e96d07-5c01-4f5b-b16a-642bda7842bb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:22.869686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:22.888087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15a766ca-3be6-49fb-939f-f144240023bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:22.888721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a766ca-3be6-49fb-939f-f144240023bb service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:22.889009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a766ca-3be6-49fb-939f-f144240023bb service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:22.889281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15a766ca-3be6-49fb-939f-f144240023bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:22.890868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-15a766ca-3be6-49fb-939f-f144240023bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:22.999292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a766ca-3be6-49fb-939f-f144240023bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:23.000755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15a766ca-3be6-49fb-939f-f144240023bb service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:23.018728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 736/1459] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:25.203977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efff9a-954b-4250-9520-664aa847c22c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:25.204539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efff9a-954b-4250-9520-664aa847c22c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:25.204539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58efff9a-954b-4250-9520-664aa847c22c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:25.205811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 724/1460] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:20:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:25.211875 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3be3-cf13-4417-9f6b-0608c8024bc7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:25.212508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3be3-cf13-4417-9f6b-0608c8024bc7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:25.212856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4e3be3-cf13-4417-9f6b-0608c8024bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:25.278088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5e4e3be3-cf13-4417-9f6b-0608c8024bc7 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:25.279278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5e4e3be3-cf13-4417-9f6b-0608c8024bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:25.317443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:25.376736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 737/1461] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:20:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:25.659636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efff9a-954b-4250-9520-664aa847c22c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:25.661210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-58efff9a-954b-4250-9520-664aa847c22c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:25.766991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58efff9a-954b-4250-9520-664aa847c22c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:25.810003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:25.850872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc1064cf-d58e-42b7-bdef-5829a4b5530a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:25.851474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1064cf-d58e-42b7-bdef-5829a4b5530a service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:25.851752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1064cf-d58e-42b7-bdef-5829a4b5530a service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:25.852025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1064cf-d58e-42b7-bdef-5829a4b5530a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:25.853670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fc1064cf-d58e-42b7-bdef-5829a4b5530a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:25.961213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1064cf-d58e-42b7-bdef-5829a4b5530a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:25.962649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc1064cf-d58e-42b7-bdef-5829a4b5530a service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:25.981655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 725/1462] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 323 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:28.149233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8034a9-46fd-44c7-8140-56b0c3b96f44 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:28.149805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8034a9-46fd-44c7-8140-56b0c3b96f44 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:28.149805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8034a9-46fd-44c7-8140-56b0c3b96f44 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:28.151767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 738/1463] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:20:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:28.156997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcc9ca-5cea-4178-bd85-519f688755a1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:28.157423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcc9ca-5cea-4178-bd85-519f688755a1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:28.157526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7bcc9ca-5cea-4178-bd85-519f688755a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:28.223395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e7bcc9ca-5cea-4178-bd85-519f688755a1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:28.224747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e7bcc9ca-5cea-4178-bd85-519f688755a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:28.242583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:28.320122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 726/1464] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:28.616990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bdde2-4de9-439b-ac36-d0317929ad6a None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:28.617271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bdde2-4de9-439b-ac36-d0317929ad6a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:28.617545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551bdde2-4de9-439b-ac36-d0317929ad6a None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:28.619428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 739/1465] 10.222.0.16 () {54 vars in 964 bytes} [Sat Sep 24 14:20:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:28.625352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799876-5630-4c89-a114-f5a2d667f5f8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:28.625660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799876-5630-4c89-a114-f5a2d667f5f8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:28.626024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83799876-5630-4c89-a114-f5a2d667f5f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:28.700516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-83799876-5630-4c89-a114-f5a2d667f5f8 None None] MFA Rules not processed for user `7014b2868d4b4acea242d068f247c21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:28.701730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-83799876-5630-4c89-a114-f5a2d667f5f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:28.779421 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 727/1466] 10.222.0.16 () {58 vars in 1061 bytes} [Sat Sep 24 14:20:28 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:28.788591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bdde2-4de9-439b-ac36-d0317929ad6a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:28.790131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-551bdde2-4de9-439b-ac36-d0317929ad6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:28.891448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551bdde2-4de9-439b-ac36-d0317929ad6a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:28.957387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:28.964442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb589cea-2158-4c70-b23c-a49f3cc06ff1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:28.965034 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb589cea-2158-4c70-b23c-a49f3cc06ff1 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:28.965332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb589cea-2158-4c70-b23c-a49f3cc06ff1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:28.965578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb589cea-2158-4c70-b23c-a49f3cc06ff1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:28.967409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fb589cea-2158-4c70-b23c-a49f3cc06ff1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:29.074910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb589cea-2158-4c70-b23c-a49f3cc06ff1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:29.076277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb589cea-2158-4c70-b23c-a49f3cc06ff1 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:29.094047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 740/1467] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:31.628429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1c48-e4f0-4f9d-b7dc-6972829dfc77 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:31.628960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1c48-e4f0-4f9d-b7dc-6972829dfc77 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:31.628960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82a1c48-e4f0-4f9d-b7dc-6972829dfc77 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:31.630298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 728/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:20:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:31.635743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8709ce-6d00-4a13-a22b-67516ed2ffcc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:31.636201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8709ce-6d00-4a13-a22b-67516ed2ffcc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:31.636318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8709ce-6d00-4a13-a22b-67516ed2ffcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:31.701245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9c8709ce-6d00-4a13-a22b-67516ed2ffcc None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:31.702439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9c8709ce-6d00-4a13-a22b-67516ed2ffcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:31.750360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:31.800110 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 741/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:20:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:32.086533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a1c48-e4f0-4f9d-b7dc-6972829dfc77 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:32.088063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c82a1c48-e4f0-4f9d-b7dc-6972829dfc77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:32.102720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:32.192599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82a1c48-e4f0-4f9d-b7dc-6972829dfc77 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:32.264779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424e2e6-2fdf-43ea-96b9-c3d733ce8d2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:32.265380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e2e6-2fdf-43ea-96b9-c3d733ce8d2a service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:32.265658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e2e6-2fdf-43ea-96b9-c3d733ce8d2a service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:32.265929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424e2e6-2fdf-43ea-96b9-c3d733ce8d2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:32.267517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c424e2e6-2fdf-43ea-96b9-c3d733ce8d2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:32.334526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:32.375407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e2e6-2fdf-43ea-96b9-c3d733ce8d2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:32.376870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424e2e6-2fdf-43ea-96b9-c3d733ce8d2a service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:32.402615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 729/1470] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:41.798468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=22 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:42.400854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=25 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:52.268341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105199d6-3443-416c-8417-79f0788f83db None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:52.268928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105199d6-3443-416c-8417-79f0788f83db None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:52.268928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-105199d6-3443-416c-8417-79f0788f83db None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:52.270299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 742/1471] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:52.275717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10826a1-b65e-4962-9a42-c7612a995866 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:52.276137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10826a1-b65e-4962-9a42-c7612a995866 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:52.276324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10826a1-b65e-4962-9a42-c7612a995866 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:52.343084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a10826a1-b65e-4962-9a42-c7612a995866 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:52.344346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a10826a1-b65e-4962-9a42-c7612a995866 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:52.438808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 730/1472] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:52.742886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d867d-18e6-438b-816c-c314927f73fe None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:52.743171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d867d-18e6-438b-816c-c314927f73fe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:52.743959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3d867d-18e6-438b-816c-c314927f73fe None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:52.745299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 743/1473] 10.222.0.16 () {54 vars in 962 bytes} [Sat Sep 24 14:20:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:52.750049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c2862-b787-4fef-85d1-6b3fe4f4c678 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:52.750332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c2862-b787-4fef-85d1-6b3fe4f4c678 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:52.750603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c2862-b787-4fef-85d1-6b3fe4f4c678 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:52.825323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f80c2862-b787-4fef-85d1-6b3fe4f4c678 None None] MFA Rules not processed for user `0ece8645e0954e1d81837cdcaa2ef1e5`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:52.826513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f80c2862-b787-4fef-85d1-6b3fe4f4c678 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:52.846965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:52.905298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 731/1474] 10.222.0.16 () {58 vars in 1059 bytes} [Sat Sep 24 14:20:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:52.913043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d867d-18e6-438b-816c-c314927f73fe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:52.914590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fb3d867d-18e6-438b-816c-c314927f73fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:53.023803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3d867d-18e6-438b-816c-c314927f73fe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:53.098503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18396ebb-e84b-4208-9ed0-f871ee6b19e0 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ece8645e0954e1d81837cdcaa2ef1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:53.099110 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18396ebb-e84b-4208-9ed0-f871ee6b19e0 service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:53.099391 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18396ebb-e84b-4208-9ed0-f871ee6b19e0 service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:53.099666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18396ebb-e84b-4208-9ed0-f871ee6b19e0 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:53.101305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-18396ebb-e84b-4208-9ed0-f871ee6b19e0 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:53.155629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:53.210921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18396ebb-e84b-4208-9ed0-f871ee6b19e0 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:53.212901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18396ebb-e84b-4208-9ed0-f871ee6b19e0 service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:53.231368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 744/1475] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:20:55.463467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109db6c-8456-4750-b05b-66af52913ce2 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:55.464070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109db6c-8456-4750-b05b-66af52913ce2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:55.464070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5109db6c-8456-4750-b05b-66af52913ce2 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:55.465386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 732/1476] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:20:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:55.470925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f9df7-25b7-45f4-bc24-44bc261ede78 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:55.471341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f9df7-25b7-45f4-bc24-44bc261ede78 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:55.471473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811f9df7-25b7-45f4-bc24-44bc261ede78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:55.536435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-811f9df7-25b7-45f4-bc24-44bc261ede78 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:55.537661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-811f9df7-25b7-45f4-bc24-44bc261ede78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:55.633574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 745/1477] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:20:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:55.911331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109db6c-8456-4750-b05b-66af52913ce2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:55.912833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5109db6c-8456-4750-b05b-66af52913ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:56.035875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5109db6c-8456-4750-b05b-66af52913ce2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:56.084429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:56.128525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5f3963-696d-4a62-b6bf-d861ed36eedc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:56.129127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3963-696d-4a62-b6bf-d861ed36eedc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:56.129408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3963-696d-4a62-b6bf-d861ed36eedc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:56.129681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5f3963-696d-4a62-b6bf-d861ed36eedc admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:56.130317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f3963-696d-4a62-b6bf-d861ed36eedc admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:56.132096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-2a5f3963-696d-4a62-b6bf-d861ed36eedc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:20:56.132096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 24 14:20:56.132096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: Sep 24 14:20:56.133266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5f3963-696d-4a62-b6bf-d861ed36eedc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:56.153168 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 733/1478] 10.222.0.16 () {56 vars in 1108 bytes} [Sat Sep 24 14:20:55 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:20:58.332234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715f63-ec56-406a-84e1-ed55387a4ead None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:58.332808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715f63-ec56-406a-84e1-ed55387a4ead None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:58.332808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf715f63-ec56-406a-84e1-ed55387a4ead None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:58.334127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 746/1479] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:20:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:20:58.339373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5a10-37b4-4729-aabe-192d8f22be61 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:58.339752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5a10-37b4-4729-aabe-192d8f22be61 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:58.339930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671a5a10-37b4-4729-aabe-192d8f22be61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:58.405947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-671a5a10-37b4-4729-aabe-192d8f22be61 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:20:58.407142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-671a5a10-37b4-4729-aabe-192d8f22be61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:58.503457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 734/1480] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:20:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:20:58.796887 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf715f63-ec56-406a-84e1-ed55387a4ead None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:20:58.798642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cf715f63-ec56-406a-84e1-ed55387a4ead None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:58.808885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:58.942989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf715f63-ec56-406a-84e1-ed55387a4ead None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:20:59.030334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:20:59.062636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679dfb96-fd4b-4569-a548-d391bb5ac149 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:20:59.063172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dfb96-fd4b-4569-a548-d391bb5ac149 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:20:59.063453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dfb96-fd4b-4569-a548-d391bb5ac149 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:20:59.063726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679dfb96-fd4b-4569-a548-d391bb5ac149 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:20:59.065357 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-679dfb96-fd4b-4569-a548-d391bb5ac149 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:20:59.155660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dfb96-fd4b-4569-a548-d391bb5ac149 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:20:59.157255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679dfb96-fd4b-4569-a548-d391bb5ac149 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:20:59.174778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 747/1481] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:20:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:21:01.514134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b77503-7c1e-4770-8be8-841798415e6c None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:01.514623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b77503-7c1e-4770-8be8-841798415e6c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:01.514723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b77503-7c1e-4770-8be8-841798415e6c None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:01.516013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 735/1482] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:21:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:21:01.521219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c821de-84e9-4648-ab33-08a5cb29d871 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:01.521621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c821de-84e9-4648-ab33-08a5cb29d871 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:01.521766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c821de-84e9-4648-ab33-08a5cb29d871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:01.587032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f2c821de-84e9-4648-ab33-08a5cb29d871 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:21:01.588267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f2c821de-84e9-4648-ab33-08a5cb29d871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:01.635096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:01.684831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 748/1483] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:21:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:21:01.970494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b77503-7c1e-4770-8be8-841798415e6c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:21:01.972038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96b77503-7c1e-4770-8be8-841798415e6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:01.996614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:02.075958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b77503-7c1e-4770-8be8-841798415e6c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:21:02.266965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1d447fc-383a-43f6-b07a-930e5f4cda2b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:21:02.267571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d447fc-383a-43f6-b07a-930e5f4cda2b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:02.267857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d447fc-383a-43f6-b07a-930e5f4cda2b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:02.268128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1d447fc-383a-43f6-b07a-930e5f4cda2b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:02.269744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1d447fc-383a-43f6-b07a-930e5f4cda2b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:02.342171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:02.377250 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d447fc-383a-43f6-b07a-930e5f4cda2b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:21:02.378696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1d447fc-383a-43f6-b07a-930e5f4cda2b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:21:02.396214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 736/1484] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:21:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:21:04.593714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac89de2-02cf-4e89-810d-9d375e97a294 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:04.594336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac89de2-02cf-4e89-810d-9d375e97a294 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:04.594336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac89de2-02cf-4e89-810d-9d375e97a294 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:04.595612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 749/1485] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:21:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:21:04.600791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144df62-4dca-4d1f-827f-8855457a787f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:04.601234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144df62-4dca-4d1f-827f-8855457a787f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:04.601339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2144df62-4dca-4d1f-827f-8855457a787f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:04.665009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2144df62-4dca-4d1f-827f-8855457a787f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:21:04.666199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2144df62-4dca-4d1f-827f-8855457a787f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:04.760820 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 737/1486] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:21:05.055076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac89de2-02cf-4e89-810d-9d375e97a294 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:21:05.056691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9ac89de2-02cf-4e89-810d-9d375e97a294 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:05.167748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac89de2-02cf-4e89-810d-9d375e97a294 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:21:05.240378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:05.241902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ea8037-fecd-4db3-b789-d4b631cc4dae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:21:05.242633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea8037-fecd-4db3-b789-d4b631cc4dae service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:05.243633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea8037-fecd-4db3-b789-d4b631cc4dae service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:05.244126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ea8037-fecd-4db3-b789-d4b631cc4dae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:05.245975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-95ea8037-fecd-4db3-b789-d4b631cc4dae service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:05.362422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea8037-fecd-4db3-b789-d4b631cc4dae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:21:05.363893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ea8037-fecd-4db3-b789-d4b631cc4dae service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:21:05.382535 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 750/1487] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:21:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:21:07.703607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4d982-e2ef-4a1a-8c71-6872a3ae4030 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:07.704195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4d982-e2ef-4a1a-8c71-6872a3ae4030 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:07.704195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc4d982-e2ef-4a1a-8c71-6872a3ae4030 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:07.705540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 738/1488] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:21:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:21:07.711506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9370ce-b61b-48d7-b707-d7254ce3ecdf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:07.712023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9370ce-b61b-48d7-b707-d7254ce3ecdf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:07.712141 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9370ce-b61b-48d7-b707-d7254ce3ecdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:07.782269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9c9370ce-b61b-48d7-b707-d7254ce3ecdf None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:21:07.783476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9c9370ce-b61b-48d7-b707-d7254ce3ecdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:07.836723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:07.881761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 751/1489] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:21:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:21:08.175512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4d982-e2ef-4a1a-8c71-6872a3ae4030 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:21:08.177114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5fc4d982-e2ef-4a1a-8c71-6872a3ae4030 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:08.213563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:08.281703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc4d982-e2ef-4a1a-8c71-6872a3ae4030 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:21:08.355046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229eb341-71fe-46c7-b779-ebfdb1ce5752 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:21:08.355648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb341-71fe-46c7-b779-ebfdb1ce5752 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:08.355926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb341-71fe-46c7-b779-ebfdb1ce5752 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:08.356234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229eb341-71fe-46c7-b779-ebfdb1ce5752 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:08.357831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-229eb341-71fe-46c7-b779-ebfdb1ce5752 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:08.448185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:08.477093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eb341-71fe-46c7-b779-ebfdb1ce5752 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:21:08.479103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-229eb341-71fe-46c7-b779-ebfdb1ce5752 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:21:08.496958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 739/1490] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:21:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:21:10.799638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71779a-70d3-4ad5-a99f-33965d898b16 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:10.800204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71779a-70d3-4ad5-a99f-33965d898b16 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:10.800204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de71779a-70d3-4ad5-a99f-33965d898b16 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:10.801541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 752/1491] 10.222.0.16 () {54 vars in 927 bytes} [Sat Sep 24 14:21:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:21:10.807478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34396c3c-f340-43c0-87ae-daec6cd47a5a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:10.807939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34396c3c-f340-43c0-87ae-daec6cd47a5a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:10.808045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34396c3c-f340-43c0-87ae-daec6cd47a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:10.872934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-34396c3c-f340-43c0-87ae-daec6cd47a5a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:21:10.874147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-34396c3c-f340-43c0-87ae-daec6cd47a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:10.968335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 740/1492] 10.222.0.16 () {58 vars in 1024 bytes} [Sat Sep 24 14:21:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:21:11.258242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71779a-70d3-4ad5-a99f-33965d898b16 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:21:11.259802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-de71779a-70d3-4ad5-a99f-33965d898b16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:11.363891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de71779a-70d3-4ad5-a99f-33965d898b16 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:21:11.442363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e1fe331-ce7b-434e-8e1b-5f37255bff3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:21:11.442980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe331-ce7b-434e-8e1b-5f37255bff3f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:21:11.443279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe331-ce7b-434e-8e1b-5f37255bff3f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:21:11.443531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e1fe331-ce7b-434e-8e1b-5f37255bff3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:21:11.445189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e1fe331-ce7b-434e-8e1b-5f37255bff3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:21:11.454468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:11.568115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fe331-ce7b-434e-8e1b-5f37255bff3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:21:11.569547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e1fe331-ce7b-434e-8e1b-5f37255bff3f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:21:11.588668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 753/1493] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:21:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:21:20.966824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=82 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:21:21.586123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=50 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:31.956526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e4b6-4583-46d7-96a4-b73f5d914863 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:31.957117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e4b6-4583-46d7-96a4-b73f5d914863 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:31.957117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7934e4b6-4583-46d7-96a4-b73f5d914863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:32.032485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7934e4b6-4583-46d7-96a4-b73f5d914863 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:22:32.033626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7934e4b6-4583-46d7-96a4-b73f5d914863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:32.127641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 741/1494] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:22:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:22:32.135597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece525-35c9-4dc2-8d95-65b44aafcd24 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:32.136093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece525-35c9-4dc2-8d95-65b44aafcd24 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:32.136239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ece525-35c9-4dc2-8d95-65b44aafcd24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:32.219121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b9ece525-35c9-4dc2-8d95-65b44aafcd24 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:22:32.220373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b9ece525-35c9-4dc2-8d95-65b44aafcd24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:32.315484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 754/1495] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:22:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:22:32.320646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e4b6-4583-46d7-96a4-b73f5d914863 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:22:32.321845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7934e4b6-4583-46d7-96a4-b73f5d914863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:32.332897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7934e4b6-4583-46d7-96a4-b73f5d914863 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:22:32.392917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:32.425494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:22:32.426098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:32.426377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:32.426647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:32.427277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:22:32.427580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:22:32.429136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:22:32.429136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 24 14:22:32.429136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: Sep 24 14:22:32.430010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:22:32.440927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 742/1496] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:22:32.449935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece525-35c9-4dc2-8d95-65b44aafcd24 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:22:32.459139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ece525-35c9-4dc2-8d95-65b44aafcd24 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:22:32.520551 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:32.555146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a9134-3efc-4b56-a3ec-76c65e7ba169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:22:32.555756 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9134-3efc-4b56-a3ec-76c65e7ba169 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:32.556038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9134-3efc-4b56-a3ec-76c65e7ba169 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:32.556357 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04a9134-3efc-4b56-a3ec-76c65e7ba169 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:32.557495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a9134-3efc-4b56-a3ec-76c65e7ba169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:22:32.559412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-e04a9134-3efc-4b56-a3ec-76c65e7ba169 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:22:32.559412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 24 14:22:32.559412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: Sep 24 14:22:32.560644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e04a9134-3efc-4b56-a3ec-76c65e7ba169 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:22:32.617574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 755/1497] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:22:32 2022] POST /identity/v3/projects => generated 377 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:22:32.621653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:22:32.623193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:32.655327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e649c93e-a9f8-480a-b4ae-15f5acd0374f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:22:32.746625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f8b1a-5b5f-4b32-87e1-40a091ebbc87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:22:32.747216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f8b1a-5b5f-4b32-87e1-40a091ebbc87 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:32.747491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f8b1a-5b5f-4b32-87e1-40a091ebbc87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:32.747759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7f8b1a-5b5f-4b32-87e1-40a091ebbc87 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:32.748416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f8b1a-5b5f-4b32-87e1-40a091ebbc87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:22:32.749425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-cb7f8b1a-5b5f-4b32-87e1-40a091ebbc87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:22:32.749425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 24 14:22:32.749425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: Sep 24 14:22:32.750607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7f8b1a-5b5f-4b32-87e1-40a091ebbc87 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:22:32.793566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 743/1498] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:22:32 2022] POST /identity/v3/users => generated 289 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:22:32.797744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a9134-3efc-4b56-a3ec-76c65e7ba169 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:22:32.799289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e04a9134-3efc-4b56-a3ec-76c65e7ba169 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:32.861673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e04a9134-3efc-4b56-a3ec-76c65e7ba169 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:22:32.948359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:32.959383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4120452-10fb-42b7-a388-3cd09bf0e578 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:22:32.959991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4120452-10fb-42b7-a388-3cd09bf0e578 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:32.960300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4120452-10fb-42b7-a388-3cd09bf0e578 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:32.960574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4120452-10fb-42b7-a388-3cd09bf0e578 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:32.961211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4120452-10fb-42b7-a388-3cd09bf0e578 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:22:32.962223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-e4120452-10fb-42b7-a388-3cd09bf0e578 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:22:32.962223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 24 14:22:32.962223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: Sep 24 14:22:32.963107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4120452-10fb-42b7-a388-3cd09bf0e578 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:22:32.975441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 756/1499] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:22:32.979530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f8b1a-5b5f-4b32-87e1-40a091ebbc87 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:22:32.981166 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb7f8b1a-5b5f-4b32-87e1-40a091ebbc87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:32.993140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7f8b1a-5b5f-4b32-87e1-40a091ebbc87 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:22:33.018318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:33.088053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ef9100-8043-41dc-959d-85043c6519ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:22:33.088688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9100-8043-41dc-959d-85043c6519ad admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:33.088961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9100-8043-41dc-959d-85043c6519ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:33.089227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ef9100-8043-41dc-959d-85043c6519ad admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:33.089859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef9100-8043-41dc-959d-85043c6519ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:22:33.090872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-08ef9100-8043-41dc-959d-85043c6519ad admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:22:33.090872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 24 14:22:33.090872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: Sep 24 14:22:33.092014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ef9100-8043-41dc-959d-85043c6519ad admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:22:33.104017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 744/1500] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:22:33.108255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4120452-10fb-42b7-a388-3cd09bf0e578 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:22:33.109806 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e4120452-10fb-42b7-a388-3cd09bf0e578 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:33.144583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4120452-10fb-42b7-a388-3cd09bf0e578 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:22:33.239481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7f177f-d73d-45ba-858d-90b116b7b465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:22:33.240050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f177f-d73d-45ba-858d-90b116b7b465 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:33.240855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f177f-d73d-45ba-858d-90b116b7b465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:33.241125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7f177f-d73d-45ba-858d-90b116b7b465 admin admin] PATH_INFO: `/v3/projects/1427d9eece054862b19de4dacffa405a/users/e0fcf7c42d364bc4be5d85de90433339/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:33.264610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f177f-d73d-45ba-858d-90b116b7b465 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1427d9eece054862b19de4dacffa405a, user_id=e0fcf7c42d364bc4be5d85de90433339, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:22:33.265686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-2e7f177f-d73d-45ba-858d-90b116b7b465 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:22:33.265686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 24 14:22:33.265686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: Sep 24 14:22:33.268101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7f177f-d73d-45ba-858d-90b116b7b465 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:22:33.293203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 757/1501] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:22:33 2022] PUT /identity/v3/projects/1427d9eece054862b19de4dacffa405a/users/e0fcf7c42d364bc4be5d85de90433339/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:22:33.305881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028cd9e-edbf-41bb-9a6d-7f7b19ebc531 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:33.306165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028cd9e-edbf-41bb-9a6d-7f7b19ebc531 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:33.306436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028cd9e-edbf-41bb-9a6d-7f7b19ebc531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:33.363145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0028cd9e-edbf-41bb-9a6d-7f7b19ebc531 None None] MFA Rules not processed for user `e0fcf7c42d364bc4be5d85de90433339`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:22:33.364379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0028cd9e-edbf-41bb-9a6d-7f7b19ebc531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:33.439645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 745/1502] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:22:33.452866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce7ca6-9903-4ff2-9aac-5ba843603fbc None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:33.453149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce7ca6-9903-4ff2-9aac-5ba843603fbc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:33.453422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ce7ca6-9903-4ff2-9aac-5ba843603fbc None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:33.454739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 758/1503] 10.222.0.16 () {54 vars in 963 bytes} [Sat Sep 24 14:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:22:33.459478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac7f1c-189c-44a2-a700-10014ef994d9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:33.459762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac7f1c-189c-44a2-a700-10014ef994d9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:33.460034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aac7f1c-189c-44a2-a700-10014ef994d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:33.492462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:33.535763 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3aac7f1c-189c-44a2-a700-10014ef994d9 None None] MFA Rules not processed for user `c1152b27494941deae022b8a3eb48802`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:22:33.537487 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3aac7f1c-189c-44a2-a700-10014ef994d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:33.610893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 746/1504] 10.222.0.16 () {58 vars in 1060 bytes} [Sat Sep 24 14:22:33 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:22:33.619105 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce7ca6-9903-4ff2-9aac-5ba843603fbc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:22:33.620637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-88ce7ca6-9903-4ff2-9aac-5ba843603fbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:33.670118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:33.723744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ce7ca6-9903-4ff2-9aac-5ba843603fbc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:22:33.800169 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a50e0-f561-4427-af58-83c3b5dcb212 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:22:33.800808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a50e0-f561-4427-af58-83c3b5dcb212 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:33.801082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a50e0-f561-4427-af58-83c3b5dcb212 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:33.801374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b27a50e0-f561-4427-af58-83c3b5dcb212 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:33.802960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b27a50e0-f561-4427-af58-83c3b5dcb212 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:33.899267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a50e0-f561-4427-af58-83c3b5dcb212 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:22:33.900858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b27a50e0-f561-4427-af58-83c3b5dcb212 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:22:33.904296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:33.919357 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 759/1505] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:22:33 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:22:33.965470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702eb77-d5c9-47ef-b0a3-93c0b6d27868 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:33.965761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702eb77-d5c9-47ef-b0a3-93c0b6d27868 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:33.966040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5702eb77-d5c9-47ef-b0a3-93c0b6d27868 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:33.967554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 747/1506] 10.222.0.16 () {52 vars in 830 bytes} [Sat Sep 24 14:22:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:22:33.971142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a50e0-f561-4427-af58-83c3b5dcb212 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:22:33.972388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b27a50e0-f561-4427-af58-83c3b5dcb212 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:34.069597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b27a50e0-f561-4427-af58-83c3b5dcb212 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:22:34.161897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:22:34.162552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:34.162813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:34.163087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] PATH_INFO: `/v3/users/e0fcf7c42d364bc4be5d85de90433339` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:34.175925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e0fcf7c42d364bc4be5d85de90433339)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:22:34.176991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:22:34.176991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 24 14:22:34.176991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: Sep 24 14:22:34.178229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:22:34.187867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:34.249460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e0fcf7c42d364bc4be5d85de90433339'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:22:34.249925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e0fcf7c42d364bc4be5d85de90433339'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:22:34.250462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e0fcf7c42d364bc4be5d85de90433339'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:22:34.264506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e0fcf7c42d364bc4be5d85de90433339'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:22:34.289889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e0fcf7c42d364bc4be5d85de90433339'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:22:34.304104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 760/1507] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:22:33 2022] DELETE /identity/v3/users/e0fcf7c42d364bc4be5d85de90433339 => generated 0 bytes in 333 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:22:34.308552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d520c1-a676-4c29-a13f-e93d2d8bf474 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:34.309057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d520c1-a676-4c29-a13f-e93d2d8bf474 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:34.309166 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d520c1-a676-4c29-a13f-e93d2d8bf474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:34.366108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-08d520c1-a676-4c29-a13f-e93d2d8bf474 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:22:34.367233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-08d520c1-a676-4c29-a13f-e93d2d8bf474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:34.440524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:34.454040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 748/1508] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:22:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:22:34.463638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:22:34.464901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:34.566456 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831fff4c-bec2-4091-9205-6243cd6ffc79 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:22:34.626303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:34.646555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1151cd54-66fa-4fe1-9758-d7914aeac49f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:22:34.647159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151cd54-66fa-4fe1-9758-d7914aeac49f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:34.647439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151cd54-66fa-4fe1-9758-d7914aeac49f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:34.647711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1151cd54-66fa-4fe1-9758-d7914aeac49f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:34.649344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1151cd54-66fa-4fe1-9758-d7914aeac49f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:34.755539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151cd54-66fa-4fe1-9758-d7914aeac49f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:22:34.757620 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1151cd54-66fa-4fe1-9758-d7914aeac49f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:22:34.775649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 761/1509] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:22:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:22:35.138637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d520c1-a676-4c29-a13f-e93d2d8bf474 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:22:35.139865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-08d520c1-a676-4c29-a13f-e93d2d8bf474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:22:35.151661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d520c1-a676-4c29-a13f-e93d2d8bf474 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:22:35.253781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09507af3-1753-48db-8946-cb809569401e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:22:35.254878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09507af3-1753-48db-8946-cb809569401e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:22:35.255394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09507af3-1753-48db-8946-cb809569401e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:22:35.256486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09507af3-1753-48db-8946-cb809569401e admin admin] PATH_INFO: `/v3/projects/1427d9eece054862b19de4dacffa405a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:22:35.267179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09507af3-1753-48db-8946-cb809569401e admin admin] RBAC: Authorizing `identity:delete_project(project_id=1427d9eece054862b19de4dacffa405a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:22:35.268264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-09507af3-1753-48db-8946-cb809569401e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:22:35.268264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 24 14:22:35.268264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: Sep 24 14:22:35.269449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09507af3-1753-48db-8946-cb809569401e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:22:35.330918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09507af3-1753-48db-8946-cb809569401e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1427d9eece054862b19de4dacffa405a', 'request_id': 'req-09507af3-1753-48db-8946-cb809569401e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:22:35.339775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09507af3-1753-48db-8946-cb809569401e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1427d9eece054862b19de4dacffa405a', 'request_id': 'req-09507af3-1753-48db-8946-cb809569401e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:22:35.354998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09507af3-1753-48db-8946-cb809569401e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1427d9eece054862b19de4dacffa405a', 'request_id': 'req-09507af3-1753-48db-8946-cb809569401e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:22:35.387127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09507af3-1753-48db-8946-cb809569401e admin admin] The token cache is being invalidate because project 1427d9eece054862b19de4dacffa405a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:22:35.387452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09507af3-1753-48db-8946-cb809569401e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:22:35.388076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-09507af3-1753-48db-8946-cb809569401e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:22:35.392195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 749/1510] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:22:35 2022] DELETE /identity/v3/projects/1427d9eece054862b19de4dacffa405a => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:22:44.773407 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=62 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:22:45.384663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:24:10.312249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8539c1-9900-40aa-8a45-0c2c8cb47853 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:10.312858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8539c1-9900-40aa-8a45-0c2c8cb47853 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:10.312858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8539c1-9900-40aa-8a45-0c2c8cb47853 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:10.314213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 762/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:24:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:24:10.320399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba62b-4b3a-4185-9cad-67bda8e5788e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:10.320814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba62b-4b3a-4185-9cad-67bda8e5788e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:10.320956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22ba62b-4b3a-4185-9cad-67bda8e5788e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:10.399417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f22ba62b-4b3a-4185-9cad-67bda8e5788e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:24:10.400649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f22ba62b-4b3a-4185-9cad-67bda8e5788e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:10.505116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 750/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:24:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:24:10.659591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8539c1-9900-40aa-8a45-0c2c8cb47853 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:24:10.661717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ab8539c1-9900-40aa-8a45-0c2c8cb47853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:10.779001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8539c1-9900-40aa-8a45-0c2c8cb47853 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:24:10.784986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3d35e4-fe15-46d7-a4d1-0fdf2c96ed34 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:24:10.785582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d35e4-fe15-46d7-a4d1-0fdf2c96ed34 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:10.785863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d35e4-fe15-46d7-a4d1-0fdf2c96ed34 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:10.786138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3d35e4-fe15-46d7-a4d1-0fdf2c96ed34 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:10.794029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d35e4-fe15-46d7-a4d1-0fdf2c96ed34 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:24:10.795597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3d35e4-fe15-46d7-a4d1-0fdf2c96ed34 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:24:10.805473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 763/1513] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:24:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:24:11.794566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eaee20-1ec4-422c-93ef-31fbec416a5d None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:11.802107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eaee20-1ec4-422c-93ef-31fbec416a5d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:11.802107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9eaee20-1ec4-422c-93ef-31fbec416a5d None None] PATH_INFO: `/v3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:11.802611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 751/1514] 10.222.0.18 () {54 vars in 925 bytes} [Sat Sep 24 14:24:11 2022] GET /identity/v3 => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:24:11.809380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f150d6-e7c7-4af4-b24d-baa3576523a8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:11.809922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f150d6-e7c7-4af4-b24d-baa3576523a8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:11.809922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f150d6-e7c7-4af4-b24d-baa3576523a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:11.870533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c5f150d6-e7c7-4af4-b24d-baa3576523a8 None None] MFA Rules not processed for user `2bc00e6583d7424cbdc13732a962fc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:24:11.871787 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5f150d6-e7c7-4af4-b24d-baa3576523a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:11.895378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf00261-c1eb-4f79-a0d0-7d2365be9c8e None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:11.895665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf00261-c1eb-4f79-a0d0-7d2365be9c8e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:11.895945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf00261-c1eb-4f79-a0d0-7d2365be9c8e None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:11.897327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 752/1515] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:24:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:24:11.903572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a596-be98-441a-9b47-233b2d5e84e1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:11.903863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a596-be98-441a-9b47-233b2d5e84e1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:11.904147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb82a596-be98-441a-9b47-233b2d5e84e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:11.925268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cb82a596-be98-441a-9b47-233b2d5e84e1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:24:11.926482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb82a596-be98-441a-9b47-233b2d5e84e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:11.934477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 753/1516] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:24:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:24:11.943193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:24:11.949866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 764/1517] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Sep 24 14:24:11 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:24:12.087428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82a596-be98-441a-9b47-233b2d5e84e1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:24:12.100680 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb82a596-be98-441a-9b47-233b2d5e84e1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:24:12.106846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdeb373c-7235-4346-b660-3ebdbe064216 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:24:12.107447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb373c-7235-4346-b660-3ebdbe064216 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:12.107726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb373c-7235-4346-b660-3ebdbe064216 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:12.108000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdeb373c-7235-4346-b660-3ebdbe064216 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:12.116242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb373c-7235-4346-b660-3ebdbe064216 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:24:12.118339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdeb373c-7235-4346-b660-3ebdbe064216 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:24:12.128072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 754/1518] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:24:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:24:21.608658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0e2e-4655-4956-9fb6-1cdbc956994f None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:21.609139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0e2e-4655-4956-9fb6-1cdbc956994f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:21.609275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179f0e2e-4655-4956-9fb6-1cdbc956994f None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:21.610521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 765/1519] 10.222.0.16 () {54 vars in 961 bytes} [Sat Sep 24 14:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:24:21.616117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81156b-a326-4cf6-aba9-bf2bc1c44229 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:21.616552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81156b-a326-4cf6-aba9-bf2bc1c44229 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:21.616700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be81156b-a326-4cf6-aba9-bf2bc1c44229 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:21.636696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-be81156b-a326-4cf6-aba9-bf2bc1c44229 None None] MFA Rules not processed for user `2bc00e6583d7424cbdc13732a962fc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:24:21.637885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-be81156b-a326-4cf6-aba9-bf2bc1c44229 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:21.646237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 755/1520] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Sep 24 14:24:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:24:21.653861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f0e2e-4655-4956-9fb6-1cdbc956994f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:24:21.666992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179f0e2e-4655-4956-9fb6-1cdbc956994f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:24:21.671987 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b3c2ab-adac-4032-8c4f-33476a66289e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc00e6583d7424cbdc13732a962fc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:24:21.672605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c2ab-adac-4032-8c4f-33476a66289e service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:21.672890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c2ab-adac-4032-8c4f-33476a66289e service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:21.673687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b3c2ab-adac-4032-8c4f-33476a66289e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:21.681845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3c2ab-adac-4032-8c4f-33476a66289e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:24:21.683409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b3c2ab-adac-4032-8c4f-33476a66289e service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:24:21.694079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 766/1521] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:24:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:24:23.583839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a405a-c27e-4d91-917f-9611f4f4e189 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:23.584402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a405a-c27e-4d91-917f-9611f4f4e189 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:23.584402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90a405a-c27e-4d91-917f-9611f4f4e189 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:23.585827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:24:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:24:23.592052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b0fd-4f8d-497b-ae44-16ee01ba9dfb None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:23.592497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b0fd-4f8d-497b-ae44-16ee01ba9dfb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:23.592632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a1b0fd-4f8d-497b-ae44-16ee01ba9dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:23.611726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-56a1b0fd-4f8d-497b-ae44-16ee01ba9dfb None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:24:23.612947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-56a1b0fd-4f8d-497b-ae44-16ee01ba9dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:23.620697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:24:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:24:23.773681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a405a-c27e-4d91-917f-9611f4f4e189 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:24:23.794116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90a405a-c27e-4d91-917f-9611f4f4e189 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:24:23.799517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5154fb52-85ab-4a02-b716-e3f3adf79e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:24:23.800111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154fb52-85ab-4a02-b716-e3f3adf79e12 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:23.800419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154fb52-85ab-4a02-b716-e3f3adf79e12 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:23.800690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5154fb52-85ab-4a02-b716-e3f3adf79e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:23.808559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154fb52-85ab-4a02-b716-e3f3adf79e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:24:23.810128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5154fb52-85ab-4a02-b716-e3f3adf79e12 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:24:23.819741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 757/1524] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:24:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:24:24.884735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8323e5-2f9e-45ec-a047-a04bb4a92261 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:24.885302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8323e5-2f9e-45ec-a047-a04bb4a92261 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:24.885302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8323e5-2f9e-45ec-a047-a04bb4a92261 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:24.886614 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sat Sep 24 14:24:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:24:24.893250 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad892a6-276e-4484-bbf9-dfa6f392cd21 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:24.893668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad892a6-276e-4484-bbf9-dfa6f392cd21 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:24.893793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad892a6-276e-4484-bbf9-dfa6f392cd21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:24.915159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cad892a6-276e-4484-bbf9-dfa6f392cd21 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:24:24.916412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cad892a6-276e-4484-bbf9-dfa6f392cd21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:24.924265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sat Sep 24 14:24:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:24:25.074868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8323e5-2f9e-45ec-a047-a04bb4a92261 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:24:25.089795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8323e5-2f9e-45ec-a047-a04bb4a92261 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:24:25.095597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31401f27-1598-41b3-8bb5-f77151e1e0a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:24:25.096213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401f27-1598-41b3-8bb5-f77151e1e0a8 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:25.096498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401f27-1598-41b3-8bb5-f77151e1e0a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:25.096774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31401f27-1598-41b3-8bb5-f77151e1e0a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:25.105051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401f27-1598-41b3-8bb5-f77151e1e0a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:24:25.106627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31401f27-1598-41b3-8bb5-f77151e1e0a8 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:24:25.116006 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 769/1527] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:24:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:24:29.255948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75462809-4930-4449-bd14-38f818a8f4e4 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:29.256517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75462809-4930-4449-bd14-38f818a8f4e4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:29.256517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75462809-4930-4449-bd14-38f818a8f4e4 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:29.257875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:24:29.263151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254cc90-3d9a-4a60-95cf-5142df77020c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:29.263575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254cc90-3d9a-4a60-95cf-5142df77020c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:29.263691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0254cc90-3d9a-4a60-95cf-5142df77020c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:29.282738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0254cc90-3d9a-4a60-95cf-5142df77020c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:24:29.283921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0254cc90-3d9a-4a60-95cf-5142df77020c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:29.291864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:24:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:24:29.584431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75462809-4930-4449-bd14-38f818a8f4e4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:24:29.586225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-75462809-4930-4449-bd14-38f818a8f4e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:29.613338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:24:29.664978 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75462809-4930-4449-bd14-38f818a8f4e4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:24:29.668595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682574b3-0e92-46a7-9bfc-7a7bd7e84127 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:24:29.669175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682574b3-0e92-46a7-9bfc-7a7bd7e84127 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:29.669456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682574b3-0e92-46a7-9bfc-7a7bd7e84127 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:29.669726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682574b3-0e92-46a7-9bfc-7a7bd7e84127 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:29.679105 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682574b3-0e92-46a7-9bfc-7a7bd7e84127 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:24:29.680613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682574b3-0e92-46a7-9bfc-7a7bd7e84127 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:24:29.689950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 760/1530] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:24:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:24:31.838446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563ea3-4c78-4ada-bcca-bb5ecbea8947 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:31.838989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563ea3-4c78-4ada-bcca-bb5ecbea8947 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:31.838989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1563ea3-4c78-4ada-bcca-bb5ecbea8947 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:31.840629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:24:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:24:31.846293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf691-6054-4882-9471-6b68c7308ff8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:31.846721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf691-6054-4882-9471-6b68c7308ff8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:31.846832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61bf691-6054-4882-9471-6b68c7308ff8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:31.866415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a61bf691-6054-4882-9471-6b68c7308ff8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:24:31.867622 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a61bf691-6054-4882-9471-6b68c7308ff8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:31.875658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:24:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:24:32.162193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563ea3-4c78-4ada-bcca-bb5ecbea8947 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:24:32.173735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1563ea3-4c78-4ada-bcca-bb5ecbea8947 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:24:32.177289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0701eb-0e6a-412a-914e-51f1f94cecd0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:24:32.177901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0701eb-0e6a-412a-914e-51f1f94cecd0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:32.178175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0701eb-0e6a-412a-914e-51f1f94cecd0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:32.178443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0701eb-0e6a-412a-914e-51f1f94cecd0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:32.187176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0701eb-0e6a-412a-914e-51f1f94cecd0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:24:32.189192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a0701eb-0e6a-412a-914e-51f1f94cecd0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:24:32.198304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 772/1533] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:24:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:24:35.879613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817d60f-c346-4e99-a48d-8671e00b249f None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:35.880256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817d60f-c346-4e99-a48d-8671e00b249f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:35.880256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2817d60f-c346-4e99-a48d-8671e00b249f None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:35.881542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:24:35.886961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0e23-73c0-42c9-b6c1-82763754055b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:35.887355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0e23-73c0-42c9-b6c1-82763754055b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:35.887515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16c0e23-73c0-42c9-b6c1-82763754055b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:35.908071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f16c0e23-73c0-42c9-b6c1-82763754055b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:24:35.909298 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f16c0e23-73c0-42c9-b6c1-82763754055b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:35.917598 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:24:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:24:36.219489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817d60f-c346-4e99-a48d-8671e00b249f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:24:36.221719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2817d60f-c346-4e99-a48d-8671e00b249f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:36.299212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2817d60f-c346-4e99-a48d-8671e00b249f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:24:36.302802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-986992f6-01a5-48ad-84a1-2023b3f73dc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:24:36.303400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986992f6-01a5-48ad-84a1-2023b3f73dc7 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:36.303676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986992f6-01a5-48ad-84a1-2023b3f73dc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:36.303944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-986992f6-01a5-48ad-84a1-2023b3f73dc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:36.312656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986992f6-01a5-48ad-84a1-2023b3f73dc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:24:36.314711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-986992f6-01a5-48ad-84a1-2023b3f73dc7 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:24:36.324036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 763/1536] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:24:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:24:38.469762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcd681-072d-41ff-84a5-865fbdad2caa None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:38.470327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcd681-072d-41ff-84a5-865fbdad2caa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:38.470422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fcd681-072d-41ff-84a5-865fbdad2caa None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:38.471766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sat Sep 24 14:24:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:24:38.477174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e3dd2-edb5-4545-bb91-ea73342d21f5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:38.477574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e3dd2-edb5-4545-bb91-ea73342d21f5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:38.477723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3e3dd2-edb5-4545-bb91-ea73342d21f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:38.497665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fa3e3dd2-edb5-4545-bb91-ea73342d21f5 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:24:38.498843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fa3e3dd2-edb5-4545-bb91-ea73342d21f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:38.507130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sat Sep 24 14:24:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:24:38.805228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcd681-072d-41ff-84a5-865fbdad2caa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:24:38.806914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-85fcd681-072d-41ff-84a5-865fbdad2caa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:24:38.819789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fcd681-072d-41ff-84a5-865fbdad2caa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:24:38.823323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e7dfe4-ed0f-43b0-bf86-5c6a93cfa524 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:24:38.823909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7dfe4-ed0f-43b0-bf86-5c6a93cfa524 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:24:38.824220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7dfe4-ed0f-43b0-bf86-5c6a93cfa524 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:24:38.824499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e7dfe4-ed0f-43b0-bf86-5c6a93cfa524 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:24:38.833202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7dfe4-ed0f-43b0-bf86-5c6a93cfa524 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:24:38.834617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e7dfe4-ed0f-43b0-bf86-5c6a93cfa524 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:24:38.844205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 775/1539] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:24:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:24:48.492791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=66 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:24:48.839766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=34 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:10.499320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def57f72-86cb-479a-8f6f-757456047eb4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.499968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def57f72-86cb-479a-8f6f-757456047eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.499968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def57f72-86cb-479a-8f6f-757456047eb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.518010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac9b9e-e0af-4fbd-99eb-df01097ab745 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.518623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac9b9e-e0af-4fbd-99eb-df01097ab745 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.518623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac9b9e-e0af-4fbd-99eb-df01097ab745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.531201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-def57f72-86cb-479a-8f6f-757456047eb4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:10.533795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-def57f72-86cb-479a-8f6f-757456047eb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:10.559540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 765/1540] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:10.564181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f17da-79bd-450a-bbbe-2c464868ac63 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.564807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f17da-79bd-450a-bbbe-2c464868ac63 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.565303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18f17da-79bd-450a-bbbe-2c464868ac63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.566583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-63ac9b9e-e0af-4fbd-99eb-df01097ab745 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:10.569050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-63ac9b9e-e0af-4fbd-99eb-df01097ab745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:10.597147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 776/1541] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:26:10.598100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7430b3-50b4-41a0-ac74-675c71d1dcbe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.598390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7430b3-50b4-41a0-ac74-675c71d1dcbe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.598665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c7430b3-50b4-41a0-ac74-675c71d1dcbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.611638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b18f17da-79bd-450a-bbbe-2c464868ac63 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:10.613329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b18f17da-79bd-450a-bbbe-2c464868ac63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:10.636549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 766/1542] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:10.638343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1426e-82ce-417e-b44f-d2bd0528a95b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.642920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1426e-82ce-417e-b44f-d2bd0528a95b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.643647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e1426e-82ce-417e-b44f-d2bd0528a95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.645407 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4c7430b3-50b4-41a0-ac74-675c71d1dcbe None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:10.646808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4c7430b3-50b4-41a0-ac74-675c71d1dcbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:10.673178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 777/1543] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:10.674775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d159a9-dd63-43af-af17-3e8e96acd70f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.675065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d159a9-dd63-43af-af17-3e8e96acd70f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.675345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d159a9-dd63-43af-af17-3e8e96acd70f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.694427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-97e1426e-82ce-417e-b44f-d2bd0528a95b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:10.696033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-97e1426e-82ce-417e-b44f-d2bd0528a95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:10.708424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-43d159a9-dd63-43af-af17-3e8e96acd70f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:10.709755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-43d159a9-dd63-43af-af17-3e8e96acd70f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:10.722715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 767/1544] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:10.723948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 778/1545] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:10.724395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1426e-82ce-417e-b44f-d2bd0528a95b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:10.731868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d159a9-dd63-43af-af17-3e8e96acd70f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:10.741247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e1426e-82ce-417e-b44f-d2bd0528a95b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:10.750154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d159a9-dd63-43af-af17-3e8e96acd70f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:10.754963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b99ca5b-3d14-4957-a28d-84a334d4aaf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:10.755964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99ca5b-3d14-4957-a28d-84a334d4aaf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.756511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99ca5b-3d14-4957-a28d-84a334d4aaf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.757082 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b99ca5b-3d14-4957-a28d-84a334d4aaf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.757951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99ca5b-3d14-4957-a28d-84a334d4aaf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:10.758691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99ca5b-3d14-4957-a28d-84a334d4aaf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:10.761411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b99ca5b-3d14-4957-a28d-84a334d4aaf1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:10.761848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8391fb2-68fb-4faa-a107-4a68714762d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:10.762494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8391fb2-68fb-4faa-a107-4a68714762d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.762953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8391fb2-68fb-4faa-a107-4a68714762d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.763250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8391fb2-68fb-4faa-a107-4a68714762d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.763932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8391fb2-68fb-4faa-a107-4a68714762d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:10.764272 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8391fb2-68fb-4faa-a107-4a68714762d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:10.765331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-c8391fb2-68fb-4faa-a107-4a68714762d8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:26:10.765331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 24 14:26:10.765331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: Sep 24 14:26:10.772210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8391fb2-68fb-4faa-a107-4a68714762d8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:10.782174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 779/1546] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:26:10.783089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8391fb2-68fb-4faa-a107-4a68714762d8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:10.791784 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 768/1547] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:10.799363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ea249-afbc-4501-9b9e-9e9f597962cf None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.800092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ea249-afbc-4501-9b9e-9e9f597962cf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.800643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d6ea249-afbc-4501-9b9e-9e9f597962cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.808372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8391fb2-68fb-4faa-a107-4a68714762d8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:10.819159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b46f6-5357-437b-a517-ac018f1bfc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:10.819795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b46f6-5357-437b-a517-ac018f1bfc5a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.820077 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b46f6-5357-437b-a517-ac018f1bfc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.820380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514b46f6-5357-437b-a517-ac018f1bfc5a admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.821043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b46f6-5357-437b-a517-ac018f1bfc5a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:10.821351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b46f6-5357-437b-a517-ac018f1bfc5a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:10.823068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514b46f6-5357-437b-a517-ac018f1bfc5a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:10.849593 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2d6ea249-afbc-4501-9b9e-9e9f597962cf None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:10.851218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2d6ea249-afbc-4501-9b9e-9e9f597962cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:10.851358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 780/1548] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:10.852194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b46f6-5357-437b-a517-ac018f1bfc5a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:10.868605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514b46f6-5357-437b-a517-ac018f1bfc5a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:10.871673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 769/1549] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:26:10.873142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ea249-afbc-4501-9b9e-9e9f597962cf None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:10.881784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4481c166-5e4c-47f1-bd76-069e2010a321 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:10.882810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481c166-5e4c-47f1-bd76-069e2010a321 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.883296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481c166-5e4c-47f1-bd76-069e2010a321 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.884990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4481c166-5e4c-47f1-bd76-069e2010a321 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.885959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481c166-5e4c-47f1-bd76-069e2010a321 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:10.888480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4481c166-5e4c-47f1-bd76-069e2010a321 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:10.895953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d6ea249-afbc-4501-9b9e-9e9f597962cf None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:10.909883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7c5cf-c388-4df9-b755-414fab17c3f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:10.910958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7c5cf-c388-4df9-b755-414fab17c3f9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.911474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7c5cf-c388-4df9-b755-414fab17c3f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.911964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65a7c5cf-c388-4df9-b755-414fab17c3f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.912918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7c5cf-c388-4df9-b755-414fab17c3f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:10.914227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-65a7c5cf-c388-4df9-b755-414fab17c3f9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:26:10.914227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 24 14:26:10.914227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: Sep 24 14:26:10.916225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65a7c5cf-c388-4df9-b755-414fab17c3f9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:10.951127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 781/1550] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/projects => generated 389 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:10.952458 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2b7e8-2d8a-41c9-9a37-b938d880e44b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:10.952748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2b7e8-2d8a-41c9-9a37-b938d880e44b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:10.953022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae2b7e8-2d8a-41c9-9a37-b938d880e44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:10.954623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 770/1551] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/projects => generated 365 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:10.958748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7c5cf-c388-4df9-b755-414fab17c3f9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:10.984210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4ae2b7e8-2d8a-41c9-9a37-b938d880e44b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:10.986143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4ae2b7e8-2d8a-41c9-9a37-b938d880e44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:11.034660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65a7c5cf-c388-4df9-b755-414fab17c3f9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.039531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a6e316-2b6b-4177-b00f-25e20bd1ca7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.040148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6e316-2b6b-4177-b00f-25e20bd1ca7f admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.040506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6e316-2b6b-4177-b00f-25e20bd1ca7f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.040922 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a6e316-2b6b-4177-b00f-25e20bd1ca7f admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.041565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6e316-2b6b-4177-b00f-25e20bd1ca7f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.044095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a6e316-2b6b-4177-b00f-25e20bd1ca7f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.053894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 782/1552] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:11.061273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647747c7-9d01-4d0a-b1fc-221ec8eaadae None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.061687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647747c7-9d01-4d0a-b1fc-221ec8eaadae None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.062152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647747c7-9d01-4d0a-b1fc-221ec8eaadae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.083416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 771/1553] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:10 2022] POST /identity/v3/projects => generated 369 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:11.085160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e8c32-baf8-4064-a624-6af0a54e6000 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.085766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e8c32-baf8-4064-a624-6af0a54e6000 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.086275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0e8c32-baf8-4064-a624-6af0a54e6000 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.093234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-647747c7-9d01-4d0a-b1fc-221ec8eaadae None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:11.094483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-647747c7-9d01-4d0a-b1fc-221ec8eaadae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:11.109138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3c0e8c32-baf8-4064-a624-6af0a54e6000 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:11.110352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c0e8c32-baf8-4064-a624-6af0a54e6000 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:11.156729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 783/1554] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:11.157636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647747c7-9d01-4d0a-b1fc-221ec8eaadae None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.168269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647747c7-9d01-4d0a-b1fc-221ec8eaadae None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.173071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e8d09a-787f-4b5a-9411-9cb43f3ca24e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.173689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8d09a-787f-4b5a-9411-9cb43f3ca24e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.174005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8d09a-787f-4b5a-9411-9cb43f3ca24e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.174283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e8d09a-787f-4b5a-9411-9cb43f3ca24e admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.174930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8d09a-787f-4b5a-9411-9cb43f3ca24e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.175953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-40e8d09a-787f-4b5a-9411-9cb43f3ca24e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:26:11.175953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 24 14:26:11.175953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: Sep 24 14:26:11.177283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e8d09a-787f-4b5a-9411-9cb43f3ca24e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.178865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 772/1555] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:11.179834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e8c32-baf8-4064-a624-6af0a54e6000 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.194850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0e8c32-baf8-4064-a624-6af0a54e6000 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.200820 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c878c1fc-adf7-4dba-9fad-cbe65234ebfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.201439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878c1fc-adf7-4dba-9fad-cbe65234ebfe admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.201715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878c1fc-adf7-4dba-9fad-cbe65234ebfe admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.201984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c878c1fc-adf7-4dba-9fad-cbe65234ebfe admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.202640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878c1fc-adf7-4dba-9fad-cbe65234ebfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.204599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c878c1fc-adf7-4dba-9fad-cbe65234ebfe admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.205305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 784/1556] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/users => generated 295 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:11.206799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1c465-d8d4-4a13-b352-c55a34e5febe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.207098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1c465-d8d4-4a13-b352-c55a34e5febe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.207376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa1c465-d8d4-4a13-b352-c55a34e5febe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.224641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:11.230491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dfa1c465-d8d4-4a13-b352-c55a34e5febe None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:11.232394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dfa1c465-d8d4-4a13-b352-c55a34e5febe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:11.233413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 773/1557] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/users => generated 283 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:11.234675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cf7f0-c00c-4ee1-9db9-6ec6cd170f37 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.234943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cf7f0-c00c-4ee1-9db9-6ec6cd170f37 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.235214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a7cf7f0-c00c-4ee1-9db9-6ec6cd170f37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.246493 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 785/1558] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:11.247322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1c465-d8d4-4a13-b352-c55a34e5febe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.250653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:11.257958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa1c465-d8d4-4a13-b352-c55a34e5febe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.260919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5a7cf7f0-c00c-4ee1-9db9-6ec6cd170f37 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:11.262829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5a7cf7f0-c00c-4ee1-9db9-6ec6cd170f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:11.264262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa1da-bfe7-4b2e-88c1-e7ac4880911a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.264875 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa1da-bfe7-4b2e-88c1-e7ac4880911a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.265155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa1da-bfe7-4b2e-88c1-e7ac4880911a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.265429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79fa1da-bfe7-4b2e-88c1-e7ac4880911a admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.267203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fa1da-bfe7-4b2e-88c1-e7ac4880911a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.267994 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79fa1da-bfe7-4b2e-88c1-e7ac4880911a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.271969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 774/1559] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:11.273334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b051c4b-7020-4651-acc7-e889efd7fd74 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.273619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b051c4b-7020-4651-acc7-e889efd7fd74 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.273895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b051c4b-7020-4651-acc7-e889efd7fd74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.292666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 786/1560] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/users => generated 285 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:11.293470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa1da-bfe7-4b2e-88c1-e7ac4880911a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.301863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7b051c4b-7020-4651-acc7-e889efd7fd74 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:11.303102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7b051c4b-7020-4651-acc7-e889efd7fd74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:11.303459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79fa1da-bfe7-4b2e-88c1-e7ac4880911a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.308014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040713-1e59-4aa4-8d6a-af320238d45a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.308715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040713-1e59-4aa4-8d6a-af320238d45a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.308995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040713-1e59-4aa4-8d6a-af320238d45a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.309273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e040713-1e59-4aa4-8d6a-af320238d45a admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.309925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040713-1e59-4aa4-8d6a-af320238d45a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:11.310354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040713-1e59-4aa4-8d6a-af320238d45a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.311646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 775/1561] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:11.313964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e73970-56cc-403d-aa6d-9219cd173fcc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.314363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e73970-56cc-403d-aa6d-9219cd173fcc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.314843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e73970-56cc-403d-aa6d-9219cd173fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.316591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e040713-1e59-4aa4-8d6a-af320238d45a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.333783 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 787/1562] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:11.334947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040713-1e59-4aa4-8d6a-af320238d45a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.338119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e3e73970-56cc-403d-aa6d-9219cd173fcc None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:11.339596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e3e73970-56cc-403d-aa6d-9219cd173fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:11.345999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e040713-1e59-4aa4-8d6a-af320238d45a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.348774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 776/1563] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:11.349607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e73970-56cc-403d-aa6d-9219cd173fcc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.356010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c4603c-6ee8-4113-b3b4-61aad5e369f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.356668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4603c-6ee8-4113-b3b4-61aad5e369f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.356947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4603c-6ee8-4113-b3b4-61aad5e369f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.357216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c4603c-6ee8-4113-b3b4-61aad5e369f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.357862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4603c-6ee8-4113-b3b4-61aad5e369f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.359343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e73970-56cc-403d-aa6d-9219cd173fcc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.359445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c4603c-6ee8-4113-b3b4-61aad5e369f0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.364432 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17ef3-8538-41ba-833d-9d85f68017b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.365056 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17ef3-8538-41ba-833d-9d85f68017b0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.365349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17ef3-8538-41ba-833d-9d85f68017b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.365627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a17ef3-8538-41ba-833d-9d85f68017b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.366275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a17ef3-8538-41ba-833d-9d85f68017b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.369244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a17ef3-8538-41ba-833d-9d85f68017b0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.370699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 788/1564] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:11.371951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca267c-5dda-4245-b8c6-986e822ab512 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.372264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca267c-5dda-4245-b8c6-986e822ab512 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.372541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ca267c-5dda-4245-b8c6-986e822ab512 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.390509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 777/1565] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:11.390509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17ef3-8538-41ba-833d-9d85f68017b0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.393255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-30ca267c-5dda-4245-b8c6-986e822ab512 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:11.394474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-30ca267c-5dda-4245-b8c6-986e822ab512 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:11.402873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 789/1566] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:11.403050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a17ef3-8538-41ba-833d-9d85f68017b0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.403699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca267c-5dda-4245-b8c6-986e822ab512 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.411610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b68f6f-0b07-4959-8522-7ec662098587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.412274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b68f6f-0b07-4959-8522-7ec662098587 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.412560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b68f6f-0b07-4959-8522-7ec662098587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.412840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b68f6f-0b07-4959-8522-7ec662098587 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.413498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b68f6f-0b07-4959-8522-7ec662098587 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:11.413806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b68f6f-0b07-4959-8522-7ec662098587 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.414203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ca267c-5dda-4245-b8c6-986e822ab512 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.415434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b68f6f-0b07-4959-8522-7ec662098587 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.418924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179f68e-a5b4-489d-af9f-0a6e8a06b2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.419531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179f68e-a5b4-489d-af9f-0a6e8a06b2ff admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.419813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179f68e-a5b4-489d-af9f-0a6e8a06b2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.420113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3179f68e-a5b4-489d-af9f-0a6e8a06b2ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.420770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179f68e-a5b4-489d-af9f-0a6e8a06b2ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.422789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3179f68e-a5b4-489d-af9f-0a6e8a06b2ff admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.428455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 778/1567] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:11.429879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9976-1274-49cc-a675-a8a65a98d5e0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.430259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9976-1274-49cc-a675-a8a65a98d5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.430629 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573f9976-1274-49cc-a675-a8a65a98d5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.441458 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 790/1568] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:11.442299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179f68e-a5b4-489d-af9f-0a6e8a06b2ff admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.451312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-573f9976-1274-49cc-a675-a8a65a98d5e0 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:11.452561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-573f9976-1274-49cc-a675-a8a65a98d5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:11.453176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3179f68e-a5b4-489d-af9f-0a6e8a06b2ff admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.459571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c01f5-79e9-4c2e-8d06-9a035aead4bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.460218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c01f5-79e9-4c2e-8d06-9a035aead4bb admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.460506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c01f5-79e9-4c2e-8d06-9a035aead4bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.460784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953c01f5-79e9-4c2e-8d06-9a035aead4bb admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.461020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 779/1569] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:11.461451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c01f5-79e9-4c2e-8d06-9a035aead4bb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.461938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9976-1274-49cc-a675-a8a65a98d5e0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.463382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953c01f5-79e9-4c2e-8d06-9a035aead4bb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.477396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573f9976-1274-49cc-a675-a8a65a98d5e0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.483905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d859d79-21a1-4bcb-a73b-66ffe2c62848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.484560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859d79-21a1-4bcb-a73b-66ffe2c62848 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.484839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859d79-21a1-4bcb-a73b-66ffe2c62848 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.485112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d859d79-21a1-4bcb-a73b-66ffe2c62848 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.485772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d859d79-21a1-4bcb-a73b-66ffe2c62848 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:11.486075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d859d79-21a1-4bcb-a73b-66ffe2c62848 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.487718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d859d79-21a1-4bcb-a73b-66ffe2c62848 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.500756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 780/1570] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:11.503243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 791/1571] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/projects => generated 385 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:11.505168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c01f5-79e9-4c2e-8d06-9a035aead4bb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.505320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d859d79-21a1-4bcb-a73b-66ffe2c62848 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.517208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d859d79-21a1-4bcb-a73b-66ffe2c62848 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.582204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5b50-6229-4705-89e4-36d44e021e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.583170 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5b50-6229-4705-89e4-36d44e021e23 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.583587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5b50-6229-4705-89e4-36d44e021e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.583976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666b5b50-6229-4705-89e4-36d44e021e23 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.584828 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953c01f5-79e9-4c2e-8d06-9a035aead4bb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.585452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b5b50-6229-4705-89e4-36d44e021e23 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.586908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666b5b50-6229-4705-89e4-36d44e021e23 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.590056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52cbc2-c9e9-48ca-92b5-16fdab672903 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.590680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52cbc2-c9e9-48ca-92b5-16fdab672903 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.591109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52cbc2-c9e9-48ca-92b5-16fdab672903 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.591391 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d52cbc2-c9e9-48ca-92b5-16fdab672903 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.592040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52cbc2-c9e9-48ca-92b5-16fdab672903 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.593708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d52cbc2-c9e9-48ca-92b5-16fdab672903 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.597829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 781/1572] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:11.601565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5b50-6229-4705-89e4-36d44e021e23 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.604533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 792/1573] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:11.605218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52cbc2-c9e9-48ca-92b5-16fdab672903 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.615720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666b5b50-6229-4705-89e4-36d44e021e23 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.616991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d52cbc2-c9e9-48ca-92b5-16fdab672903 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.622171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b813811-7962-4527-8d46-5761b7a49594 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.622383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4715-331a-4a78-b9ce-62a33cdaceb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.622829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4715-331a-4a78-b9ce-62a33cdaceb3 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.622933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b813811-7962-4527-8d46-5761b7a49594 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.623163 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4715-331a-4a78-b9ce-62a33cdaceb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.623273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b813811-7962-4527-8d46-5761b7a49594 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.623377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bac4715-331a-4a78-b9ce-62a33cdaceb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.623513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b813811-7962-4527-8d46-5761b7a49594 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.623978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac4715-331a-4a78-b9ce-62a33cdaceb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.624384 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b813811-7962-4527-8d46-5761b7a49594 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:11.624825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b813811-7962-4527-8d46-5761b7a49594 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.625899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bac4715-331a-4a78-b9ce-62a33cdaceb3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.626681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b813811-7962-4527-8d46-5761b7a49594 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.640283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 782/1574] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:11.641201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b813811-7962-4527-8d46-5761b7a49594 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.656586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b813811-7962-4527-8d46-5761b7a49594 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.664319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 793/1575] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/projects => generated 393 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:11.664319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4715-331a-4a78-b9ce-62a33cdaceb3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.666523 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf83f-07f5-46d7-872a-18a1363efe5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.667143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf83f-07f5-46d7-872a-18a1363efe5c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.667425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf83f-07f5-46d7-872a-18a1363efe5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.667696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63adf83f-07f5-46d7-872a-18a1363efe5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.669548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adf83f-07f5-46d7-872a-18a1363efe5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.670033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63adf83f-07f5-46d7-872a-18a1363efe5c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.680809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 783/1576] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:11.681766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf83f-07f5-46d7-872a-18a1363efe5c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.693066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63adf83f-07f5-46d7-872a-18a1363efe5c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.720719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:11.734721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bac4715-331a-4a78-b9ce-62a33cdaceb3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.739811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8142b-663c-4586-bd76-4e92ee398b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.740474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8142b-663c-4586-bd76-4e92ee398b91 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.740755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8142b-663c-4586-bd76-4e92ee398b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.741024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b8142b-663c-4586-bd76-4e92ee398b91 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.741667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8142b-663c-4586-bd76-4e92ee398b91 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:11.741970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8142b-663c-4586-bd76-4e92ee398b91 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.743565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b8142b-663c-4586-bd76-4e92ee398b91 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.756057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779c9ec-8534-404f-ac8a-6a68af9480d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.756705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779c9ec-8534-404f-ac8a-6a68af9480d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.756982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779c9ec-8534-404f-ac8a-6a68af9480d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.757254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5779c9ec-8534-404f-ac8a-6a68af9480d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.757972 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779c9ec-8534-404f-ac8a-6a68af9480d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.759932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5779c9ec-8534-404f-ac8a-6a68af9480d2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.760123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 794/1577] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:11.761017 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8142b-663c-4586-bd76-4e92ee398b91 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.772239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b8142b-663c-4586-bd76-4e92ee398b91 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.779172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613a9d7-864a-4a64-9037-d636a4076962 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.780265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613a9d7-864a-4a64-9037-d636a4076962 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.780896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613a9d7-864a-4a64-9037-d636a4076962 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.781166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d613a9d7-864a-4a64-9037-d636a4076962 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.781814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613a9d7-864a-4a64-9037-d636a4076962 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.783722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d613a9d7-864a-4a64-9037-d636a4076962 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.785439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 784/1578] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/users => generated 293 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:11.786433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779c9ec-8534-404f-ac8a-6a68af9480d2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.792642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:11.796948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5779c9ec-8534-404f-ac8a-6a68af9480d2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.803573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824940-a950-4cd4-a57e-e04c18c0888b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.804832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824940-a950-4cd4-a57e-e04c18c0888b admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.805178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824940-a950-4cd4-a57e-e04c18c0888b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.805458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5824940-a950-4cd4-a57e-e04c18c0888b admin admin] PATH_INFO: `/v3/projects/46d40f3eea3b4ffb8b8720ffd6348975/users/40f99377b0134e59802907c55b1c6949/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.817682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 795/1579] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/projects => generated 385 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:11.818582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613a9d7-864a-4a64-9037-d636a4076962 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.822470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5824940-a950-4cd4-a57e-e04c18c0888b admin admin] RBAC: Authorizing `identity:create_grant(project_id=46d40f3eea3b4ffb8b8720ffd6348975, user_id=40f99377b0134e59802907c55b1c6949, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.823551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-f5824940-a950-4cd4-a57e-e04c18c0888b admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:26:11.823551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 24 14:26:11.823551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: Sep 24 14:26:11.826351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5824940-a950-4cd4-a57e-e04c18c0888b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.840270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 785/1580] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:11 2022] PUT /identity/v3/projects/46d40f3eea3b4ffb8b8720ffd6348975/users/40f99377b0134e59802907c55b1c6949/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:11.841184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824940-a950-4cd4-a57e-e04c18c0888b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.893973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d613a9d7-864a-4a64-9037-d636a4076962 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.908570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5824940-a950-4cd4-a57e-e04c18c0888b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:11.913852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f774659-7412-4b9d-a3c6-b04e8a06ae83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.914469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774659-7412-4b9d-a3c6-b04e8a06ae83 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.914769 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774659-7412-4b9d-a3c6-b04e8a06ae83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.915041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f774659-7412-4b9d-a3c6-b04e8a06ae83 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.915671 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f774659-7412-4b9d-a3c6-b04e8a06ae83 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.917610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f774659-7412-4b9d-a3c6-b04e8a06ae83 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:11.951792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 786/1581] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/projects => generated 375 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:11.952931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f774659-7412-4b9d-a3c6-b04e8a06ae83 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:11.966283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04b5ff-51b6-4cbc-8b5a-6832c31efa5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:11.966952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04b5ff-51b6-4cbc-8b5a-6832c31efa5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:11.967233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04b5ff-51b6-4cbc-8b5a-6832c31efa5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:11.967508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b04b5ff-51b6-4cbc-8b5a-6832c31efa5d admin admin] PATH_INFO: `/v3/projects/25b1e904a81f4cb486fef84824fd0d21/users/4b71c204c520467bb20549437560f1e6/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:11.983093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04b5ff-51b6-4cbc-8b5a-6832c31efa5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=25b1e904a81f4cb486fef84824fd0d21, user_id=4b71c204c520467bb20549437560f1e6, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:11.985971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b04b5ff-51b6-4cbc-8b5a-6832c31efa5d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.008144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 796/1582] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:11 2022] PUT /identity/v3/projects/25b1e904a81f4cb486fef84824fd0d21/users/4b71c204c520467bb20549437560f1e6/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:12.008144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04b5ff-51b6-4cbc-8b5a-6832c31efa5d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.026522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f774659-7412-4b9d-a3c6-b04e8a06ae83 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.078060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:12.084305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b04b5ff-51b6-4cbc-8b5a-6832c31efa5d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.092252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc65f7-8187-4cea-b3ce-d66d51c7e861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.092820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc65f7-8187-4cea-b3ce-d66d51c7e861 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.093097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc65f7-8187-4cea-b3ce-d66d51c7e861 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.093370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cc65f7-8187-4cea-b3ce-d66d51c7e861 admin admin] PATH_INFO: `/v3/projects/f09201ad76b1445c9ffb48deb1418b38/users/51b416aed03e4c35b93e8edf2821a89f/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.095940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03cdba-b984-448a-9913-dbecd4eef754 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.096587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03cdba-b984-448a-9913-dbecd4eef754 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.096866 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03cdba-b984-448a-9913-dbecd4eef754 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.097140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d03cdba-b984-448a-9913-dbecd4eef754 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.097810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03cdba-b984-448a-9913-dbecd4eef754 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.099724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d03cdba-b984-448a-9913-dbecd4eef754 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.109477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc65f7-8187-4cea-b3ce-d66d51c7e861 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f09201ad76b1445c9ffb48deb1418b38, user_id=51b416aed03e4c35b93e8edf2821a89f, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.112107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36cc65f7-8187-4cea-b3ce-d66d51c7e861 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.122755 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 787/1583] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:11 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:12.123633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03cdba-b984-448a-9913-dbecd4eef754 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.128515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:12.130288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 797/1584] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:12 2022] PUT /identity/v3/projects/f09201ad76b1445c9ffb48deb1418b38/users/51b416aed03e4c35b93e8edf2821a89f/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:12.131210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc65f7-8187-4cea-b3ce-d66d51c7e861 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.137281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d03cdba-b984-448a-9913-dbecd4eef754 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.193072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cc65f7-8187-4cea-b3ce-d66d51c7e861 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.196961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4bb9d6-ca1c-446a-bbb8-52f5a87eefff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.197572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bb9d6-ca1c-446a-bbb8-52f5a87eefff admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.197845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bb9d6-ca1c-446a-bbb8-52f5a87eefff admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.197953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761f7e1-96e4-4977-bc0a-220ba19cc2c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.198115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4bb9d6-ca1c-446a-bbb8-52f5a87eefff admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.198516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761f7e1-96e4-4977-bc0a-220ba19cc2c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.198744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bb9d6-ca1c-446a-bbb8-52f5a87eefff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.198919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761f7e1-96e4-4977-bc0a-220ba19cc2c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.199134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0761f7e1-96e4-4977-bc0a-220ba19cc2c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.199791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761f7e1-96e4-4977-bc0a-220ba19cc2c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.200740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4bb9d6-ca1c-446a-bbb8-52f5a87eefff admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.201444 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0761f7e1-96e4-4977-bc0a-220ba19cc2c2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.211269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 798/1585] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:12.212049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761f7e1-96e4-4977-bc0a-220ba19cc2c2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.222936 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0761f7e1-96e4-4977-bc0a-220ba19cc2c2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.228236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfd11-2ad6-4617-9a0e-db8fb01737bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.228938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfd11-2ad6-4617-9a0e-db8fb01737bb admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.229261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 788/1586] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:12 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:12.229396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfd11-2ad6-4617-9a0e-db8fb01737bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.229760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bbfd11-2ad6-4617-9a0e-db8fb01737bb admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.231222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c465a6-00d5-4abd-a474-5689f48c6f35 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.231354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbfd11-2ad6-4617-9a0e-db8fb01737bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.231465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c465a6-00d5-4abd-a474-5689f48c6f35 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.231586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c465a6-00d5-4abd-a474-5689f48c6f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.233500 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bbfd11-2ad6-4617-9a0e-db8fb01737bb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.251651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-98c465a6-00d5-4abd-a474-5689f48c6f35 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:12.252897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-98c465a6-00d5-4abd-a474-5689f48c6f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:12.256331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 799/1587] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:12 2022] POST /identity/v3/users => generated 293 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:12.257537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfd11-2ad6-4617-9a0e-db8fb01737bb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.267431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bbfd11-2ad6-4617-9a0e-db8fb01737bb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.323220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 789/1588] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:12.325519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893b282-eccf-4843-8fa1-3e72ecadfd5f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.326126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893b282-eccf-4843-8fa1-3e72ecadfd5f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.326583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6893b282-eccf-4843-8fa1-3e72ecadfd5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.336470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878ae1d-01f0-4ccf-95c5-143238311757 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.337119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878ae1d-01f0-4ccf-95c5-143238311757 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.337397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878ae1d-01f0-4ccf-95c5-143238311757 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.337669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7878ae1d-01f0-4ccf-95c5-143238311757 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.338304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878ae1d-01f0-4ccf-95c5-143238311757 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.341079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7878ae1d-01f0-4ccf-95c5-143238311757 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.358465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6893b282-eccf-4843-8fa1-3e72ecadfd5f None None] MFA Rules not processed for user `4b71c204c520467bb20549437560f1e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:12.359682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6893b282-eccf-4843-8fa1-3e72ecadfd5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:12.364791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 800/1589] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:12 2022] POST /identity/v3/users => generated 288 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:12.368802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878ae1d-01f0-4ccf-95c5-143238311757 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.380055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7878ae1d-01f0-4ccf-95c5-143238311757 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.384818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5c6d52-751c-4ffe-9a34-f8af6365741d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.385463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6d52-751c-4ffe-9a34-f8af6365741d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.385867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6d52-751c-4ffe-9a34-f8af6365741d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.386213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5c6d52-751c-4ffe-9a34-f8af6365741d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.386927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c6d52-751c-4ffe-9a34-f8af6365741d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.388596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c5c6d52-751c-4ffe-9a34-f8af6365741d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.399227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 801/1590] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:12.400278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c384c-6c79-4e58-a1b5-c515411e3136 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.400565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c384c-6c79-4e58-a1b5-c515411e3136 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.400842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942c384c-6c79-4e58-a1b5-c515411e3136 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.437838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-942c384c-6c79-4e58-a1b5-c515411e3136 None None] MFA Rules not processed for user `51b416aed03e4c35b93e8edf2821a89f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:12.441876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 790/1591] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:12.442098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-942c384c-6c79-4e58-a1b5-c515411e3136 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:12.442734 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893b282-eccf-4843-8fa1-3e72ecadfd5f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.456312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6893b282-eccf-4843-8fa1-3e72ecadfd5f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.461422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc1f6-86c7-43b4-939b-f0db568ebf72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.462034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc1f6-86c7-43b4-939b-f0db568ebf72 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.462314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc1f6-86c7-43b4-939b-f0db568ebf72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.462592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-836fc1f6-86c7-43b4-939b-f0db568ebf72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.463298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fc1f6-86c7-43b4-939b-f0db568ebf72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.465951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-836fc1f6-86c7-43b4-939b-f0db568ebf72 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.472455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:12.481997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 791/1592] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:12.481997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc1f6-86c7-43b4-939b-f0db568ebf72 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.491542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-836fc1f6-86c7-43b4-939b-f0db568ebf72 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.496201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb6e5b-f175-4da0-9f9c-84e6e60918cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.496805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb6e5b-f175-4da0-9f9c-84e6e60918cd admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.497098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb6e5b-f175-4da0-9f9c-84e6e60918cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.497532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edfb6e5b-f175-4da0-9f9c-84e6e60918cd admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.498164 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb6e5b-f175-4da0-9f9c-84e6e60918cd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.500092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edfb6e5b-f175-4da0-9f9c-84e6e60918cd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.508454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:12.523010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 792/1593] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:12 2022] POST /identity/v3/users => generated 288 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:12.528112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb6e5b-f175-4da0-9f9c-84e6e60918cd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.528304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 802/1594] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:12 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:12.528304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c384c-6c79-4e58-a1b5-c515411e3136 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.537236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edfb6e5b-f175-4da0-9f9c-84e6e60918cd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.541938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28af0f-e410-4520-839c-dd0376936185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.542538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28af0f-e410-4520-839c-dd0376936185 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.542840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28af0f-e410-4520-839c-dd0376936185 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.543752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae28af0f-e410-4520-839c-dd0376936185 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.544426 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28af0f-e410-4520-839c-dd0376936185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.546647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae28af0f-e410-4520-839c-dd0376936185 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.558067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 793/1595] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:12.558945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28af0f-e410-4520-839c-dd0376936185 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.568512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae28af0f-e410-4520-839c-dd0376936185 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.573299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7b663-ccf5-4d3f-8dde-6df74c770aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.573886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7b663-ccf5-4d3f-8dde-6df74c770aba admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.574201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7b663-ccf5-4d3f-8dde-6df74c770aba admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.574478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f7b663-ccf5-4d3f-8dde-6df74c770aba admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.575127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7b663-ccf5-4d3f-8dde-6df74c770aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.576737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f7b663-ccf5-4d3f-8dde-6df74c770aba admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.582088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942c384c-6c79-4e58-a1b5-c515411e3136 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.585861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62b950-7e61-49b9-bc13-93a025223a82 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.586462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62b950-7e61-49b9-bc13-93a025223a82 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.586739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62b950-7e61-49b9-bc13-93a025223a82 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.587013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d62b950-7e61-49b9-bc13-93a025223a82 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.591028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 794/1596] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:12.591028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7b663-ccf5-4d3f-8dde-6df74c770aba admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.598033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f7b663-ccf5-4d3f-8dde-6df74c770aba admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.600563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62b950-7e61-49b9-bc13-93a025223a82 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.602050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d62b950-7e61-49b9-bc13-93a025223a82 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.602663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b090a-d900-44b4-a913-261469a647d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.603237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b090a-d900-44b4-a913-261469a647d4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.603516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b090a-d900-44b4-a913-261469a647d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.603793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-348b090a-d900-44b4-a913-261469a647d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.604445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b090a-d900-44b4-a913-261469a647d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.606604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-348b090a-d900-44b4-a913-261469a647d4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.612519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 803/1597] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:12.613447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62b950-7e61-49b9-bc13-93a025223a82 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.616832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 795/1598] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:12.617463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b090a-d900-44b4-a913-261469a647d4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.627204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-348b090a-d900-44b4-a913-261469a647d4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.632544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64305a-89dd-4cdc-9820-aff9af4366fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.633298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64305a-89dd-4cdc-9820-aff9af4366fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.633586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64305a-89dd-4cdc-9820-aff9af4366fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.633911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b64305a-89dd-4cdc-9820-aff9af4366fd admin admin] PATH_INFO: `/v3/projects/50558a555112422aa524ccc099ebbadc/users/5a3a7f87ef4349eb9b21745be3a6b8ea/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.651760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64305a-89dd-4cdc-9820-aff9af4366fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=50558a555112422aa524ccc099ebbadc, user_id=5a3a7f87ef4349eb9b21745be3a6b8ea, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.655153 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b64305a-89dd-4cdc-9820-aff9af4366fd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.671812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 796/1599] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:12 2022] PUT /identity/v3/projects/50558a555112422aa524ccc099ebbadc/users/5a3a7f87ef4349eb9b21745be3a6b8ea/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:12.676412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64305a-89dd-4cdc-9820-aff9af4366fd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.681385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d62b950-7e61-49b9-bc13-93a025223a82 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.753291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8ea06-7eb3-4594-b469-7a11abf60c65 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.754198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8ea06-7eb3-4594-b469-7a11abf60c65 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.754933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8ea06-7eb3-4594-b469-7a11abf60c65 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.755433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c8ea06-7eb3-4594-b469-7a11abf60c65 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.769765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b64305a-89dd-4cdc-9820-aff9af4366fd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.778856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4acdec-6f98-42b7-89e5-de548416e274 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.779723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4acdec-6f98-42b7-89e5-de548416e274 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.780013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4acdec-6f98-42b7-89e5-de548416e274 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.780324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4acdec-6f98-42b7-89e5-de548416e274 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.781411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4acdec-6f98-42b7-89e5-de548416e274 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.783074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4acdec-6f98-42b7-89e5-de548416e274 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.795327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 797/1600] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:12.796272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4acdec-6f98-42b7-89e5-de548416e274 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.808999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4acdec-6f98-42b7-89e5-de548416e274 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.819912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53863406-7dc3-4663-b804-b0c02bb9d80e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.820143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:12.820803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53863406-7dc3-4663-b804-b0c02bb9d80e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.821025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53863406-7dc3-4663-b804-b0c02bb9d80e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.821739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53863406-7dc3-4663-b804-b0c02bb9d80e admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.821990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53863406-7dc3-4663-b804-b0c02bb9d80e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.824560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53863406-7dc3-4663-b804-b0c02bb9d80e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.852304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8ea06-7eb3-4594-b469-7a11abf60c65 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.854551 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3c8ea06-7eb3-4594-b469-7a11abf60c65 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.864901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 798/1601] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:12 2022] POST /identity/v3/projects => generated 367 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:12.864901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53863406-7dc3-4663-b804-b0c02bb9d80e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.871426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 804/1602] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:12.882799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8ea06-7eb3-4594-b469-7a11abf60c65 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.912840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c8ea06-7eb3-4594-b469-7a11abf60c65 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.960556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53863406-7dc3-4663-b804-b0c02bb9d80e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:12.973810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca1e54-cb6c-4aa8-a93b-f2428b9ea85a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.974727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca1e54-cb6c-4aa8-a93b-f2428b9ea85a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.975012 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca1e54-cb6c-4aa8-a93b-f2428b9ea85a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.975281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ca1e54-cb6c-4aa8-a93b-f2428b9ea85a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.975932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca1e54-cb6c-4aa8-a93b-f2428b9ea85a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:12.977848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ca1e54-cb6c-4aa8-a93b-f2428b9ea85a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:12.993584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 799/1603] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:12.993584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca1e54-cb6c-4aa8-a93b-f2428b9ea85a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:12.996776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42b2fb-4594-4476-a7c8-c28c72e112a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:12.998159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42b2fb-4594-4476-a7c8-c28c72e112a4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:12.998530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42b2fb-4594-4476-a7c8-c28c72e112a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:12.998934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42b2fb-4594-4476-a7c8-c28c72e112a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:12.999649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42b2fb-4594-4476-a7c8-c28c72e112a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:13.001357 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42b2fb-4594-4476-a7c8-c28c72e112a4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:13.003284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:13.012963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ca1e54-cb6c-4aa8-a93b-f2428b9ea85a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:13.016884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 805/1604] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:12 2022] GET /identity/v3/roles => generated 1420 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:13.016884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581a939-8fb6-4d6d-8b7a-21ceda89fba1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.016884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581a939-8fb6-4d6d-8b7a-21ceda89fba1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.016884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b581a939-8fb6-4d6d-8b7a-21ceda89fba1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.036027 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9da4c1-f4d8-4f1b-98f8-ac62a224f56b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:13.036748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da4c1-f4d8-4f1b-98f8-ac62a224f56b admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.037223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da4c1-f4d8-4f1b-98f8-ac62a224f56b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.037484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9da4c1-f4d8-4f1b-98f8-ac62a224f56b admin admin] PATH_INFO: `/v3/projects/c53f86a15d924963b0dd3f78acc462fb/users/da78d19e83fe41a99ae64d52d2d10d8a/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.046135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b581a939-8fb6-4d6d-8b7a-21ceda89fba1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:13.050707 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b581a939-8fb6-4d6d-8b7a-21ceda89fba1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:13.065039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9da4c1-f4d8-4f1b-98f8-ac62a224f56b admin admin] RBAC: Authorizing `identity:create_grant(project_id=c53f86a15d924963b0dd3f78acc462fb, user_id=da78d19e83fe41a99ae64d52d2d10d8a, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:13.068226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9da4c1-f4d8-4f1b-98f8-ac62a224f56b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:13.069083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 806/1605] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:13.069961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581a939-8fb6-4d6d-8b7a-21ceda89fba1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:13.100843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 800/1606] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:12 2022] PUT /identity/v3/projects/c53f86a15d924963b0dd3f78acc462fb/users/da78d19e83fe41a99ae64d52d2d10d8a/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:13.102075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9da4c1-f4d8-4f1b-98f8-ac62a224f56b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:13.103039 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b581a939-8fb6-4d6d-8b7a-21ceda89fba1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:13.196497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9da4c1-f4d8-4f1b-98f8-ac62a224f56b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:13.197997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60fa27-2693-4134-bc6d-4fa7d203eac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:13.200320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60fa27-2693-4134-bc6d-4fa7d203eac1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.201423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60fa27-2693-4134-bc6d-4fa7d203eac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.202325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60fa27-2693-4134-bc6d-4fa7d203eac1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.203410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71f555-1d68-4ae6-b205-2644c046c3fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:13.204130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71f555-1d68-4ae6-b205-2644c046c3fa admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.204641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60fa27-2693-4134-bc6d-4fa7d203eac1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:13.204830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71f555-1d68-4ae6-b205-2644c046c3fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.205215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71f555-1d68-4ae6-b205-2644c046c3fa admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.205931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71f555-1d68-4ae6-b205-2644c046c3fa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:13.208594 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e71f555-1d68-4ae6-b205-2644c046c3fa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:13.209669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa60fa27-2693-4134-bc6d-4fa7d203eac1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:13.233870 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 807/1607] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:13.235242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60fa27-2693-4134-bc6d-4fa7d203eac1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:13.241602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 801/1608] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:13 2022] POST /identity/v3/users => generated 290 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:13.242849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71f555-1d68-4ae6-b205-2644c046c3fa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:13.257964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60fa27-2693-4134-bc6d-4fa7d203eac1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:13.259135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71f555-1d68-4ae6-b205-2644c046c3fa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:13.264360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2d06e-0638-44ef-b5be-85324eb0b338 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:13.265049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a181c08-7d4d-48b6-9ff3-25e06bb32b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:13.265331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2d06e-0638-44ef-b5be-85324eb0b338 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.265738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2d06e-0638-44ef-b5be-85324eb0b338 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.265864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a181c08-7d4d-48b6-9ff3-25e06bb32b9d admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.266181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a181c08-7d4d-48b6-9ff3-25e06bb32b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.266310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f2d06e-0638-44ef-b5be-85324eb0b338 admin admin] PATH_INFO: `/v3/projects/7ec610a542c144be8c59b3184bb9f739/users/9bb095bd274846a49d6eeb52beafac90/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.266462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a181c08-7d4d-48b6-9ff3-25e06bb32b9d admin admin] PATH_INFO: `/v3/projects/3856a0fad62e49da915a255b7b4265c9/users/b790a83a93cb4c6cb34519267bc60795/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.286959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2d06e-0638-44ef-b5be-85324eb0b338 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ec610a542c144be8c59b3184bb9f739, user_id=9bb095bd274846a49d6eeb52beafac90, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:13.287320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a181c08-7d4d-48b6-9ff3-25e06bb32b9d admin admin] RBAC: Authorizing `identity:create_grant(project_id=3856a0fad62e49da915a255b7b4265c9, user_id=b790a83a93cb4c6cb34519267bc60795, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:13.290486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f2d06e-0638-44ef-b5be-85324eb0b338 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:13.292118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a181c08-7d4d-48b6-9ff3-25e06bb32b9d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:13.308179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 808/1609] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:13 2022] PUT /identity/v3/projects/7ec610a542c144be8c59b3184bb9f739/users/9bb095bd274846a49d6eeb52beafac90/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:13.309845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2d06e-0638-44ef-b5be-85324eb0b338 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:13.322945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 802/1610] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:13 2022] PUT /identity/v3/projects/3856a0fad62e49da915a255b7b4265c9/users/b790a83a93cb4c6cb34519267bc60795/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:13.327250 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e401e-0c35-4e27-8220-b2626f54b857 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.327250 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e401e-0c35-4e27-8220-b2626f54b857 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.327559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514e401e-0c35-4e27-8220-b2626f54b857 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.355988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-514e401e-0c35-4e27-8220-b2626f54b857 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:13.357209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-514e401e-0c35-4e27-8220-b2626f54b857 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:13.393315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:13.410802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f2d06e-0638-44ef-b5be-85324eb0b338 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:13.478770 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 803/1611] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:13.479918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e401e-0c35-4e27-8220-b2626f54b857 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:13.494846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e232dd-1c11-4d48-a5ae-e8fc395bc8c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:13.497414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e232dd-1c11-4d48-a5ae-e8fc395bc8c6 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.497965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e232dd-1c11-4d48-a5ae-e8fc395bc8c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.498246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e232dd-1c11-4d48-a5ae-e8fc395bc8c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.498675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514e401e-0c35-4e27-8220-b2626f54b857 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:13.504234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b40b407-6b37-49a5-bf50-94bff9d88f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:13.505029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b407-6b37-49a5-bf50-94bff9d88f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.505405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b407-6b37-49a5-bf50-94bff9d88f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.505780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b40b407-6b37-49a5-bf50-94bff9d88f6f admin admin] PATH_INFO: `/v3/projects/5f26cb8267d84f15ae98eead0657aea4/users/e1fcaec552f7441f941b6c1bd6b5bdac/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.513671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e232dd-1c11-4d48-a5ae-e8fc395bc8c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:13.526496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40b407-6b37-49a5-bf50-94bff9d88f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f26cb8267d84f15ae98eead0657aea4, user_id=e1fcaec552f7441f941b6c1bd6b5bdac, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:13.527009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e232dd-1c11-4d48-a5ae-e8fc395bc8c6 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:13.529766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b40b407-6b37-49a5-bf50-94bff9d88f6f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:13.540961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 809/1612] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:13.541880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e232dd-1c11-4d48-a5ae-e8fc395bc8c6 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:13.557054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e232dd-1c11-4d48-a5ae-e8fc395bc8c6 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:13.562649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-634da590-4258-4c1a-9f8b-853c618e8011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:13.563261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634da590-4258-4c1a-9f8b-853c618e8011 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.563691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634da590-4258-4c1a-9f8b-853c618e8011 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.563973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-634da590-4258-4c1a-9f8b-853c618e8011 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.564680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634da590-4258-4c1a-9f8b-853c618e8011 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:13.566556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-634da590-4258-4c1a-9f8b-853c618e8011 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:13.578069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 810/1613] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:13 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:13.579494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae030be-fe84-4b13-bc32-a6dc55c77f0b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.579784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae030be-fe84-4b13-bc32-a6dc55c77f0b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.580065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae030be-fe84-4b13-bc32-a6dc55c77f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.590337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 804/1614] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:13 2022] PUT /identity/v3/projects/5f26cb8267d84f15ae98eead0657aea4/users/e1fcaec552f7441f941b6c1bd6b5bdac/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:13.606166 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ad46-d9e8-4d7f-b5a6-a2c3e69ca4f8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.609078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ad46-d9e8-4d7f-b5a6-a2c3e69ca4f8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.611108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac2ad46-d9e8-4d7f-b5a6-a2c3e69ca4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.624050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-aae030be-fe84-4b13-bc32-a6dc55c77f0b None None] MFA Rules not processed for user `9bb095bd274846a49d6eeb52beafac90`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:13.625674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aae030be-fe84-4b13-bc32-a6dc55c77f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:13.659143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9ac2ad46-d9e8-4d7f-b5a6-a2c3e69ca4f8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:13.665382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9ac2ad46-d9e8-4d7f-b5a6-a2c3e69ca4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:13.719454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:13.799418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 811/1615] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:13.799418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae030be-fe84-4b13-bc32-a6dc55c77f0b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:13.835526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 805/1616] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:13.839112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2ad46-d9e8-4d7f-b5a6-a2c3e69ca4f8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:13.883933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac2ad46-d9e8-4d7f-b5a6-a2c3e69ca4f8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:13.901414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3529267-d725-4a30-814a-3e9123054bfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:13.904416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3529267-d725-4a30-814a-3e9123054bfd admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.905982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3529267-d725-4a30-814a-3e9123054bfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.908575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3529267-d725-4a30-814a-3e9123054bfd admin admin] PATH_INFO: `/v3/projects/d709e464dab746a3ac800463fa620423/users/94f7a9279d044a64bdd6a3ea129464c8/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:13.954508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3529267-d725-4a30-814a-3e9123054bfd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d709e464dab746a3ac800463fa620423, user_id=94f7a9279d044a64bdd6a3ea129464c8, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:13.963748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3529267-d725-4a30-814a-3e9123054bfd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:13.992702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 806/1617] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:13 2022] PUT /identity/v3/projects/d709e464dab746a3ac800463fa620423/users/94f7a9279d044a64bdd6a3ea129464c8/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:13.993728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae030be-fe84-4b13-bc32-a6dc55c77f0b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:13.995002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fa330-4446-4491-a3ea-efdabb283fe8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:13.995431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fa330-4446-4491-a3ea-efdabb283fe8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:13.995545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636fa330-4446-4491-a3ea-efdabb283fe8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.042112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-636fa330-4446-4491-a3ea-efdabb283fe8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:14.043428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-636fa330-4446-4491-a3ea-efdabb283fe8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:14.062687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:14.113072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2165ea5-1e9f-496c-be6b-53b8e22d32ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:14.115917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2165ea5-1e9f-496c-be6b-53b8e22d32ed service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:14.116423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2165ea5-1e9f-496c-be6b-53b8e22d32ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:14.117315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2165ea5-1e9f-496c-be6b-53b8e22d32ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.176739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 807/1618] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:14.179384 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30534926-2eca-4e61-a9e0-42c9c616ed00 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:14.179734 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30534926-2eca-4e61-a9e0-42c9c616ed00 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:14.180033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30534926-2eca-4e61-a9e0-42c9c616ed00 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.186976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 808/1619] 10.222.0.16 () {54 vars in 961 bytes} [Sat Sep 24 14:26:14 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:26:14.187868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30534926-2eca-4e61-a9e0-42c9c616ed00 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:14.215905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30534926-2eca-4e61-a9e0-42c9c616ed00 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:14.224193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78abac-6d45-45a4-b9c5-88a602ec4ece service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:14.224818 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78abac-6d45-45a4-b9c5-88a602ec4ece service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:14.225111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78abac-6d45-45a4-b9c5-88a602ec4ece service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:14.225373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf78abac-6d45-45a4-b9c5-88a602ec4ece service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.244487 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78abac-6d45-45a4-b9c5-88a602ec4ece service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:14.246803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf78abac-6d45-45a4-b9c5-88a602ec4ece service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:14.259109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2165ea5-1e9f-496c-be6b-53b8e22d32ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:14.260631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 809/1620] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:14.260992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2165ea5-1e9f-496c-be6b-53b8e22d32ed service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:14.261146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78abac-6d45-45a4-b9c5-88a602ec4ece service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:14.271898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf78abac-6d45-45a4-b9c5-88a602ec4ece service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:14.280198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 812/1621] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:14.282779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ae173-c687-49df-b91b-1a5efdb4d2fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:14.283605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e433069-739c-4bbd-b784-4a164dcadcef None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:14.283799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ae173-c687-49df-b91b-1a5efdb4d2fa admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:14.284044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e433069-739c-4bbd-b784-4a164dcadcef None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:14.284206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ae173-c687-49df-b91b-1a5efdb4d2fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:14.284404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02ae173-c687-49df-b91b-1a5efdb4d2fa admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.284526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e433069-739c-4bbd-b784-4a164dcadcef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.285065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ae173-c687-49df-b91b-1a5efdb4d2fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:14.289156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02ae173-c687-49df-b91b-1a5efdb4d2fa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:14.315923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 810/1622] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:14 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:14.317226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ae173-c687-49df-b91b-1a5efdb4d2fa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:14.344212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02ae173-c687-49df-b91b-1a5efdb4d2fa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:14.356449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9ee15-eab6-4ecb-8c00-7303f1edc737 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:14.357186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9ee15-eab6-4ecb-8c00-7303f1edc737 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:14.357523 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9ee15-eab6-4ecb-8c00-7303f1edc737 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:14.357834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e9ee15-eab6-4ecb-8c00-7303f1edc737 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.363243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9e433069-739c-4bbd-b784-4a164dcadcef None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:14.365218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9e433069-739c-4bbd-b784-4a164dcadcef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:14.384425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9ee15-eab6-4ecb-8c00-7303f1edc737 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:14.386114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e9ee15-eab6-4ecb-8c00-7303f1edc737 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:14.409985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 811/1623] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:14.410846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9ee15-eab6-4ecb-8c00-7303f1edc737 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:14.428900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e9ee15-eab6-4ecb-8c00-7303f1edc737 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:14.441619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fddda0-f8fb-4325-a364-eca17c90eb43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:14.442514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fddda0-f8fb-4325-a364-eca17c90eb43 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:14.442632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fddda0-f8fb-4325-a364-eca17c90eb43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:14.442838 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fddda0-f8fb-4325-a364-eca17c90eb43 admin admin] PATH_INFO: `/v3/projects/d709e464dab746a3ac800463fa620423/users/94f7a9279d044a64bdd6a3ea129464c8/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.450157 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fddda0-f8fb-4325-a364-eca17c90eb43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d709e464dab746a3ac800463fa620423, user_id=94f7a9279d044a64bdd6a3ea129464c8, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:14.453281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fddda0-f8fb-4325-a364-eca17c90eb43 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:14.492485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 812/1624] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:14 2022] PUT /identity/v3/projects/d709e464dab746a3ac800463fa620423/users/94f7a9279d044a64bdd6a3ea129464c8/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:14.503206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fb1be-6c6e-46a3-b03f-d33b5498b30d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:14.503569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fb1be-6c6e-46a3-b03f-d33b5498b30d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:14.503785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e66fb1be-6c6e-46a3-b03f-d33b5498b30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.518623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 813/1625] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Sep 24 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:14.531061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e433069-739c-4bbd-b784-4a164dcadcef None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:14.543512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e66fb1be-6c6e-46a3-b03f-d33b5498b30d None None] MFA Rules not processed for user `94f7a9279d044a64bdd6a3ea129464c8`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:14.547065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e66fb1be-6c6e-46a3-b03f-d33b5498b30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:14.547337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e433069-739c-4bbd-b784-4a164dcadcef None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:14.635306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:14.686081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:14.700643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d3d49-4cb3-4370-913d-9ff1cd4bfced service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:14.701384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d3d49-4cb3-4370-913d-9ff1cd4bfced service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:14.701864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d3d49-4cb3-4370-913d-9ff1cd4bfced service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:14.702210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d3d49-4cb3-4370-913d-9ff1cd4bfced service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.706752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 813/1626] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:14 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:14.719895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fb1be-6c6e-46a3-b03f-d33b5498b30d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:14.841865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e66fb1be-6c6e-46a3-b03f-d33b5498b30d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:14.849052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe24eb9-18ef-4eef-9457-137f1f109aa7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:14.850627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24eb9-18ef-4eef-9457-137f1f109aa7 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:14.851176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24eb9-18ef-4eef-9457-137f1f109aa7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:14.851836 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe24eb9-18ef-4eef-9457-137f1f109aa7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:14.870327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d3d49-4cb3-4370-913d-9ff1cd4bfced service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:14.875014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7d3d49-4cb3-4370-913d-9ff1cd4bfced service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:14.878223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe24eb9-18ef-4eef-9457-137f1f109aa7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:14.879840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbe24eb9-18ef-4eef-9457-137f1f109aa7 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:14.894192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 814/1627] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:14.895982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 814/1628] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:15.389055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa7f37-2b6d-49fc-be88-70e747d968f8 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:15.389338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa7f37-2b6d-49fc-be88-70e747d968f8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:15.389691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7faa7f37-2b6d-49fc-be88-70e747d968f8 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:15.391462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 815/1629] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 24 14:26:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:26:15.400739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d132-0da2-4d3f-9c6d-fff0edd0223a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:15.401299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d132-0da2-4d3f-9c6d-fff0edd0223a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:15.401746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d82d132-0da2-4d3f-9c6d-fff0edd0223a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:15.442045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4d82d132-0da2-4d3f-9c6d-fff0edd0223a None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:15.443755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4d82d132-0da2-4d3f-9c6d-fff0edd0223a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:15.462022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 815/1630] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:15.480931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa7f37-2b6d-49fc-be88-70e747d968f8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:15.498623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7faa7f37-2b6d-49fc-be88-70e747d968f8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:15.515271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e9f1aa-83f7-4ed3-bc12-8a50ea22e6df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:15.516126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9f1aa-83f7-4ed3-bc12-8a50ea22e6df service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:15.517576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9f1aa-83f7-4ed3-bc12-8a50ea22e6df service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:15.517964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e9f1aa-83f7-4ed3-bc12-8a50ea22e6df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:15.546278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9f1aa-83f7-4ed3-bc12-8a50ea22e6df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:15.551069 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e9f1aa-83f7-4ed3-bc12-8a50ea22e6df service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:15.580595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 816/1631] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:15.771716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e8391-5692-43b9-b02c-fe848ded670c None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:15.772337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e8391-5692-43b9-b02c-fe848ded670c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:15.772673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138e8391-5692-43b9-b02c-fe848ded670c None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:15.774845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 816/1632] 10.222.0.16 () {54 vars in 961 bytes} [Sat Sep 24 14:26:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:26:15.782714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a077473-55da-4c01-a23a-4d0dcb8917c2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:15.783258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a077473-55da-4c01-a23a-4d0dcb8917c2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:15.784401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a077473-55da-4c01-a23a-4d0dcb8917c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:15.817590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3a077473-55da-4c01-a23a-4d0dcb8917c2 None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:15.819580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3a077473-55da-4c01-a23a-4d0dcb8917c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:15.846251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 817/1633] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Sep 24 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:26:15.856701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641313d-8a98-4906-b653-e6fd1ba682c9 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:15.856701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641313d-8a98-4906-b653-e6fd1ba682c9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:15.856701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9641313d-8a98-4906-b653-e6fd1ba682c9 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:15.857153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 817/1634] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 24 14:26:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:26:15.866072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bbac3-c3ac-410f-b392-7daecb974181 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:15.866380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bbac3-c3ac-410f-b392-7daecb974181 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:15.866660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827bbac3-c3ac-410f-b392-7daecb974181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:15.946872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-827bbac3-c3ac-410f-b392-7daecb974181 None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:15.951295 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-827bbac3-c3ac-410f-b392-7daecb974181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:15.977075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 818/1635] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:26:15 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:16.035974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641313d-8a98-4906-b653-e6fd1ba682c9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:16.059922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9641313d-8a98-4906-b653-e6fd1ba682c9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:16.064377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00778069-619a-4ba3-84b0-6d37c9e5477c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:16.065291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00778069-619a-4ba3-84b0-6d37c9e5477c service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:16.065572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00778069-619a-4ba3-84b0-6d37c9e5477c service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:16.065844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00778069-619a-4ba3-84b0-6d37c9e5477c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:16.096840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00778069-619a-4ba3-84b0-6d37c9e5477c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:16.097704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00778069-619a-4ba3-84b0-6d37c9e5477c service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:16.117362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 818/1636] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:17.972811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bbac3-c3ac-410f-b392-7daecb974181 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:18.146315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827bbac3-c3ac-410f-b392-7daecb974181 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:18.159332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:18.161310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:18.161611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:18.161887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] PATH_INFO: `/v3/users/51b416aed03e4c35b93e8edf2821a89f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:18.167479 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=51b416aed03e4c35b93e8edf2821a89f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:18.170127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: WARNING py.warnings [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:26:18.170127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: warnings.warn(msg) Sep 24 14:26:18.170127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: Sep 24 14:26:18.174040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:18.376372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '51b416aed03e4c35b93e8edf2821a89f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:18.378943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '51b416aed03e4c35b93e8edf2821a89f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:18.389547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:18.427140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '51b416aed03e4c35b93e8edf2821a89f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:18.431577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '51b416aed03e4c35b93e8edf2821a89f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:18.471256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '51b416aed03e4c35b93e8edf2821a89f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:18.565231 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 819/1637] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:17 2022] DELETE /identity/v3/users/51b416aed03e4c35b93e8edf2821a89f => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:18.570427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d16d9-a6f4-4697-9203-2b5927f3a375 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:18.570866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d16d9-a6f4-4697-9203-2b5927f3a375 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:18.571080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4d16d9-a6f4-4697-9203-2b5927f3a375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:18.645625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7e4d16d9-a6f4-4697-9203-2b5927f3a375 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:18.647490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7e4d16d9-a6f4-4697-9203-2b5927f3a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:18.947183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 819/1638] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:26:18.975728 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:18.977500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:19.108244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13aead0-ccd1-43c1-aa33-d513e52e4cb2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:19.115813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5925e1e-e140-4215-ab21-9e36243e85f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:19.116815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5925e1e-e140-4215-ab21-9e36243e85f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:19.117306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5925e1e-e140-4215-ab21-9e36243e85f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:19.118550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5925e1e-e140-4215-ab21-9e36243e85f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:19.132686 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5925e1e-e140-4215-ab21-9e36243e85f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:19.135552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5925e1e-e140-4215-ab21-9e36243e85f5 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:19.151363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 820/1639] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:20.998989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d16d9-a6f4-4697-9203-2b5927f3a375 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:21.001360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7e4d16d9-a6f4-4697-9203-2b5927f3a375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:21.021932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4d16d9-a6f4-4697-9203-2b5927f3a375 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:21.031075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:21.032242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:21.032755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:21.033233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] PATH_INFO: `/v3/projects/f09201ad76b1445c9ffb48deb1418b38` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:21.034788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f09201ad76b1445c9ffb48deb1418b38)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:21.036586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: WARNING py.warnings [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Sep 24 14:26:21.036586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: warnings.warn(msg) Sep 24 14:26:21.036586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: Sep 24 14:26:21.038971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:21.177934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f09201ad76b1445c9ffb48deb1418b38', 'request_id': 'req-0d6b01ff-a866-4ed1-b33e-2d2451de3809'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:21.200767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f09201ad76b1445c9ffb48deb1418b38', 'request_id': 'req-0d6b01ff-a866-4ed1-b33e-2d2451de3809'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:21.211402 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f09201ad76b1445c9ffb48deb1418b38', 'request_id': 'req-0d6b01ff-a866-4ed1-b33e-2d2451de3809'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:21.230686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] The token cache is being invalidate because project f09201ad76b1445c9ffb48deb1418b38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:21.231152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:21.232939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:21.235362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 820/1640] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:20 2022] DELETE /identity/v3/projects/f09201ad76b1445c9ffb48deb1418b38 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:21.241022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5925e1e-e140-4215-ab21-9e36243e85f5 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:21.266749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5925e1e-e140-4215-ab21-9e36243e85f5 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:21.439247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:21.440126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:21.440541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:21.440908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] PATH_INFO: `/v3/users/94f7a9279d044a64bdd6a3ea129464c8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:21.442630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] RBAC: Authorizing `identity:delete_user(user_id=94f7a9279d044a64bdd6a3ea129464c8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:21.447441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:21.572708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '94f7a9279d044a64bdd6a3ea129464c8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:21.575337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '94f7a9279d044a64bdd6a3ea129464c8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:21.657796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '94f7a9279d044a64bdd6a3ea129464c8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:21.659286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '94f7a9279d044a64bdd6a3ea129464c8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:21.670656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:21.673526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-231d4b95-4bc5-43d7-b8f5-a1c3e66ed414 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '94f7a9279d044a64bdd6a3ea129464c8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:21.718569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 821/1641] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:21 2022] DELETE /identity/v3/users/94f7a9279d044a64bdd6a3ea129464c8 => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:22.764781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:22.767448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:22.776287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:22.798219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6b01ff-a866-4ed1-b33e-2d2451de3809 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:22.936447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:22.937953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:22.938240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:22.938516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] PATH_INFO: `/v3/users/9bb095bd274846a49d6eeb52beafac90` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:22.940752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bb095bd274846a49d6eeb52beafac90)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:22.945380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:23.032044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bb095bd274846a49d6eeb52beafac90'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:23.032820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bb095bd274846a49d6eeb52beafac90'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:23.033461 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bb095bd274846a49d6eeb52beafac90'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:23.043802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bb095bd274846a49d6eeb52beafac90'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:23.067095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bb095bd274846a49d6eeb52beafac90'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:23.125569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 821/1642] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:22 2022] DELETE /identity/v3/users/9bb095bd274846a49d6eeb52beafac90 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:23.134074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bff6e-79d7-488b-b295-5f8b9b2a9291 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:23.137459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bff6e-79d7-488b-b295-5f8b9b2a9291 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:23.137967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353bff6e-79d7-488b-b295-5f8b9b2a9291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:23.183289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-353bff6e-79d7-488b-b295-5f8b9b2a9291 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:23.188320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-353bff6e-79d7-488b-b295-5f8b9b2a9291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:23.389491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 822/1643] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:23.439836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:23.442937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:23.548727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bff6e-79d7-488b-b295-5f8b9b2a9291 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:23.551230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-353bff6e-79d7-488b-b295-5f8b9b2a9291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:23.604516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d01d0a0-a970-4f70-a2c2-835a224be946 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:23.609617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353bff6e-79d7-488b-b295-5f8b9b2a9291 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:23.616726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979a59ae-ba88-49a4-8c0d-4b1a94c2b19e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:23.617615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a59ae-ba88-49a4-8c0d-4b1a94c2b19e service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:23.623217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a59ae-ba88-49a4-8c0d-4b1a94c2b19e service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:23.623657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979a59ae-ba88-49a4-8c0d-4b1a94c2b19e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:23.626313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:23.627389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:23.627850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:23.628548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] PATH_INFO: `/v3/projects/d709e464dab746a3ac800463fa620423` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:23.641242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=d709e464dab746a3ac800463fa620423)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:23.644621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:23.650346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a59ae-ba88-49a4-8c0d-4b1a94c2b19e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:23.654339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979a59ae-ba88-49a4-8c0d-4b1a94c2b19e service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:23.708435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 822/1644] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:23.744194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd709e464dab746a3ac800463fa620423', 'request_id': 'req-fa5355d5-676b-4199-882c-f124c8f86bbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:23.765812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd709e464dab746a3ac800463fa620423', 'request_id': 'req-fa5355d5-676b-4199-882c-f124c8f86bbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:23.783694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd709e464dab746a3ac800463fa620423', 'request_id': 'req-fa5355d5-676b-4199-882c-f124c8f86bbe'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:23.834926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] The token cache is being invalidate because project d709e464dab746a3ac800463fa620423 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:23.835295 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:23.836334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-fa5355d5-676b-4199-882c-f124c8f86bbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:23.842600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 823/1645] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:23 2022] DELETE /identity/v3/projects/d709e464dab746a3ac800463fa620423 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:23.844467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14676b14-633a-4822-9e77-1dc0f2817a09 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:23.844916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14676b14-633a-4822-9e77-1dc0f2817a09 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:23.845044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14676b14-633a-4822-9e77-1dc0f2817a09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:23.885448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-14676b14-633a-4822-9e77-1dc0f2817a09 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:23.887315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-14676b14-633a-4822-9e77-1dc0f2817a09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:23.922595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:24.039025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 823/1646] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:24.043638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400068a0-782b-47d1-b618-522f34922143 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:24.044414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400068a0-782b-47d1-b618-522f34922143 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:24.044920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400068a0-782b-47d1-b618-522f34922143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:24.100983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-400068a0-782b-47d1-b618-522f34922143 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:24.116609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-400068a0-782b-47d1-b618-522f34922143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:24.148999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 824/1647] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:26:24.152671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14676b14-633a-4822-9e77-1dc0f2817a09 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:24.179107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14676b14-633a-4822-9e77-1dc0f2817a09 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:24.205277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cf942-f813-4563-8605-fff7f2efe4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:24.206063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cf942-f813-4563-8605-fff7f2efe4be admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:24.206494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cf942-f813-4563-8605-fff7f2efe4be admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:24.206780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44cf942-f813-4563-8605-fff7f2efe4be admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:24.207457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cf942-f813-4563-8605-fff7f2efe4be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:24.207808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cf942-f813-4563-8605-fff7f2efe4be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:24.209615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44cf942-f813-4563-8605-fff7f2efe4be admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:24.256176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 824/1648] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:24.258641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400068a0-782b-47d1-b618-522f34922143 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:24.274535 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400068a0-782b-47d1-b618-522f34922143 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:24.301760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd900217-438f-4264-985f-f485274b5f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:24.302626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900217-438f-4264-985f-f485274b5f6a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:24.302626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900217-438f-4264-985f-f485274b5f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:24.303092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd900217-438f-4264-985f-f485274b5f6a admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:24.304631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd900217-438f-4264-985f-f485274b5f6a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:24.306658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd900217-438f-4264-985f-f485274b5f6a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:24.423702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 825/1649] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:24 2022] POST /identity/v3/projects => generated 377 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:24.428078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cf942-f813-4563-8605-fff7f2efe4be admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:24.444958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44cf942-f813-4563-8605-fff7f2efe4be admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:24.716779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aba7f-d0cf-4b74-b11f-3d9390d90251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:24.717737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aba7f-d0cf-4b74-b11f-3d9390d90251 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:24.717923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aba7f-d0cf-4b74-b11f-3d9390d90251 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:24.719631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8aba7f-d0cf-4b74-b11f-3d9390d90251 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:24.722699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aba7f-d0cf-4b74-b11f-3d9390d90251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:24.728754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8aba7f-d0cf-4b74-b11f-3d9390d90251 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:24.792507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd900217-438f-4264-985f-f485274b5f6a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:24.800053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 825/1650] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:24 2022] POST /identity/v3/users => generated 289 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:26:24.807670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd900217-438f-4264-985f-f485274b5f6a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:24.815098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e7b9-d3ef-4086-924c-d024fed1da37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:24.816438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e7b9-d3ef-4086-924c-d024fed1da37 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:24.816783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e7b9-d3ef-4086-924c-d024fed1da37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:24.817167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b56e7b9-d3ef-4086-924c-d024fed1da37 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:24.818396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56e7b9-d3ef-4086-924c-d024fed1da37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:24.830227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b56e7b9-d3ef-4086-924c-d024fed1da37 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:24.855167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aba7f-d0cf-4b74-b11f-3d9390d90251 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:24.866520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 826/1651] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:24.871052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8aba7f-d0cf-4b74-b11f-3d9390d90251 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:24.879228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07dfc057-aab3-4afb-8e05-199f57a49ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:24.879926 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfc057-aab3-4afb-8e05-199f57a49ed1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:24.880694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfc057-aab3-4afb-8e05-199f57a49ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:24.880985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07dfc057-aab3-4afb-8e05-199f57a49ed1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:24.881761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfc057-aab3-4afb-8e05-199f57a49ed1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:24.884090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07dfc057-aab3-4afb-8e05-199f57a49ed1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:24.918470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e7b9-d3ef-4086-924c-d024fed1da37 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:24.931180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 826/1652] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:24 2022] GET /identity/v3/roles => generated 1420 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:24.945759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b56e7b9-d3ef-4086-924c-d024fed1da37 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:24.960354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8f368-2ca1-4af3-ad4c-0a6a8732b6c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:24.961573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8f368-2ca1-4af3-ad4c-0a6a8732b6c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:24.962002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8f368-2ca1-4af3-ad4c-0a6a8732b6c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:24.962458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c8f368-2ca1-4af3-ad4c-0a6a8732b6c3 admin admin] PATH_INFO: `/v3/projects/1ade7b670b5b49c19f7b7df4ab24c6de/users/640bf745e3824bfd9f2f9a076c2e1da0/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:25.022490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8f368-2ca1-4af3-ad4c-0a6a8732b6c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ade7b670b5b49c19f7b7df4ab24c6de, user_id=640bf745e3824bfd9f2f9a076c2e1da0, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:25.029310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c8f368-2ca1-4af3-ad4c-0a6a8732b6c3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:25.072655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f41fa-53e4-42e2-ba9a-05a904dbe0b0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:25.072941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f41fa-53e4-42e2-ba9a-05a904dbe0b0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:25.073230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a58f41fa-53e4-42e2-ba9a-05a904dbe0b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:25.076118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 827/1653] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:24 2022] PUT /identity/v3/projects/1ade7b670b5b49c19f7b7df4ab24c6de/users/640bf745e3824bfd9f2f9a076c2e1da0/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:25.124866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a58f41fa-53e4-42e2-ba9a-05a904dbe0b0 None None] MFA Rules not processed for user `640bf745e3824bfd9f2f9a076c2e1da0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:25.129427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a58f41fa-53e4-42e2-ba9a-05a904dbe0b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:25.320858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8f368-2ca1-4af3-ad4c-0a6a8732b6c3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:25.330757 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 827/1654] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:25.356181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:25.532674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c8f368-2ca1-4af3-ad4c-0a6a8732b6c3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:25.549765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e7989-0ab5-4e79-84cf-60f079bc4b10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:25.550407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e7989-0ab5-4e79-84cf-60f079bc4b10 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:25.550693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e7989-0ab5-4e79-84cf-60f079bc4b10 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:25.550972 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27e7989-0ab5-4e79-84cf-60f079bc4b10 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:25.552709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e7989-0ab5-4e79-84cf-60f079bc4b10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:25.559509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27e7989-0ab5-4e79-84cf-60f079bc4b10 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:25.628935 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 828/1655] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:25 2022] POST /identity/v3/projects => generated 375 bytes in 309 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:25.642792 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f41fa-53e4-42e2-ba9a-05a904dbe0b0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:25.675742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a58f41fa-53e4-42e2-ba9a-05a904dbe0b0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:25.746481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:25.918792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e7989-0ab5-4e79-84cf-60f079bc4b10 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:25.921747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e27e7989-0ab5-4e79-84cf-60f079bc4b10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:25.929729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c64b05-b7a6-4371-8280-b25a23a308e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:25.933996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c64b05-b7a6-4371-8280-b25a23a308e6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:25.936005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c64b05-b7a6-4371-8280-b25a23a308e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:25.937619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c64b05-b7a6-4371-8280-b25a23a308e6 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:25.938470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c64b05-b7a6-4371-8280-b25a23a308e6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:25.946471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c64b05-b7a6-4371-8280-b25a23a308e6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:25.953594 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27e7989-0ab5-4e79-84cf-60f079bc4b10 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:25.990430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:25.994785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:25.998124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:25.998880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] PATH_INFO: `/v3/users/4b71c204c520467bb20549437560f1e6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:26.002847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b71c204c520467bb20549437560f1e6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:26.013079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:26.036880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 828/1656] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:25 2022] POST /identity/v3/users => generated 294 bytes in 403 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:26.038422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c64b05-b7a6-4371-8280-b25a23a308e6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:26.071466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c64b05-b7a6-4371-8280-b25a23a308e6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:26.099986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6c5f-08a7-47db-b014-5642b3fc026b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:26.101177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6c5f-08a7-47db-b014-5642b3fc026b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:26.101609 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6c5f-08a7-47db-b014-5642b3fc026b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:26.102030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0e6c5f-08a7-47db-b014-5642b3fc026b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:26.103540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6c5f-08a7-47db-b014-5642b3fc026b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:26.110341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0e6c5f-08a7-47db-b014-5642b3fc026b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:26.158104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 829/1657] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:26.160091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6c5f-08a7-47db-b014-5642b3fc026b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:26.180177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b71c204c520467bb20549437560f1e6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:26.182106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b71c204c520467bb20549437560f1e6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:26.194929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0e6c5f-08a7-47db-b014-5642b3fc026b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:26.208266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373643d-2675-463b-a63b-f55e461090f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:26.208961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373643d-2675-463b-a63b-f55e461090f8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:26.209245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373643d-2675-463b-a63b-f55e461090f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:26.209527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2373643d-2675-463b-a63b-f55e461090f8 admin admin] PATH_INFO: `/v3/projects/4aa7582e2baf44fbbc8c9795ed51317e/users/17ddb84699af48b78bfd9eb9595e7a67/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:26.219794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b71c204c520467bb20549437560f1e6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:26.227301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b71c204c520467bb20549437560f1e6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:26.246997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-69dd6e83-144f-402e-b542-1f8f13b7062f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b71c204c520467bb20549437560f1e6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:26.254956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373643d-2675-463b-a63b-f55e461090f8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa7582e2baf44fbbc8c9795ed51317e, user_id=17ddb84699af48b78bfd9eb9595e7a67, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:26.262309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2373643d-2675-463b-a63b-f55e461090f8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:26.273913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 829/1658] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:25 2022] DELETE /identity/v3/users/4b71c204c520467bb20549437560f1e6 => generated 0 bytes in 355 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:26.279258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48b45e-9867-4464-afb8-6983f7267271 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:26.279582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48b45e-9867-4464-afb8-6983f7267271 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:26.279959 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad48b45e-9867-4464-afb8-6983f7267271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:26.299578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 830/1659] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:26 2022] PUT /identity/v3/projects/4aa7582e2baf44fbbc8c9795ed51317e/users/17ddb84699af48b78bfd9eb9595e7a67/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:26.305321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373643d-2675-463b-a63b-f55e461090f8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:26.308705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2373643d-2675-463b-a63b-f55e461090f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:26.341574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ad48b45e-9867-4464-afb8-6983f7267271 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:26.342827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ad48b45e-9867-4464-afb8-6983f7267271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:26.483556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2373643d-2675-463b-a63b-f55e461090f8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:26.496405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a566c4-6c58-4816-bef0-12e03bce3fd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:26.497044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a566c4-6c58-4816-bef0-12e03bce3fd5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:26.497330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a566c4-6c58-4816-bef0-12e03bce3fd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:26.497611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9a566c4-6c58-4816-bef0-12e03bce3fd5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:26.498272 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a566c4-6c58-4816-bef0-12e03bce3fd5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:26.503883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9a566c4-6c58-4816-bef0-12e03bce3fd5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:26.508252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 830/1660] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:26.530097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48b45e-9867-4464-afb8-6983f7267271 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:26.533788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ad48b45e-9867-4464-afb8-6983f7267271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:26.543381 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 831/1661] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:26 2022] GET /identity/v3/roles => generated 1420 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:26.548127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a566c4-6c58-4816-bef0-12e03bce3fd5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:26.562523 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:26.579358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9a566c4-6c58-4816-bef0-12e03bce3fd5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:26.598833 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691596cc-a1c5-417a-a410-48adfd3435f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:26.599714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691596cc-a1c5-417a-a410-48adfd3435f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:26.600074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691596cc-a1c5-417a-a410-48adfd3435f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:26.600587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691596cc-a1c5-417a-a410-48adfd3435f4 admin admin] PATH_INFO: `/v3/projects/4aa7582e2baf44fbbc8c9795ed51317e/users/17ddb84699af48b78bfd9eb9595e7a67/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:26.608994 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691596cc-a1c5-417a-a410-48adfd3435f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4aa7582e2baf44fbbc8c9795ed51317e, user_id=17ddb84699af48b78bfd9eb9595e7a67, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:26.614188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691596cc-a1c5-417a-a410-48adfd3435f4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:26.631466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 832/1662] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:26 2022] PUT /identity/v3/projects/4aa7582e2baf44fbbc8c9795ed51317e/users/17ddb84699af48b78bfd9eb9595e7a67/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:26.643215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0ea81-27e7-4d75-9ea9-18ac5763a3b2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:26.643628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0ea81-27e7-4d75-9ea9-18ac5763a3b2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:26.643990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed0ea81-27e7-4d75-9ea9-18ac5763a3b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:26.679701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2ed0ea81-27e7-4d75-9ea9-18ac5763a3b2 None None] MFA Rules not processed for user `17ddb84699af48b78bfd9eb9595e7a67`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:26.681108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2ed0ea81-27e7-4d75-9ea9-18ac5763a3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:26.701205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad48b45e-9867-4464-afb8-6983f7267271 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:26.758868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:26.807204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc46b8-e379-4332-b77d-f90e0be56dad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:26.808525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc46b8-e379-4332-b77d-f90e0be56dad service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:26.808880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc46b8-e379-4332-b77d-f90e0be56dad service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:26.809259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fc46b8-e379-4332-b77d-f90e0be56dad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:26.837284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 833/1663] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:26.838961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0ea81-27e7-4d75-9ea9-18ac5763a3b2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:26.847114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2ed0ea81-27e7-4d75-9ea9-18ac5763a3b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:26.993606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc46b8-e379-4332-b77d-f90e0be56dad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:26.995107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63fc46b8-e379-4332-b77d-f90e0be56dad service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:27.024419 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed0ea81-27e7-4d75-9ea9-18ac5763a3b2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:27.037038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 831/1664] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 511 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:26:27.039594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:27.041211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc46b8-e379-4332-b77d-f90e0be56dad service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:27.041580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:27.041868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:27.045034 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] PATH_INFO: `/v3/projects/7ec610a542c144be8c59b3184bb9f739` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:27.046385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-63fc46b8-e379-4332-b77d-f90e0be56dad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:27.050296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ec610a542c144be8c59b3184bb9f739)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:27.053929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:27.162718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ec610a542c144be8c59b3184bb9f739', 'request_id': 'req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:27.180132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ec610a542c144be8c59b3184bb9f739', 'request_id': 'req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:27.199561 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ec610a542c144be8c59b3184bb9f739', 'request_id': 'req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:27.206774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fc46b8-e379-4332-b77d-f90e0be56dad service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:27.228704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] The token cache is being invalidate because project 7ec610a542c144be8c59b3184bb9f739 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:27.229012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:27.230744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1e7e33ef-9e6c-40c5-b081-c1ca8064cbc6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:27.239221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 834/1665] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:26 2022] DELETE /identity/v3/projects/7ec610a542c144be8c59b3184bb9f739 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:27.242027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b23057-366a-49f5-957b-7acdf8d379e4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:27.242027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b23057-366a-49f5-957b-7acdf8d379e4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:27.242289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49b23057-366a-49f5-957b-7acdf8d379e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:27.303629 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:27.303995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-49b23057-366a-49f5-957b-7acdf8d379e4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:27.307590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-49b23057-366a-49f5-957b-7acdf8d379e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:27.359939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b772228-83f4-4223-8d07-a58a3e7ac1e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:27.360605 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772228-83f4-4223-8d07-a58a3e7ac1e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:27.360887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772228-83f4-4223-8d07-a58a3e7ac1e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:27.361160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b772228-83f4-4223-8d07-a58a3e7ac1e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:27.366281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0b772228-83f4-4223-8d07-a58a3e7ac1e7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:27.469384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 835/1666] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:27.477273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dd76e-5afa-4981-aba7-cbf57687ecde None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:27.477559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dd76e-5afa-4981-aba7-cbf57687ecde None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:27.477872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68dd76e-5afa-4981-aba7-cbf57687ecde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:27.539419 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e68dd76e-5afa-4981-aba7-cbf57687ecde None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:27.540759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b772228-83f4-4223-8d07-a58a3e7ac1e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:27.542831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b772228-83f4-4223-8d07-a58a3e7ac1e7 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:27.544404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e68dd76e-5afa-4981-aba7-cbf57687ecde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:27.564518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 836/1667] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:26:27.568991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dd76e-5afa-4981-aba7-cbf57687ecde None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:27.592954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68dd76e-5afa-4981-aba7-cbf57687ecde None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:27.600502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 832/1668] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:27.606843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556c66-e7fd-4993-bfb9-456266bcc028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:27.608475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556c66-e7fd-4993-bfb9-456266bcc028 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:27.608859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556c66-e7fd-4993-bfb9-456266bcc028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:27.609537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef556c66-e7fd-4993-bfb9-456266bcc028 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:27.612273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556c66-e7fd-4993-bfb9-456266bcc028 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:27.613744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556c66-e7fd-4993-bfb9-456266bcc028 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:27.621885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef556c66-e7fd-4993-bfb9-456266bcc028 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:27.624898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:27.673778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 837/1669] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:27.675413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b772228-83f4-4223-8d07-a58a3e7ac1e7 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:27.692526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b772228-83f4-4223-8d07-a58a3e7ac1e7 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:27.708991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e9892-b41e-45f8-8266-cb9cad8862a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:27.710076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e9892-b41e-45f8-8266-cb9cad8862a1 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:27.710480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e9892-b41e-45f8-8266-cb9cad8862a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:27.710856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4e9892-b41e-45f8-8266-cb9cad8862a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:27.711602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e9892-b41e-45f8-8266-cb9cad8862a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:27.720350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4e9892-b41e-45f8-8266-cb9cad8862a1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:27.817104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 833/1670] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:27 2022] POST /identity/v3/projects => generated 371 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:27.817844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556c66-e7fd-4993-bfb9-456266bcc028 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:27.838789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef556c66-e7fd-4993-bfb9-456266bcc028 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:28.063016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be36ac-5f5f-4491-833d-7978dd02dcf0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:28.063697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be36ac-5f5f-4491-833d-7978dd02dcf0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:28.063942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be36ac-5f5f-4491-833d-7978dd02dcf0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:28.064243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be36ac-5f5f-4491-833d-7978dd02dcf0 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:28.064923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be36ac-5f5f-4491-833d-7978dd02dcf0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:28.068262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51be36ac-5f5f-4491-833d-7978dd02dcf0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:28.162069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 838/1671] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:27 2022] POST /identity/v3/users => generated 286 bytes in 342 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:26:28.163578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e9892-b41e-45f8-8266-cb9cad8862a1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:28.184448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4e9892-b41e-45f8-8266-cb9cad8862a1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:28.197552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a124e-0701-49fd-b2c6-34357c44a39e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:28.197552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a124e-0701-49fd-b2c6-34357c44a39e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:28.197552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a124e-0701-49fd-b2c6-34357c44a39e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:28.201917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b1a124e-0701-49fd-b2c6-34357c44a39e admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:28.203028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a124e-0701-49fd-b2c6-34357c44a39e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:28.207132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b1a124e-0701-49fd-b2c6-34357c44a39e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:28.239069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be36ac-5f5f-4491-833d-7978dd02dcf0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:28.240000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 834/1672] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:28.258502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be36ac-5f5f-4491-833d-7978dd02dcf0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:28.276990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769155e1-da0d-42cd-9c67-b32e77788320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:28.277669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769155e1-da0d-42cd-9c67-b32e77788320 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:28.277946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769155e1-da0d-42cd-9c67-b32e77788320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:28.279001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769155e1-da0d-42cd-9c67-b32e77788320 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:28.279744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769155e1-da0d-42cd-9c67-b32e77788320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:28.286675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769155e1-da0d-42cd-9c67-b32e77788320 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:28.319652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a124e-0701-49fd-b2c6-34357c44a39e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:28.330424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 839/1673] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:28 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:28.333681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b1a124e-0701-49fd-b2c6-34357c44a39e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:28.353004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93953c-d99b-4f96-a3e9-399109184fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:28.353759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93953c-d99b-4f96-a3e9-399109184fbc admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:28.354041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93953c-d99b-4f96-a3e9-399109184fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:28.354330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b93953c-d99b-4f96-a3e9-399109184fbc admin admin] PATH_INFO: `/v3/projects/1ff7744db36149968fd6e53f363d8dd2/users/db9a32300a1940c8b89c9353076c5ad0/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:28.424492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93953c-d99b-4f96-a3e9-399109184fbc admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ff7744db36149968fd6e53f363d8dd2, user_id=db9a32300a1940c8b89c9353076c5ad0, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:28.429924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b93953c-d99b-4f96-a3e9-399109184fbc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:28.505908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 835/1674] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:28 2022] PUT /identity/v3/projects/1ff7744db36149968fd6e53f363d8dd2/users/db9a32300a1940c8b89c9353076c5ad0/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:28.520775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2189d-3473-4331-8389-6d66b6a8d07f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:28.520775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2189d-3473-4331-8389-6d66b6a8d07f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:28.521092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2189d-3473-4331-8389-6d66b6a8d07f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:28.599819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fde2189d-3473-4331-8389-6d66b6a8d07f None None] MFA Rules not processed for user `db9a32300a1940c8b89c9353076c5ad0`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:28.601266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fde2189d-3473-4331-8389-6d66b6a8d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:28.759763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 840/1675] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:28 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:28.761091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93953c-d99b-4f96-a3e9-399109184fbc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:28.763139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6b93953c-d99b-4f96-a3e9-399109184fbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:28.964954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b93953c-d99b-4f96-a3e9-399109184fbc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:28.978569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c2e0b6-433f-4c98-a301-27dcd516147d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:28.979196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2e0b6-433f-4c98-a301-27dcd516147d service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:28.980239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2e0b6-433f-4c98-a301-27dcd516147d service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:28.981924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c2e0b6-433f-4c98-a301-27dcd516147d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:29.003813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2e0b6-433f-4c98-a301-27dcd516147d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:29.004856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c2e0b6-433f-4c98-a301-27dcd516147d service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:29.028954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 836/1676] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:29.092370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2189d-3473-4331-8389-6d66b6a8d07f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:29.093963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fde2189d-3473-4331-8389-6d66b6a8d07f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:29.227363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be49d8-6084-4258-a813-dd828e7dc6b0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:29.227605 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be49d8-6084-4258-a813-dd828e7dc6b0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:29.228070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1be49d8-6084-4258-a813-dd828e7dc6b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:29.300945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:29.320957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2189d-3473-4331-8389-6d66b6a8d07f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:29.326089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d1be49d8-6084-4258-a813-dd828e7dc6b0 None None] MFA Rules not processed for user `5a3a7f87ef4349eb9b21745be3a6b8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:29.329230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d1be49d8-6084-4258-a813-dd828e7dc6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:29.338090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:29.339717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:29.340476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:29.340476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] PATH_INFO: `/v3/projects/25b1e904a81f4cb486fef84824fd0d21` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:29.350519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] RBAC: Authorizing `identity:delete_project(project_id=25b1e904a81f4cb486fef84824fd0d21)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:29.356303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:29.362266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:29.494457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '25b1e904a81f4cb486fef84824fd0d21', 'request_id': 'req-06c76fe4-83c8-4834-abb9-df2a5d95030a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:29.511415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '25b1e904a81f4cb486fef84824fd0d21', 'request_id': 'req-06c76fe4-83c8-4834-abb9-df2a5d95030a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:29.554671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '25b1e904a81f4cb486fef84824fd0d21', 'request_id': 'req-06c76fe4-83c8-4834-abb9-df2a5d95030a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:29.589818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] The token cache is being invalidate because project 25b1e904a81f4cb486fef84824fd0d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:29.590123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:29.593175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-06c76fe4-83c8-4834-abb9-df2a5d95030a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:29.606013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 841/1677] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:29 2022] DELETE /identity/v3/projects/25b1e904a81f4cb486fef84824fd0d21 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:29.606789 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 837/1678] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 380 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:29.615566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be49d8-6084-4258-a813-dd828e7dc6b0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:29.616040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d5dd-f418-4d9a-88e9-167731efac9b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:29.616363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d5dd-f418-4d9a-88e9-167731efac9b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:29.616647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f36d5dd-f418-4d9a-88e9-167731efac9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:29.618315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d1be49d8-6084-4258-a813-dd828e7dc6b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:29.670813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1be49d8-6084-4258-a813-dd828e7dc6b0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:29.678666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8f36d5dd-f418-4d9a-88e9-167731efac9b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:29.679959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8f36d5dd-f418-4d9a-88e9-167731efac9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:29.849188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 842/1679] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:29.862838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc2798-1146-4302-9ac0-448d63646d56 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:29.863436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc2798-1146-4302-9ac0-448d63646d56 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:29.863944 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bdc2798-1146-4302-9ac0-448d63646d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:29.913182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0bdc2798-1146-4302-9ac0-448d63646d56 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:29.919048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0bdc2798-1146-4302-9ac0-448d63646d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:29.945248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 843/1680] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:29.946210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc2798-1146-4302-9ac0-448d63646d56 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:29.981833 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bdc2798-1146-4302-9ac0-448d63646d56 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:29.981937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e97cc1-f0b9-481d-863e-78bb81d135ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:29.982315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e97cc1-f0b9-481d-863e-78bb81d135ef service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:29.982598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e97cc1-f0b9-481d-863e-78bb81d135ef service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:29.983374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e97cc1-f0b9-481d-863e-78bb81d135ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:29.989555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-48e97cc1-f0b9-481d-863e-78bb81d135ef service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:29.994577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c7127-64da-45f3-9ea1-c043e4ada9c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:29.996333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7127-64da-45f3-9ea1-c043e4ada9c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:29.996625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7127-64da-45f3-9ea1-c043e4ada9c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:29.996907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788c7127-64da-45f3-9ea1-c043e4ada9c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:29.999259 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7127-64da-45f3-9ea1-c043e4ada9c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:30.000758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7127-64da-45f3-9ea1-c043e4ada9c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:30.007594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-788c7127-64da-45f3-9ea1-c043e4ada9c9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:30.050921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 844/1681] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:30.055512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c7127-64da-45f3-9ea1-c043e4ada9c9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:30.083499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788c7127-64da-45f3-9ea1-c043e4ada9c9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:30.107446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682d71f-179a-443d-8af4-25a7bbf720d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:30.109441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682d71f-179a-443d-8af4-25a7bbf720d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:30.109441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682d71f-179a-443d-8af4-25a7bbf720d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:30.109441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682d71f-179a-443d-8af4-25a7bbf720d3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:30.110652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682d71f-179a-443d-8af4-25a7bbf720d3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:30.117252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682d71f-179a-443d-8af4-25a7bbf720d3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:30.154297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e97cc1-f0b9-481d-863e-78bb81d135ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:30.158912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e97cc1-f0b9-481d-863e-78bb81d135ef service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:30.187517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 845/1682] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:30 2022] POST /identity/v3/projects => generated 405 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:26:30.191815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682d71f-179a-443d-8af4-25a7bbf720d3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:30.193814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 838/1683] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:29 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 578 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:30.333188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:30.370451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682d71f-179a-443d-8af4-25a7bbf720d3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:30.388769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea83ca75-d86d-4956-8cb6-d18ff40fb7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:30.389319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ca75-d86d-4956-8cb6-d18ff40fb7dc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:30.389597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ca75-d86d-4956-8cb6-d18ff40fb7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:30.389874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea83ca75-d86d-4956-8cb6-d18ff40fb7dc admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:30.391136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ca75-d86d-4956-8cb6-d18ff40fb7dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:30.392642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea83ca75-d86d-4956-8cb6-d18ff40fb7dc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:30.425851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 846/1684] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:30 2022] POST /identity/v3/users => generated 303 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:26:30.430034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e97cc1-f0b9-481d-863e-78bb81d135ef service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:30.459904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e97cc1-f0b9-481d-863e-78bb81d135ef service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:30.485340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb612826-388d-48ac-b91a-0f2f557c8328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:30.490523 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb612826-388d-48ac-b91a-0f2f557c8328 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:30.492193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb612826-388d-48ac-b91a-0f2f557c8328 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:30.493597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb612826-388d-48ac-b91a-0f2f557c8328 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:30.498009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb612826-388d-48ac-b91a-0f2f557c8328 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:30.501291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb612826-388d-48ac-b91a-0f2f557c8328 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:30.507323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac97ad-29e0-44f5-8294-eafc12afbd3f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:30.507323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac97ad-29e0-44f5-8294-eafc12afbd3f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:30.507711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ac97ad-29e0-44f5-8294-eafc12afbd3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:30.539567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 839/1685] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:30.544445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb612826-388d-48ac-b91a-0f2f557c8328 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:30.566862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb612826-388d-48ac-b91a-0f2f557c8328 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:30.574899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-08ac97ad-29e0-44f5-8294-eafc12afbd3f None None] MFA Rules not processed for user `40f99377b0134e59802907c55b1c6949`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:30.577662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-08ac97ad-29e0-44f5-8294-eafc12afbd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:30.583717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c6277-2ca7-4774-aec1-8182126f2fca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:30.584602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6277-2ca7-4774-aec1-8182126f2fca admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:30.585018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6277-2ca7-4774-aec1-8182126f2fca admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:30.585427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919c6277-2ca7-4774-aec1-8182126f2fca admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:30.586247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c6277-2ca7-4774-aec1-8182126f2fca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:30.588033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919c6277-2ca7-4774-aec1-8182126f2fca admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:30.608540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 840/1686] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:30 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:30.614007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c6277-2ca7-4774-aec1-8182126f2fca admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:30.635572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919c6277-2ca7-4774-aec1-8182126f2fca admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:30.654549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b845473-1517-4b75-b24b-fe33827fb379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:30.655414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845473-1517-4b75-b24b-fe33827fb379 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:30.655795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845473-1517-4b75-b24b-fe33827fb379 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:30.656362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b845473-1517-4b75-b24b-fe33827fb379 admin admin] PATH_INFO: `/v3/projects/14918ad5aa614cdf9a4573ddf2bfacac/users/52f16522f7e44e5d9b48776867364a8f/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:30.683642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:30.693457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b845473-1517-4b75-b24b-fe33827fb379 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14918ad5aa614cdf9a4573ddf2bfacac, user_id=52f16522f7e44e5d9b48776867364a8f, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:30.704392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b845473-1517-4b75-b24b-fe33827fb379 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:30.739079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 841/1687] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:30 2022] PUT /identity/v3/projects/14918ad5aa614cdf9a4573ddf2bfacac/users/52f16522f7e44e5d9b48776867364a8f/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:30.751734 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1463d-7dcd-4aca-9592-b69cf3bd6405 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:30.752032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1463d-7dcd-4aca-9592-b69cf3bd6405 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:30.752408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d1463d-7dcd-4aca-9592-b69cf3bd6405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:30.797488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 847/1688] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:30.802750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac97ad-29e0-44f5-8294-eafc12afbd3f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:30.805939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-08ac97ad-29e0-44f5-8294-eafc12afbd3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:30.851905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-88d1463d-7dcd-4aca-9592-b69cf3bd6405 None None] MFA Rules not processed for user `52f16522f7e44e5d9b48776867364a8f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:30.853465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-88d1463d-7dcd-4aca-9592-b69cf3bd6405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:31.119798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ac97ad-29e0-44f5-8294-eafc12afbd3f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:31.138553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 842/1689] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:30 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:31.142379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1463d-7dcd-4aca-9592-b69cf3bd6405 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:31.387627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caec12b-5011-41c6-9789-d10d481bf2a1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:31.388655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec12b-5011-41c6-9789-d10d481bf2a1 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:31.389094 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec12b-5011-41c6-9789-d10d481bf2a1 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:31.390244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3caec12b-5011-41c6-9789-d10d481bf2a1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:31.407826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:31.445799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d1463d-7dcd-4aca-9592-b69cf3bd6405 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:31.474277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a5f88-448a-4462-abb3-45393b38c9ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:31.474277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a5f88-448a-4462-abb3-45393b38c9ee admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:31.474277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a5f88-448a-4462-abb3-45393b38c9ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:31.474277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a5f88-448a-4462-abb3-45393b38c9ee admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:31.474687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a5f88-448a-4462-abb3-45393b38c9ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:31.488748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a5f88-448a-4462-abb3-45393b38c9ee admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:31.633890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 843/1690] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:31 2022] POST /identity/v3/projects => generated 405 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:31.637381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a5f88-448a-4462-abb3-45393b38c9ee admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:31.645717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caec12b-5011-41c6-9789-d10d481bf2a1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:31.647107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-887a5f88-448a-4462-abb3-45393b38c9ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:31.647882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3caec12b-5011-41c6-9789-d10d481bf2a1 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:31.688619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 848/1691] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:30 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 886 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:31.689607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caec12b-5011-41c6-9789-d10d481bf2a1 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:31.738537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3caec12b-5011-41c6-9789-d10d481bf2a1 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:31.781726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a5f88-448a-4462-abb3-45393b38c9ee admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:31.813981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419826d5-eb8d-4ebe-9555-93d33b892202 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:31.814954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419826d5-eb8d-4ebe-9555-93d33b892202 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:31.815468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419826d5-eb8d-4ebe-9555-93d33b892202 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:31.815924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419826d5-eb8d-4ebe-9555-93d33b892202 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:31.818847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-419826d5-eb8d-4ebe-9555-93d33b892202 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:31.887084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:32.016503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e3716f-98fe-40e8-9279-a9f14124e5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:32.017569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3716f-98fe-40e8-9279-a9f14124e5d3 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:32.018070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3716f-98fe-40e8-9279-a9f14124e5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:32.018559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e3716f-98fe-40e8-9279-a9f14124e5d3 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:32.023221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3716f-98fe-40e8-9279-a9f14124e5d3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:32.035303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e3716f-98fe-40e8-9279-a9f14124e5d3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:32.052973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419826d5-eb8d-4ebe-9555-93d33b892202 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:32.054445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419826d5-eb8d-4ebe-9555-93d33b892202 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:32.130876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 849/1692] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:31 2022] POST /identity/v3/users => generated 309 bytes in 442 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:32.134056 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 844/1693] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:31 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:32.135176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419826d5-eb8d-4ebe-9555-93d33b892202 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:32.135450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd622d61-f6e9-4148-a894-cb2adb1195be None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:32.139370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd622d61-f6e9-4148-a894-cb2adb1195be None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:32.139742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd622d61-f6e9-4148-a894-cb2adb1195be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:32.183887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419826d5-eb8d-4ebe-9555-93d33b892202 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:32.198149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b31596-10cf-4117-ba49-2a58c31860b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:32.198786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31596-10cf-4117-ba49-2a58c31860b2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:32.199063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31596-10cf-4117-ba49-2a58c31860b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:32.199334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b31596-10cf-4117-ba49-2a58c31860b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:32.199988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b31596-10cf-4117-ba49-2a58c31860b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:32.201663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b31596-10cf-4117-ba49-2a58c31860b2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:32.244411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 845/1694] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:32.250763 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b31596-10cf-4117-ba49-2a58c31860b2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:32.270353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fd622d61-f6e9-4148-a894-cb2adb1195be None None] MFA Rules not processed for user `e1fcaec552f7441f941b6c1bd6b5bdac`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:32.273958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b31596-10cf-4117-ba49-2a58c31860b2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:32.276129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fd622d61-f6e9-4148-a894-cb2adb1195be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:32.294115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8805a-2eec-499a-9071-a089a47e97aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:32.299071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8805a-2eec-499a-9071-a089a47e97aa admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:32.310431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8805a-2eec-499a-9071-a089a47e97aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:32.310893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b8805a-2eec-499a-9071-a089a47e97aa admin admin] PATH_INFO: `/v3/projects/cd0acbb2cb3f4f9988ae80f1fc48df62/users/7d960e52706f4e319e1171cb316ecf41/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:32.372543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8805a-2eec-499a-9071-a089a47e97aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0acbb2cb3f4f9988ae80f1fc48df62, user_id=7d960e52706f4e319e1171cb316ecf41, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:32.379960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b8805a-2eec-499a-9071-a089a47e97aa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:32.399951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 846/1695] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:32 2022] PUT /identity/v3/projects/cd0acbb2cb3f4f9988ae80f1fc48df62/users/7d960e52706f4e319e1171cb316ecf41/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:32.404045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8805a-2eec-499a-9071-a089a47e97aa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:32.568482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 850/1696] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 430 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:32.581378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd622d61-f6e9-4148-a894-cb2adb1195be None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:32.586180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fd622d61-f6e9-4148-a894-cb2adb1195be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:32.631095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b8805a-2eec-499a-9071-a089a47e97aa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:32.641849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8b36e-04e9-4f7c-9195-d9940528249c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:32.642466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8b36e-04e9-4f7c-9195-d9940528249c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:32.642744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8b36e-04e9-4f7c-9195-d9940528249c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:32.643018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef8b36e-04e9-4f7c-9195-d9940528249c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:32.643672 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8b36e-04e9-4f7c-9195-d9940528249c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:32.648493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef8b36e-04e9-4f7c-9195-d9940528249c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:32.677727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:32.710166 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 847/1697] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:32 2022] GET /identity/v3/roles => generated 1420 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:32.715733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8b36e-04e9-4f7c-9195-d9940528249c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:32.743407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef8b36e-04e9-4f7c-9195-d9940528249c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:32.753840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8cae14-f237-46ee-8fff-f8be068f9eeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:32.754626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cae14-f237-46ee-8fff-f8be068f9eeb admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:32.754847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cae14-f237-46ee-8fff-f8be068f9eeb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:32.757391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8cae14-f237-46ee-8fff-f8be068f9eeb admin admin] PATH_INFO: `/v3/projects/cd0acbb2cb3f4f9988ae80f1fc48df62/users/7d960e52706f4e319e1171cb316ecf41/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:32.763119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cae14-f237-46ee-8fff-f8be068f9eeb admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd0acbb2cb3f4f9988ae80f1fc48df62, user_id=7d960e52706f4e319e1171cb316ecf41, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:32.771695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8cae14-f237-46ee-8fff-f8be068f9eeb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:32.799063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 848/1698] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:32 2022] PUT /identity/v3/projects/cd0acbb2cb3f4f9988ae80f1fc48df62/users/7d960e52706f4e319e1171cb316ecf41/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:32.826243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b385755-5177-4b10-8fd6-aea83cb38ecd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:32.826575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b385755-5177-4b10-8fd6-aea83cb38ecd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:32.826870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b385755-5177-4b10-8fd6-aea83cb38ecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:32.873427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd622d61-f6e9-4148-a894-cb2adb1195be None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:32.981524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4b385755-5177-4b10-8fd6-aea83cb38ecd None None] MFA Rules not processed for user `7d960e52706f4e319e1171cb316ecf41`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:32.983955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4b385755-5177-4b10-8fd6-aea83cb38ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:33.020341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c074cec-b841-480a-9534-6eaa998939fc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:33.020978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c074cec-b841-480a-9534-6eaa998939fc service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:33.021507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c074cec-b841-480a-9534-6eaa998939fc service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:33.021964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c074cec-b841-480a-9534-6eaa998939fc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:33.138623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:33.147650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c074cec-b841-480a-9534-6eaa998939fc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:33.150629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c074cec-b841-480a-9534-6eaa998939fc service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:33.178861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 851/1699] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:33.184364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b65f0-3035-4690-ab4a-6d0e6249d01a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:33.184677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b65f0-3035-4690-ab4a-6d0e6249d01a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:33.184963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13b65f0-3035-4690-ab4a-6d0e6249d01a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:33.224977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 849/1700] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:32 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 407 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:33.228981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b385755-5177-4b10-8fd6-aea83cb38ecd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:33.234205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4b385755-5177-4b10-8fd6-aea83cb38ecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:33.283876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f13b65f0-3035-4690-ab4a-6d0e6249d01a None None] MFA Rules not processed for user `b790a83a93cb4c6cb34519267bc60795`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:33.289093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f13b65f0-3035-4690-ab4a-6d0e6249d01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:33.465307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b385755-5177-4b10-8fd6-aea83cb38ecd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:33.466712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:33.497714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:33.500475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:33.502252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:33.502635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] PATH_INFO: `/v3/users/db9a32300a1940c8b89c9353076c5ad0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:33.505232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db9a32300a1940c8b89c9353076c5ad0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:33.512261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:33.516206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 852/1701] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:33.517295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b65f0-3035-4690-ab4a-6d0e6249d01a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:33.522041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f13b65f0-3035-4690-ab4a-6d0e6249d01a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:33.644233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db9a32300a1940c8b89c9353076c5ad0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:33.645434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db9a32300a1940c8b89c9353076c5ad0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:33.679579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db9a32300a1940c8b89c9353076c5ad0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:33.680640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db9a32300a1940c8b89c9353076c5ad0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:33.692452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13b65f0-3035-4690-ab4a-6d0e6249d01a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:33.695339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23f738ba-d601-4352-b21f-4194bb737a5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db9a32300a1940c8b89c9353076c5ad0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:33.704683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5effb037-3d52-44fd-883c-d35e01ca6257 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:33.705989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effb037-3d52-44fd-883c-d35e01ca6257 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:33.706482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effb037-3d52-44fd-883c-d35e01ca6257 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:33.706897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5effb037-3d52-44fd-883c-d35e01ca6257 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:33.709580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5effb037-3d52-44fd-883c-d35e01ca6257 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:33.718920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 850/1702] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:33 2022] DELETE /identity/v3/users/db9a32300a1940c8b89c9353076c5ad0 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:33.720909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92fb0a-6b45-48e6-a53c-d9e63f225115 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:33.721306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92fb0a-6b45-48e6-a53c-d9e63f225115 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:33.722762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd92fb0a-6b45-48e6-a53c-d9e63f225115 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:33.732187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effb037-3d52-44fd-883c-d35e01ca6257 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:33.733945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5effb037-3d52-44fd-883c-d35e01ca6257 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:33.750901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-bd92fb0a-6b45-48e6-a53c-d9e63f225115 None None] MFA Rules not processed for user `b790a83a93cb4c6cb34519267bc60795`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:33.752382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bd92fb0a-6b45-48e6-a53c-d9e63f225115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:33.763780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 853/1703] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:33 2022] GET /identity/v3/auth/tokens => generated 3349 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:33.774237 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0215d-e848-4e70-81a3-2cb98b75c420 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:33.774477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0215d-e848-4e70-81a3-2cb98b75c420 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:33.774826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f0215d-e848-4e70-81a3-2cb98b75c420 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:33.818464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-28f0215d-e848-4e70-81a3-2cb98b75c420 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:33.820344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-28f0215d-e848-4e70-81a3-2cb98b75c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:33.923961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 851/1704] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:33.943451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92fb0a-6b45-48e6-a53c-d9e63f225115 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:33.945192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bd92fb0a-6b45-48e6-a53c-d9e63f225115 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:33.974568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:34.043798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 854/1705] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 280 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:34.103182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0215d-e848-4e70-81a3-2cb98b75c420 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:34.104252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-28f0215d-e848-4e70-81a3-2cb98b75c420 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:34.217566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd92fb0a-6b45-48e6-a53c-d9e63f225115 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:34.226996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c93c9-7324-4904-a0e8-814e5aad42f6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:34.229842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c93c9-7324-4904-a0e8-814e5aad42f6 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:34.230509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c93c9-7324-4904-a0e8-814e5aad42f6 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:34.230999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-414c93c9-7324-4904-a0e8-814e5aad42f6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:34.241086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-414c93c9-7324-4904-a0e8-814e5aad42f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:34.256741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c93c9-7324-4904-a0e8-814e5aad42f6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:34.258966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-414c93c9-7324-4904-a0e8-814e5aad42f6 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:34.302131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 852/1706] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:33 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:26:34.303528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c93c9-7324-4904-a0e8-814e5aad42f6 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:34.305822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-414c93c9-7324-4904-a0e8-814e5aad42f6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:34.340019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-414c93c9-7324-4904-a0e8-814e5aad42f6 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:34.356879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:34.357709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f0215d-e848-4e70-81a3-2cb98b75c420 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:34.358716 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:34.359229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:34.359706 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] PATH_INFO: `/v3/users/52f16522f7e44e5d9b48776867364a8f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:34.362486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] RBAC: Authorizing `identity:delete_user(user_id=52f16522f7e44e5d9b48776867364a8f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:34.371501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:34.379769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56063967-6650-4fdd-a271-4beca12aea96 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:34.380502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56063967-6650-4fdd-a271-4beca12aea96 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:34.386707 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56063967-6650-4fdd-a271-4beca12aea96 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:34.387140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56063967-6650-4fdd-a271-4beca12aea96 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:34.415304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56063967-6650-4fdd-a271-4beca12aea96 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:34.417470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56063967-6650-4fdd-a271-4beca12aea96 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:34.451023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 855/1707] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 349 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:26:34.538851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52f16522f7e44e5d9b48776867364a8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:34.539887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52f16522f7e44e5d9b48776867364a8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:34.567130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52f16522f7e44e5d9b48776867364a8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:34.568098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52f16522f7e44e5d9b48776867364a8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:34.576937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52f16522f7e44e5d9b48776867364a8f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:34.597209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 853/1708] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:34 2022] DELETE /identity/v3/users/52f16522f7e44e5d9b48776867364a8f => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:34.601902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6ac18-29d4-45c2-a6c8-0f927651ba39 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:34.604119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6ac18-29d4-45c2-a6c8-0f927651ba39 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:34.604979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae6ac18-29d4-45c2-a6c8-0f927651ba39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:34.647394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0ae6ac18-29d4-45c2-a6c8-0f927651ba39 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:34.650280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0ae6ac18-29d4-45c2-a6c8-0f927651ba39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:34.790891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:34.908579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 856/1709] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:34.952420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:34.960240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:35.153307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-600efbc1-caf9-4499-a968-e06b5a10934c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:35.167897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298aafc-594e-4758-8718-ee77cfcecf00 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:35.168226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298aafc-594e-4758-8718-ee77cfcecf00 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:35.168575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2298aafc-594e-4758-8718-ee77cfcecf00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:35.169926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94074183-dcb3-4568-becf-67fb403844e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:35.170576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94074183-dcb3-4568-becf-67fb403844e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:35.170948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94074183-dcb3-4568-becf-67fb403844e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:35.171234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94074183-dcb3-4568-becf-67fb403844e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:35.215842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94074183-dcb3-4568-becf-67fb403844e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:35.225967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94074183-dcb3-4568-becf-67fb403844e3 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:35.246516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2298aafc-594e-4758-8718-ee77cfcecf00 None None] MFA Rules not processed for user `da78d19e83fe41a99ae64d52d2d10d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:35.247839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2298aafc-594e-4758-8718-ee77cfcecf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:35.265097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 854/1710] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:35.452221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 857/1711] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 286 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:26:35.463458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88a895-cd5d-41aa-b4af-ec63cc67236b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:35.464515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88a895-cd5d-41aa-b4af-ec63cc67236b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:35.464951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d88a895-cd5d-41aa-b4af-ec63cc67236b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:35.520217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6d88a895-cd5d-41aa-b4af-ec63cc67236b None None] MFA Rules not processed for user `da78d19e83fe41a99ae64d52d2d10d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:35.521950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6d88a895-cd5d-41aa-b4af-ec63cc67236b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:35.540242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 855/1712] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:35 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:35.552906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298aafc-594e-4758-8718-ee77cfcecf00 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:35.554737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2298aafc-594e-4758-8718-ee77cfcecf00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:35.617921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbac8d-57b0-4cdc-afee-8c4d0f9c03bf None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:35.618422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbac8d-57b0-4cdc-afee-8c4d0f9c03bf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:35.618843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abbac8d-57b0-4cdc-afee-8c4d0f9c03bf None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:35.620882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 856/1713] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 24 14:26:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:26:35.633436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae3750-c698-4fbf-b0aa-98e02a0e78f9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:35.634104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae3750-c698-4fbf-b0aa-98e02a0e78f9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:35.634530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ae3750-c698-4fbf-b0aa-98e02a0e78f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:35.674278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:35.741315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-63ae3750-c698-4fbf-b0aa-98e02a0e78f9 None None] MFA Rules not processed for user `7014b2868d4b4acea242d068f247c21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:35.742595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-63ae3750-c698-4fbf-b0aa-98e02a0e78f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:35.772635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 857/1714] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:26:35 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) Sep 24 14:26:35.780554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae3750-c698-4fbf-b0aa-98e02a0e78f9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:35.782464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-63ae3750-c698-4fbf-b0aa-98e02a0e78f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:35.801032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ae3750-c698-4fbf-b0aa-98e02a0e78f9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:35.805346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2298aafc-594e-4758-8718-ee77cfcecf00 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:35.814022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd4800-df76-4747-a488-d0b509089370 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:35.814976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd4800-df76-4747-a488-d0b509089370 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:35.815508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd4800-df76-4747-a488-d0b509089370 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:35.815907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13dd4800-df76-4747-a488-d0b509089370 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:35.835601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cba264-b628-438a-818e-3a592a356e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:35.836750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cba264-b628-438a-818e-3a592a356e35 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:35.837531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cba264-b628-438a-818e-3a592a356e35 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:35.838271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cba264-b628-438a-818e-3a592a356e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:35.839019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd4800-df76-4747-a488-d0b509089370 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:35.843969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13dd4800-df76-4747-a488-d0b509089370 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:35.869012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cba264-b628-438a-818e-3a592a356e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:35.879689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cba264-b628-438a-818e-3a592a356e35 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:35.887107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 858/1715] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:35 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:26:35.917727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 858/1716] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:35 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:36.769332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd4800-df76-4747-a488-d0b509089370 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:36.770990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-13dd4800-df76-4747-a488-d0b509089370 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:36.962338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13dd4800-df76-4747-a488-d0b509089370 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:36.977570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0feee6b-cc0d-4edb-9635-ce17c630bc24 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc00e6583d7424cbdc13732a962fc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:36.978214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feee6b-cc0d-4edb-9635-ce17c630bc24 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:36.978497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feee6b-cc0d-4edb-9635-ce17c630bc24 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:36.978770 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0feee6b-cc0d-4edb-9635-ce17c630bc24 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:36.983151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c0feee6b-cc0d-4edb-9635-ce17c630bc24 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:37.005206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feee6b-cc0d-4edb-9635-ce17c630bc24 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:37.006839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0feee6b-cc0d-4edb-9635-ce17c630bc24 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:37.051591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 859/1717] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:36 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:37.219360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4a5b-bd95-43ad-b731-7d316059f5fc None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:37.220814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4a5b-bd95-43ad-b731-7d316059f5fc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:37.221241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3b4a5b-bd95-43ad-b731-7d316059f5fc None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:37.222818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 859/1718] 10.222.0.16 () {54 vars in 912 bytes} [Sat Sep 24 14:26:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:26:37.231306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e458d88-bf4d-4c8f-b419-b65fd838ff68 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:37.231306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e458d88-bf4d-4c8f-b419-b65fd838ff68 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:37.231306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e458d88-bf4d-4c8f-b419-b65fd838ff68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:37.270296 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9e458d88-bf4d-4c8f-b419-b65fd838ff68 None None] MFA Rules not processed for user `7014b2868d4b4acea242d068f247c21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:37.271601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9e458d88-bf4d-4c8f-b419-b65fd838ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:37.290744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 860/1719] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:26:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:37.317425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b4a5b-bd95-43ad-b731-7d316059f5fc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:37.336770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3b4a5b-bd95-43ad-b731-7d316059f5fc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:37.347617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548f68a-27ff-4a8d-b4ca-78c37db964dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:37.351148 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f68a-27ff-4a8d-b4ca-78c37db964dd service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:37.351432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f68a-27ff-4a8d-b4ca-78c37db964dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:37.351710 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3548f68a-27ff-4a8d-b4ca-78c37db964dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:37.371168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548f68a-27ff-4a8d-b4ca-78c37db964dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:37.377752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3548f68a-27ff-4a8d-b4ca-78c37db964dd service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:37.427443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 860/1720] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:37.546373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e458d88-bf4d-4c8f-b419-b65fd838ff68 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:37.548134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9e458d88-bf4d-4c8f-b419-b65fd838ff68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:37.578860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e458d88-bf4d-4c8f-b419-b65fd838ff68 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:37.594601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:37.596413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:37.596712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:37.596988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] PATH_INFO: `/v3/projects/1ff7744db36149968fd6e53f363d8dd2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:37.600766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ff7744db36149968fd6e53f363d8dd2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:37.605339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:37.705679 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548f68a-27ff-4a8d-b4ca-78c37db964dd service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:37.708170 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3548f68a-27ff-4a8d-b4ca-78c37db964dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:37.739471 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ff7744db36149968fd6e53f363d8dd2', 'request_id': 'req-13fad801-2b26-4e75-bebe-ad38bc3daa76'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:37.743156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3548f68a-27ff-4a8d-b4ca-78c37db964dd service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:37.778903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ff7744db36149968fd6e53f363d8dd2', 'request_id': 'req-13fad801-2b26-4e75-bebe-ad38bc3daa76'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:37.801921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ff7744db36149968fd6e53f363d8dd2', 'request_id': 'req-13fad801-2b26-4e75-bebe-ad38bc3daa76'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:37.825607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] The token cache is being invalidate because project 1ff7744db36149968fd6e53f363d8dd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:37.825915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:37.826655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-13fad801-2b26-4e75-bebe-ad38bc3daa76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:37.832840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 861/1721] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:37 2022] DELETE /identity/v3/projects/1ff7744db36149968fd6e53f363d8dd2 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:37.837815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5faf5a-164f-4450-bb40-054bd3a8e0b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:37.839008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5faf5a-164f-4450-bb40-054bd3a8e0b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:37.839418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5faf5a-164f-4450-bb40-054bd3a8e0b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:37.867989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:37.920374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6c5faf5a-164f-4450-bb40-054bd3a8e0b3 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:37.939356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6c5faf5a-164f-4450-bb40-054bd3a8e0b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:37.971863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:37.973841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:37.974125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:37.974399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] PATH_INFO: `/v3/projects/14918ad5aa614cdf9a4573ddf2bfacac` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:37.978174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] RBAC: Authorizing `identity:delete_project(project_id=14918ad5aa614cdf9a4573ddf2bfacac)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:37.989973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:37.992451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 862/1722] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:37.994840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af3675-2321-44ff-bcdc-aec6dc7c25aa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:38.000706 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af3675-2321-44ff-bcdc-aec6dc7c25aa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:38.001671 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0af3675-2321-44ff-bcdc-aec6dc7c25aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:38.045149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b0af3675-2321-44ff-bcdc-aec6dc7c25aa None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:38.048164 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b0af3675-2321-44ff-bcdc-aec6dc7c25aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:38.073687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 863/1723] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:38.074977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af3675-2321-44ff-bcdc-aec6dc7c25aa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:38.098281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0af3675-2321-44ff-bcdc-aec6dc7c25aa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:38.122709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae9806-8ca6-4600-9443-dcd09ba776f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:38.124276 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae9806-8ca6-4600-9443-dcd09ba776f4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:38.125361 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae9806-8ca6-4600-9443-dcd09ba776f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:38.126152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fae9806-8ca6-4600-9443-dcd09ba776f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:38.128865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae9806-8ca6-4600-9443-dcd09ba776f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:38.130305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae9806-8ca6-4600-9443-dcd09ba776f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:38.133839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fae9806-8ca6-4600-9443-dcd09ba776f4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:38.166783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 864/1724] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:38.174831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae9806-8ca6-4600-9443-dcd09ba776f4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:38.224965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14918ad5aa614cdf9a4573ddf2bfacac', 'request_id': 'req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:38.226698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fae9806-8ca6-4600-9443-dcd09ba776f4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:38.235643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14918ad5aa614cdf9a4573ddf2bfacac', 'request_id': 'req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:38.247143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14918ad5aa614cdf9a4573ddf2bfacac', 'request_id': 'req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:38.286131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] The token cache is being invalidate because project 14918ad5aa614cdf9a4573ddf2bfacac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:38.286598 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:38.287975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:38.293034 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 861/1725] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:37 2022] DELETE /identity/v3/projects/14918ad5aa614cdf9a4573ddf2bfacac => generated 0 bytes in 588 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:38.298252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:38.299261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:38.302121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:38.510675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d0716-e023-4934-b6ee-6ab7b09188dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:38.511326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d0716-e023-4934-b6ee-6ab7b09188dd admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:38.511615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d0716-e023-4934-b6ee-6ab7b09188dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:38.511885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a31d0716-e023-4934-b6ee-6ab7b09188dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:38.512868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d0716-e023-4934-b6ee-6ab7b09188dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:38.515208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a31d0716-e023-4934-b6ee-6ab7b09188dd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:38.623205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 865/1726] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:38 2022] POST /identity/v3/projects => generated 363 bytes in 452 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:38.628385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d0716-e023-4934-b6ee-6ab7b09188dd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:38.638164 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a31d0716-e023-4934-b6ee-6ab7b09188dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:38.754405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727c1809-7e5e-4fdc-8875-8fa0b8e1737c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:38.854904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a31d0716-e023-4934-b6ee-6ab7b09188dd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:38.896962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea20fc9-389b-43ab-9af9-e0ff7eec09a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:38.897613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea20fc9-389b-43ab-9af9-e0ff7eec09a6 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:38.897898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea20fc9-389b-43ab-9af9-e0ff7eec09a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:38.898177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea20fc9-389b-43ab-9af9-e0ff7eec09a6 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:38.898963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea20fc9-389b-43ab-9af9-e0ff7eec09a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:38.917331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea20fc9-389b-43ab-9af9-e0ff7eec09a6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:38.999931 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:39.000653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:39.002120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:39.003322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] PATH_INFO: `/v3/users/7d960e52706f4e319e1171cb316ecf41` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:39.007772 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d960e52706f4e319e1171cb316ecf41)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:39.015310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:39.026864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 866/1727] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:38 2022] POST /identity/v3/users => generated 282 bytes in 399 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:39.035295 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c9beb-6f8f-40dd-bc17-71d7131a4202 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:39.054203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c9beb-6f8f-40dd-bc17-71d7131a4202 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:39.054723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759c9beb-6f8f-40dd-bc17-71d7131a4202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:39.076121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:39.199328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-759c9beb-6f8f-40dd-bc17-71d7131a4202 None None] MFA Rules not processed for user `da78d19e83fe41a99ae64d52d2d10d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:39.201167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-759c9beb-6f8f-40dd-bc17-71d7131a4202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:39.214508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d960e52706f4e319e1171cb316ecf41'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:39.217966 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d960e52706f4e319e1171cb316ecf41'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:39.237095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d960e52706f4e319e1171cb316ecf41'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:39.294832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d960e52706f4e319e1171cb316ecf41'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:39.371835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d960e52706f4e319e1171cb316ecf41'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:39.413472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 862/1728] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:38 2022] DELETE /identity/v3/users/7d960e52706f4e319e1171cb316ecf41 => generated 0 bytes in 1115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:39.420429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:39.425480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:39.494289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 867/1729] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:39 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 460 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:39.810116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256b843e-889f-49ae-afa8-ca10f657653f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:39.827244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6fd16-8a1c-401c-838c-0f644c43b28b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:39.832903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6fd16-8a1c-401c-838c-0f644c43b28b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:39.834746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6fd16-8a1c-401c-838c-0f644c43b28b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:39.836188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa6fd16-8a1c-401c-838c-0f644c43b28b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:39.838233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6fd16-8a1c-401c-838c-0f644c43b28b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:39.848039 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa6fd16-8a1c-401c-838c-0f644c43b28b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:39.886701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 863/1730] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 468 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:39.891655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c9beb-6f8f-40dd-bc17-71d7131a4202 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:39.920017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759c9beb-6f8f-40dd-bc17-71d7131a4202 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:39.933259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41203a3f-1c7c-42f1-9d88-9358713d329b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:39.934389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41203a3f-1c7c-42f1-9d88-9358713d329b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:39.934389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41203a3f-1c7c-42f1-9d88-9358713d329b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:39.934612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41203a3f-1c7c-42f1-9d88-9358713d329b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:39.935079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41203a3f-1c7c-42f1-9d88-9358713d329b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:39.936782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41203a3f-1c7c-42f1-9d88-9358713d329b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:39.991412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 868/1731] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:39.997467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6fd16-8a1c-401c-838c-0f644c43b28b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:40.046816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa6fd16-8a1c-401c-838c-0f644c43b28b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:40.066635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5de4b9-5c55-4389-b62f-2669d8611124 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:40.067710 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de4b9-5c55-4389-b62f-2669d8611124 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:40.069439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de4b9-5c55-4389-b62f-2669d8611124 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:40.069761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5de4b9-5c55-4389-b62f-2669d8611124 admin admin] PATH_INFO: `/v3/projects/e8ce4f43644545d3b10fff6a1b4d0a9e/users/9bcd9d0b45274953b18b56fff91137e4/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:40.110263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00efd-cdd1-4945-a1b0-6d816379cd5b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:40.110554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00efd-cdd1-4945-a1b0-6d816379cd5b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:40.110833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e00efd-cdd1-4945-a1b0-6d816379cd5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:40.171606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5de4b9-5c55-4389-b62f-2669d8611124 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8ce4f43644545d3b10fff6a1b4d0a9e, user_id=9bcd9d0b45274953b18b56fff91137e4, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:40.180939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5de4b9-5c55-4389-b62f-2669d8611124 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:40.181334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b8e00efd-cdd1-4945-a1b0-6d816379cd5b None None] MFA Rules not processed for user `40f99377b0134e59802907c55b1c6949`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:40.185189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8e00efd-cdd1-4945-a1b0-6d816379cd5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:40.216580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 864/1732] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:39 2022] PUT /identity/v3/projects/e8ce4f43644545d3b10fff6a1b4d0a9e/users/9bcd9d0b45274953b18b56fff91137e4/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:40.231617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6cdab-cc6b-44a9-9708-330fc44ada43 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:40.232414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6cdab-cc6b-44a9-9708-330fc44ada43 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:40.232866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca6cdab-cc6b-44a9-9708-330fc44ada43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:40.258033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:40.348173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-aca6cdab-cc6b-44a9-9708-330fc44ada43 None None] MFA Rules not processed for user `9bcd9d0b45274953b18b56fff91137e4`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:40.349916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aca6cdab-cc6b-44a9-9708-330fc44ada43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:40.406007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 869/1733] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:26:40.618921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=9,keystone:SELECT=89,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:40.664532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e00efd-cdd1-4945-a1b0-6d816379cd5b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:40.665605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 865/1734] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:40 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 436 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:40.687650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e00efd-cdd1-4945-a1b0-6d816379cd5b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:40.831391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481bb90-cfdb-4e14-bcdd-3a80c0eb3714 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:40.832355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481bb90-cfdb-4e14-bcdd-3a80c0eb3714 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:40.832801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481bb90-cfdb-4e14-bcdd-3a80c0eb3714 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:40.833711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f481bb90-cfdb-4e14-bcdd-3a80c0eb3714 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:40.834533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481bb90-cfdb-4e14-bcdd-3a80c0eb3714 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:40.840684 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f481bb90-cfdb-4e14-bcdd-3a80c0eb3714 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:40.903942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 870/1735] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:40 2022] POST /identity/v3/projects => generated 365 bytes in 240 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:26:40.908972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6cdab-cc6b-44a9-9708-330fc44ada43 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:40.932940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca6cdab-cc6b-44a9-9708-330fc44ada43 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:41.150273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629e690-6ead-4260-b620-3690118fe26e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:41.151279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629e690-6ead-4260-b620-3690118fe26e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:41.151849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629e690-6ead-4260-b620-3690118fe26e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:41.152473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8629e690-6ead-4260-b620-3690118fe26e admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:41.153715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629e690-6ead-4260-b620-3690118fe26e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:41.155868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8629e690-6ead-4260-b620-3690118fe26e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:41.256646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481bb90-cfdb-4e14-bcdd-3a80c0eb3714 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:41.269655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 866/1736] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:40 2022] POST /identity/v3/users => generated 289 bytes in 360 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:41.276114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f481bb90-cfdb-4e14-bcdd-3a80c0eb3714 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:41.288536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4838d-55fb-4cb6-bb35-e60cd627e82b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:41.296615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4838d-55fb-4cb6-bb35-e60cd627e82b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:41.297218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4838d-55fb-4cb6-bb35-e60cd627e82b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:41.298315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da4838d-55fb-4cb6-bb35-e60cd627e82b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:41.299797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4838d-55fb-4cb6-bb35-e60cd627e82b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:41.304182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6da4838d-55fb-4cb6-bb35-e60cd627e82b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:41.325103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 871/1737] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:26:41.329467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629e690-6ead-4260-b620-3690118fe26e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:41.347832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8629e690-6ead-4260-b620-3690118fe26e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:41.359412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfca2d5-ba4c-4c54-bc7e-f9e9b2df02c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:41.360252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfca2d5-ba4c-4c54-bc7e-f9e9b2df02c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:41.360587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfca2d5-ba4c-4c54-bc7e-f9e9b2df02c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:41.361066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfca2d5-ba4c-4c54-bc7e-f9e9b2df02c1 admin admin] PATH_INFO: `/v3/projects/7ce65948e0b54597a217baaf1d117537/users/a19e48a4f0cb40f18f026cb3c38816b6/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:41.394699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfca2d5-ba4c-4c54-bc7e-f9e9b2df02c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce65948e0b54597a217baaf1d117537, user_id=a19e48a4f0cb40f18f026cb3c38816b6, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:41.398249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfca2d5-ba4c-4c54-bc7e-f9e9b2df02c1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:41.442032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 867/1738] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:41 2022] PUT /identity/v3/projects/7ce65948e0b54597a217baaf1d117537/users/a19e48a4f0cb40f18f026cb3c38816b6/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:41.453118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4838d-55fb-4cb6-bb35-e60cd627e82b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:41.477381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da4838d-55fb-4cb6-bb35-e60cd627e82b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:41.690467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec63e89-44af-4e4b-92aa-39d6728219c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:41.691694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec63e89-44af-4e4b-92aa-39d6728219c2 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:41.695417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec63e89-44af-4e4b-92aa-39d6728219c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:41.696095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec63e89-44af-4e4b-92aa-39d6728219c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:41.700265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec63e89-44af-4e4b-92aa-39d6728219c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:41.703690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec63e89-44af-4e4b-92aa-39d6728219c2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:41.753557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 872/1739] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:41 2022] GET /identity/v3/roles => generated 1420 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:41.754930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfca2d5-ba4c-4c54-bc7e-f9e9b2df02c1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:41.774117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfca2d5-ba4c-4c54-bc7e-f9e9b2df02c1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:41.787447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdac9e32-7d5e-4e4d-90db-dd32f557c20e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:41.788365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac9e32-7d5e-4e4d-90db-dd32f557c20e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:41.788736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac9e32-7d5e-4e4d-90db-dd32f557c20e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:41.789251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdac9e32-7d5e-4e4d-90db-dd32f557c20e admin admin] PATH_INFO: `/v3/projects/7ce65948e0b54597a217baaf1d117537/users/a19e48a4f0cb40f18f026cb3c38816b6/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:41.793174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac9e32-7d5e-4e4d-90db-dd32f557c20e admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ce65948e0b54597a217baaf1d117537, user_id=a19e48a4f0cb40f18f026cb3c38816b6, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:41.799133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdac9e32-7d5e-4e4d-90db-dd32f557c20e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:41.837484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 868/1740] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:41 2022] PUT /identity/v3/projects/7ce65948e0b54597a217baaf1d117537/users/a19e48a4f0cb40f18f026cb3c38816b6/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:41.839851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743c31-af37-4b5a-a67d-7968e9fd18e7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:41.840140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743c31-af37-4b5a-a67d-7968e9fd18e7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:41.840656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65743c31-af37-4b5a-a67d-7968e9fd18e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:41.875216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6a40-a43a-4db9-a2d8-6021dc1b933b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:41.875503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6a40-a43a-4db9-a2d8-6021dc1b933b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:41.875810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8c6a40-a43a-4db9-a2d8-6021dc1b933b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:41.947199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-65743c31-af37-4b5a-a67d-7968e9fd18e7 None None] MFA Rules not processed for user `a19e48a4f0cb40f18f026cb3c38816b6`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:41.962043 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-65743c31-af37-4b5a-a67d-7968e9fd18e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:42.014755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-1e8c6a40-a43a-4db9-a2d8-6021dc1b933b None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:42.015908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e8c6a40-a43a-4db9-a2d8-6021dc1b933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:42.154924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:42.256728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 869/1741] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 382 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:42.257907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c6a40-a43a-4db9-a2d8-6021dc1b933b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:42.264086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1e8c6a40-a43a-4db9-a2d8-6021dc1b933b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:42.321943 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:42.386259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 873/1742] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:41 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 548 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:26:42.398755 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65743c31-af37-4b5a-a67d-7968e9fd18e7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:42.405223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-65743c31-af37-4b5a-a67d-7968e9fd18e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:42.460241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8c6a40-a43a-4db9-a2d8-6021dc1b933b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:42.476864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:42.477708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:42.478096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:42.478477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] PATH_INFO: `/v3/projects/cd0acbb2cb3f4f9988ae80f1fc48df62` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:42.481298 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd0acbb2cb3f4f9988ae80f1fc48df62)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:42.485540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:42.732518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65743c31-af37-4b5a-a67d-7968e9fd18e7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:42.750728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd0acbb2cb3f4f9988ae80f1fc48df62', 'request_id': 'req-274d2a43-9503-403e-9a78-674a3f3d10f0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:42.786770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd0acbb2cb3f4f9988ae80f1fc48df62', 'request_id': 'req-274d2a43-9503-403e-9a78-674a3f3d10f0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:42.806617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd0acbb2cb3f4f9988ae80f1fc48df62', 'request_id': 'req-274d2a43-9503-403e-9a78-674a3f3d10f0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:42.841418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] The token cache is being invalidate because project cd0acbb2cb3f4f9988ae80f1fc48df62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:42.841961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:42.848777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-274d2a43-9503-403e-9a78-674a3f3d10f0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:42.857533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 870/1743] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:42 2022] DELETE /identity/v3/projects/cd0acbb2cb3f4f9988ae80f1fc48df62 => generated 0 bytes in 600 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:42.858865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d559165-0783-4262-a4c5-89e965c769dd None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:42.859160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d559165-0783-4262-a4c5-89e965c769dd None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:42.859498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d559165-0783-4262-a4c5-89e965c769dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:42.882773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b6148-b0cb-48d6-ae20-b93aa5dac28c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:42.883196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b6148-b0cb-48d6-ae20-b93aa5dac28c service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:42.883547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b6148-b0cb-48d6-ae20-b93aa5dac28c service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:42.883915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45b6148-b0cb-48d6-ae20-b93aa5dac28c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:42.890582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f45b6148-b0cb-48d6-ae20-b93aa5dac28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:42.909516 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9d559165-0783-4262-a4c5-89e965c769dd None None] MFA Rules not processed for user `5a3a7f87ef4349eb9b21745be3a6b8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:42.910810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9d559165-0783-4262-a4c5-89e965c769dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:43.094848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b6148-b0cb-48d6-ae20-b93aa5dac28c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:43.101148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45b6148-b0cb-48d6-ae20-b93aa5dac28c service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:43.151076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 874/1744] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:42 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 753 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:26:43.156087 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b6148-b0cb-48d6-ae20-b93aa5dac28c service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:43.163634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f45b6148-b0cb-48d6-ae20-b93aa5dac28c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:43.189831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 871/1745] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 327 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:43.189831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24228d73-6639-4e98-b074-63eab9a6911a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:43.189831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24228d73-6639-4e98-b074-63eab9a6911a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:43.189831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24228d73-6639-4e98-b074-63eab9a6911a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:43.229563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-24228d73-6639-4e98-b074-63eab9a6911a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:43.230984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-24228d73-6639-4e98-b074-63eab9a6911a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:43.288994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:43.388370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:43.432834 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 872/1746] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:43.449648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8960b-d642-4f9b-b4f4-ac7e5a49abfe None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:43.449648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8960b-d642-4f9b-b4f4-ac7e5a49abfe None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:43.449945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceb8960b-d642-4f9b-b4f4-ac7e5a49abfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:43.511148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45b6148-b0cb-48d6-ae20-b93aa5dac28c service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:43.528571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ceb8960b-d642-4f9b-b4f4-ac7e5a49abfe None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:43.530618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ceb8960b-d642-4f9b-b4f4-ac7e5a49abfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:43.547897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2614b9-e46f-4479-93e0-3c35451616fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:43.548733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2614b9-e46f-4479-93e0-3c35451616fc service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:43.548733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2614b9-e46f-4479-93e0-3c35451616fc service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:43.550122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2614b9-e46f-4479-93e0-3c35451616fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:43.580539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2d2614b9-e46f-4479-93e0-3c35451616fc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:43.597005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 873/1747] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:43.601358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8960b-d642-4f9b-b4f4-ac7e5a49abfe None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:43.644741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceb8960b-d642-4f9b-b4f4-ac7e5a49abfe None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:43.668953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cd13f-116e-461c-8248-889fb317cedb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:43.669784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd13f-116e-461c-8248-889fb317cedb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:43.670417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd13f-116e-461c-8248-889fb317cedb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:43.670911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc4cd13f-116e-461c-8248-889fb317cedb admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:43.672926 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cd13f-116e-461c-8248-889fb317cedb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:43.673404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cd13f-116e-461c-8248-889fb317cedb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:43.676049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc4cd13f-116e-461c-8248-889fb317cedb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:43.716235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 874/1748] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:43.721389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cd13f-116e-461c-8248-889fb317cedb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:43.787208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2614b9-e46f-4479-93e0-3c35451616fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:43.793119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2614b9-e46f-4479-93e0-3c35451616fc service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:43.793437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc4cd13f-116e-461c-8248-889fb317cedb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:43.827380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992ef97d-1b6d-4125-a3aa-1927b4b4da09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:43.830265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ef97d-1b6d-4125-a3aa-1927b4b4da09 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:43.830556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ef97d-1b6d-4125-a3aa-1927b4b4da09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:43.832767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992ef97d-1b6d-4125-a3aa-1927b4b4da09 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:43.835784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ef97d-1b6d-4125-a3aa-1927b4b4da09 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:43.845663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992ef97d-1b6d-4125-a3aa-1927b4b4da09 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:43.847840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 875/1749] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:26:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 696 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:26:43.920600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2614b9-e46f-4479-93e0-3c35451616fc service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:43.929192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 875/1750] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:43 2022] POST /identity/v3/projects => generated 371 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:43.941929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2614b9-e46f-4479-93e0-3c35451616fc service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:44.187509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85d45f-4975-43f8-b650-5416a70e5e4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:44.190318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d45f-4975-43f8-b650-5416a70e5e4e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:44.190988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d45f-4975-43f8-b650-5416a70e5e4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:44.191876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba85d45f-4975-43f8-b650-5416a70e5e4e admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:44.193160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85d45f-4975-43f8-b650-5416a70e5e4e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:44.198298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba85d45f-4975-43f8-b650-5416a70e5e4e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:44.265885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9928f-cc7f-4f24-afff-89c2d15e3e41 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:44.266827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9928f-cc7f-4f24-afff-89c2d15e3e41 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:44.267393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf9928f-cc7f-4f24-afff-89c2d15e3e41 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:44.290723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 876/1751] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:43 2022] POST /identity/v3/users => generated 286 bytes in 371 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:44.296567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85d45f-4975-43f8-b650-5416a70e5e4e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:44.326239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba85d45f-4975-43f8-b650-5416a70e5e4e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:44.333844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ccf9928f-cc7f-4f24-afff-89c2d15e3e41 None None] MFA Rules not processed for user `e1fcaec552f7441f941b6c1bd6b5bdac`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:44.335153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ccf9928f-cc7f-4f24-afff-89c2d15e3e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:44.339951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799d5fe-debb-403c-80be-12ae73deca43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:44.340663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799d5fe-debb-403c-80be-12ae73deca43 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:44.340943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799d5fe-debb-403c-80be-12ae73deca43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:44.341220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6799d5fe-debb-403c-80be-12ae73deca43 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:44.341879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799d5fe-debb-403c-80be-12ae73deca43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:44.343518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6799d5fe-debb-403c-80be-12ae73deca43 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:44.422621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 877/1752] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:44.428969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799d5fe-debb-403c-80be-12ae73deca43 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:44.477742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6799d5fe-debb-403c-80be-12ae73deca43 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:44.500487 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05573b-285a-411a-8b23-c94223a04196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:44.500979 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05573b-285a-411a-8b23-c94223a04196 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:44.506162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05573b-285a-411a-8b23-c94223a04196 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:44.506461 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc05573b-285a-411a-8b23-c94223a04196 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:44.507352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05573b-285a-411a-8b23-c94223a04196 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:44.517927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc05573b-285a-411a-8b23-c94223a04196 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:44.558962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 878/1753] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:44 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:44.560100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05573b-285a-411a-8b23-c94223a04196 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:44.591626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc05573b-285a-411a-8b23-c94223a04196 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:44.627805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1603cfcf-4107-4034-af28-59e4c3b26f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:44.628951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603cfcf-4107-4034-af28-59e4c3b26f56 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:44.629442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603cfcf-4107-4034-af28-59e4c3b26f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:44.631898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1603cfcf-4107-4034-af28-59e4c3b26f56 admin admin] PATH_INFO: `/v3/projects/11f2b6190c664a8f84584afc0fe5a710/users/5ced4364f1bc464287b959bd4f1c6158/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:44.665403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 876/1754] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:44.670052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9928f-cc7f-4f24-afff-89c2d15e3e41 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:44.682076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ccf9928f-cc7f-4f24-afff-89c2d15e3e41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:44.708771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603cfcf-4107-4034-af28-59e4c3b26f56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f2b6190c664a8f84584afc0fe5a710, user_id=5ced4364f1bc464287b959bd4f1c6158, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:44.720174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1603cfcf-4107-4034-af28-59e4c3b26f56 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:44.729128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:44.755370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf9928f-cc7f-4f24-afff-89c2d15e3e41 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:44.768760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 879/1755] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:44 2022] PUT /identity/v3/projects/11f2b6190c664a8f84584afc0fe5a710/users/5ced4364f1bc464287b959bd4f1c6158/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:44.779242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce17fe-9eef-4051-88be-a51e32adf0de None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:44.779242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce17fe-9eef-4051-88be-a51e32adf0de None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:44.779242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cce17fe-9eef-4051-88be-a51e32adf0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:44.848891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2cce17fe-9eef-4051-88be-a51e32adf0de None None] MFA Rules not processed for user `5ced4364f1bc464287b959bd4f1c6158`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:44.850569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2cce17fe-9eef-4051-88be-a51e32adf0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:45.061341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 880/1756] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:44 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:45.069360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce17fe-9eef-4051-88be-a51e32adf0de None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:45.085797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:45.086469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:45.086748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:45.087028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] PATH_INFO: `/v3/users/9bcd9d0b45274953b18b56fff91137e4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:45.089402 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] RBAC: Authorizing `identity:delete_user(user_id=9bcd9d0b45274953b18b56fff91137e4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:45.094343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:45.262730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9bcd9d0b45274953b18b56fff91137e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:45.264401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9bcd9d0b45274953b18b56fff91137e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:45.265509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9bcd9d0b45274953b18b56fff91137e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:45.266342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cce17fe-9eef-4051-88be-a51e32adf0de None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:45.288044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9bcd9d0b45274953b18b56fff91137e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:45.290489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e175151-f293-4b9a-b4ff-71e490b343c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:45.291205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e175151-f293-4b9a-b4ff-71e490b343c8 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:45.292002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e175151-f293-4b9a-b4ff-71e490b343c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:45.292329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e175151-f293-4b9a-b4ff-71e490b343c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:45.293028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e175151-f293-4b9a-b4ff-71e490b343c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:45.308745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e175151-f293-4b9a-b4ff-71e490b343c8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:45.319416 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:45.340829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-b3992fe9-e34a-4f4f-9ff6-20dc75f4182c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9bcd9d0b45274953b18b56fff91137e4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:45.424816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 881/1757] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:45 2022] POST /identity/v3/projects => generated 371 bytes in 355 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:45.425769 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e175151-f293-4b9a-b4ff-71e490b343c8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:45.428936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7e175151-f293-4b9a-b4ff-71e490b343c8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:45.429898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 877/1758] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:44 2022] DELETE /identity/v3/users/9bcd9d0b45274953b18b56fff91137e4 => generated 0 bytes in 760 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:45.435191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6a57-3abe-4a79-87d6-6b0d5fd949fc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:45.435784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6a57-3abe-4a79-87d6-6b0d5fd949fc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:45.436348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0add6a57-3abe-4a79-87d6-6b0d5fd949fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:45.481853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0add6a57-3abe-4a79-87d6-6b0d5fd949fc None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:45.486443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0add6a57-3abe-4a79-87d6-6b0d5fd949fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:45.674919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e175151-f293-4b9a-b4ff-71e490b343c8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:45.723733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:45.730834 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 878/1759] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:26:45.776942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6a57-3abe-4a79-87d6-6b0d5fd949fc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:45.781856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0add6a57-3abe-4a79-87d6-6b0d5fd949fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:45.917231 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e07246-fc64-4b88-8498-1713ded27fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:45.919372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e07246-fc64-4b88-8498-1713ded27fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:45.924635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e07246-fc64-4b88-8498-1713ded27fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:45.925716 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e07246-fc64-4b88-8498-1713ded27fd8 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:45.927303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e07246-fc64-4b88-8498-1713ded27fd8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:45.935032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e07246-fc64-4b88-8498-1713ded27fd8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:45.943139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0add6a57-3abe-4a79-87d6-6b0d5fd949fc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:45.948682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ab589-317f-42ec-ae67-78dd8452db89 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:45.949368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab589-317f-42ec-ae67-78dd8452db89 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:45.949726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab589-317f-42ec-ae67-78dd8452db89 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:45.950006 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4ab589-317f-42ec-ae67-78dd8452db89 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:45.974781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ab589-317f-42ec-ae67-78dd8452db89 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:45.976267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4ab589-317f-42ec-ae67-78dd8452db89 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:46.008995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 879/1760] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:26:46.019837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ab589-317f-42ec-ae67-78dd8452db89 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:46.020890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 882/1761] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:45 2022] POST /identity/v3/users => generated 292 bytes in 595 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:46.035826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4ab589-317f-42ec-ae67-78dd8452db89 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:46.050203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da417-e653-467b-89cd-8d8d5ae6bdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:46.050845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da417-e653-467b-89cd-8d8d5ae6bdd7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:46.051126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da417-e653-467b-89cd-8d8d5ae6bdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:46.051406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49da417-e653-467b-89cd-8d8d5ae6bdd7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:46.052074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49da417-e653-467b-89cd-8d8d5ae6bdd7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:46.065124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49da417-e653-467b-89cd-8d8d5ae6bdd7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:46.085493 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 880/1762] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:46.087517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e07246-fc64-4b88-8498-1713ded27fd8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:46.111589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e07246-fc64-4b88-8498-1713ded27fd8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:46.128177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aaf17-6ef2-4c96-afac-5ed5f1ceea7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:46.128982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aaf17-6ef2-4c96-afac-5ed5f1ceea7a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:46.129792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aaf17-6ef2-4c96-afac-5ed5f1ceea7a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:46.131771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574aaf17-6ef2-4c96-afac-5ed5f1ceea7a admin admin] PATH_INFO: `/v3/projects/86b9ae96906e4c91b71975a0e138d442/users/4b21e583a25d47ffb673a4a51dd08d34/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:46.185170 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574aaf17-6ef2-4c96-afac-5ed5f1ceea7a admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b9ae96906e4c91b71975a0e138d442, user_id=4b21e583a25d47ffb673a4a51dd08d34, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:46.194811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574aaf17-6ef2-4c96-afac-5ed5f1ceea7a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:46.236181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 883/1763] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:46 2022] PUT /identity/v3/projects/86b9ae96906e4c91b71975a0e138d442/users/4b21e583a25d47ffb673a4a51dd08d34/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:46.237563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da417-e653-467b-89cd-8d8d5ae6bdd7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:46.253683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49da417-e653-467b-89cd-8d8d5ae6bdd7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:46.461677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3934577e-6eb5-4797-bca6-e1c2326779ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:46.462367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934577e-6eb5-4797-bca6-e1c2326779ca admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:46.462650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934577e-6eb5-4797-bca6-e1c2326779ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:46.477269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3934577e-6eb5-4797-bca6-e1c2326779ca admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:46.478023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934577e-6eb5-4797-bca6-e1c2326779ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:46.479759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3934577e-6eb5-4797-bca6-e1c2326779ca admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:46.502888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 881/1764] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:46 2022] GET /identity/v3/roles => generated 1420 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:46.507397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aaf17-6ef2-4c96-afac-5ed5f1ceea7a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:46.519614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574aaf17-6ef2-4c96-afac-5ed5f1ceea7a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:46.538782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71756c69-90e8-44fe-9d05-8d8fdb75a734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:46.540023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756c69-90e8-44fe-9d05-8d8fdb75a734 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:46.540551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756c69-90e8-44fe-9d05-8d8fdb75a734 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:46.541127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71756c69-90e8-44fe-9d05-8d8fdb75a734 admin admin] PATH_INFO: `/v3/projects/86b9ae96906e4c91b71975a0e138d442/users/4b21e583a25d47ffb673a4a51dd08d34/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:46.547942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71756c69-90e8-44fe-9d05-8d8fdb75a734 admin admin] RBAC: Authorizing `identity:create_grant(project_id=86b9ae96906e4c91b71975a0e138d442, user_id=4b21e583a25d47ffb673a4a51dd08d34, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:46.561712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71756c69-90e8-44fe-9d05-8d8fdb75a734 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:46.609942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 884/1765] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:46 2022] PUT /identity/v3/projects/86b9ae96906e4c91b71975a0e138d442/users/4b21e583a25d47ffb673a4a51dd08d34/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:46.622156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053da5-4fa5-4f59-b262-150360bf5f87 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:46.624903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053da5-4fa5-4f59-b262-150360bf5f87 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:46.624903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89053da5-4fa5-4f59-b262-150360bf5f87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:46.656363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=3,keystone:SELECT=96,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:46.703522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-89053da5-4fa5-4f59-b262-150360bf5f87 None None] MFA Rules not processed for user `4b21e583a25d47ffb673a4a51dd08d34`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:46.708009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-89053da5-4fa5-4f59-b262-150360bf5f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:46.957287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacf36-43c0-4751-bb27-acfffb515670 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:46.957607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacf36-43c0-4751-bb27-acfffb515670 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:46.957905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40aacf36-43c0-4751-bb27-acfffb515670 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:47.012966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-40aacf36-43c0-4751-bb27-acfffb515670 None None] MFA Rules not processed for user `7014b2868d4b4acea242d068f247c21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:47.014656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-40aacf36-43c0-4751-bb27-acfffb515670 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:47.041860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 882/1766] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:46 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 422 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:47.046722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89053da5-4fa5-4f59-b262-150360bf5f87 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:47.053479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-89053da5-4fa5-4f59-b262-150360bf5f87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:47.241827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 885/1767] 10.222.0.18 () {58 vars in 1015 bytes} [Sat Sep 24 14:26:46 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:47.258152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89053da5-4fa5-4f59-b262-150360bf5f87 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:47.264661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ffbf-78dd-4b37-9055-1c4b3f5db3cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:47.265881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ffbf-78dd-4b37-9055-1c4b3f5db3cc service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:47.266389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ffbf-78dd-4b37-9055-1c4b3f5db3cc service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:47.266853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b3ffbf-78dd-4b37-9055-1c4b3f5db3cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:47.279772 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ffbf-78dd-4b37-9055-1c4b3f5db3cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:47.282270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b3ffbf-78dd-4b37-9055-1c4b3f5db3cc service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:47.296283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 883/1768] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:47 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 253 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:47.459185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacf36-43c0-4751-bb27-acfffb515670 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:47.494336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40aacf36-43c0-4751-bb27-acfffb515670 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:47.499111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83a73-81cf-48ba-ad22-41c62be115a1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:47.499992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83a73-81cf-48ba-ad22-41c62be115a1 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:47.500475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83a73-81cf-48ba-ad22-41c62be115a1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:47.500895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df83a73-81cf-48ba-ad22-41c62be115a1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:47.503523 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2df83a73-81cf-48ba-ad22-41c62be115a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:47.632872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df83a73-81cf-48ba-ad22-41c62be115a1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:47.634354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df83a73-81cf-48ba-ad22-41c62be115a1 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:47.673595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 886/1769] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:47 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:47.752479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ffbf-78dd-4b37-9055-1c4b3f5db3cc service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:47.755507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-21b3ffbf-78dd-4b37-9055-1c4b3f5db3cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:47.786496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b3ffbf-78dd-4b37-9055-1c4b3f5db3cc service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:47.842117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05ad156f-17fc-4af3-a763-cb5856a38784 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:47.845948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad156f-17fc-4af3-a763-cb5856a38784 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:47.847823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad156f-17fc-4af3-a763-cb5856a38784 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:47.848523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05ad156f-17fc-4af3-a763-cb5856a38784 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:47.893533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad156f-17fc-4af3-a763-cb5856a38784 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:47.901274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05ad156f-17fc-4af3-a763-cb5856a38784 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:47.936578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 884/1770] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:47 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 185 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:49.024710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83a73-81cf-48ba-ad22-41c62be115a1 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:49.027113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2df83a73-81cf-48ba-ad22-41c62be115a1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:49.100229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:49.226731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df83a73-81cf-48ba-ad22-41c62be115a1 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:49.246135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:49.249504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:49.250385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:49.251392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] PATH_INFO: `/v3/users/640bf745e3824bfd9f2f9a076c2e1da0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:49.256779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] RBAC: Authorizing `identity:delete_user(user_id=640bf745e3824bfd9f2f9a076c2e1da0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:49.266976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:49.407061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '640bf745e3824bfd9f2f9a076c2e1da0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:49.407882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '640bf745e3824bfd9f2f9a076c2e1da0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:49.460889 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '640bf745e3824bfd9f2f9a076c2e1da0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:49.462290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '640bf745e3824bfd9f2f9a076c2e1da0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:49.510663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '640bf745e3824bfd9f2f9a076c2e1da0'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:49.539114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 887/1771] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:49 2022] DELETE /identity/v3/users/640bf745e3824bfd9f2f9a076c2e1da0 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:49.543600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629e5e9-25c1-4f6f-987b-1e32899b32b8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:49.544187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629e5e9-25c1-4f6f-987b-1e32899b32b8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:49.544187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f629e5e9-25c1-4f6f-987b-1e32899b32b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:49.626523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f629e5e9-25c1-4f6f-987b-1e32899b32b8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:49.633128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f629e5e9-25c1-4f6f-987b-1e32899b32b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:49.874457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 885/1772] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 333 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:50.032609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:50.034090 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:50.151446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629e5e9-25c1-4f6f-987b-1e32899b32b8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:50.153158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f629e5e9-25c1-4f6f-987b-1e32899b32b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:50.187471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f629e5e9-25c1-4f6f-987b-1e32899b32b8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:50.206406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:50.210171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:50.210646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:50.210943 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] PATH_INFO: `/v3/projects/e8ce4f43644545d3b10fff6a1b4d0a9e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:50.217262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8ce4f43644545d3b10fff6a1b4d0a9e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:50.219723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:50.249622 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d73058-e5ad-4f1f-9472-4e139550b083 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:50.256142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f6c25-087d-4bd7-8258-9f53edfe7053 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:50.256837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f6c25-087d-4bd7-8258-9f53edfe7053 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:50.257113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f6c25-087d-4bd7-8258-9f53edfe7053 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:50.257391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae7f6c25-087d-4bd7-8258-9f53edfe7053 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:50.283341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f6c25-087d-4bd7-8258-9f53edfe7053 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:50.285905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae7f6c25-087d-4bd7-8258-9f53edfe7053 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:50.306222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 888/1773] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:26:50.345281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:50.566042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8ce4f43644545d3b10fff6a1b4d0a9e', 'request_id': 'req-f7dcde14-083b-406c-bfa1-d18352ff30fa'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:50.608261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8ce4f43644545d3b10fff6a1b4d0a9e', 'request_id': 'req-f7dcde14-083b-406c-bfa1-d18352ff30fa'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:50.649401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8ce4f43644545d3b10fff6a1b4d0a9e', 'request_id': 'req-f7dcde14-083b-406c-bfa1-d18352ff30fa'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:50.751884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] The token cache is being invalidate because project e8ce4f43644545d3b10fff6a1b4d0a9e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:50.752425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:50.755126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f7dcde14-083b-406c-bfa1-d18352ff30fa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:50.765293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 886/1774] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:50 2022] DELETE /identity/v3/projects/e8ce4f43644545d3b10fff6a1b4d0a9e => generated 0 bytes in 610 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:50.771364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f6c25-087d-4bd7-8258-9f53edfe7053 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:50.861453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae7f6c25-087d-4bd7-8258-9f53edfe7053 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:51.235051 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:51.387543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:51.398064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:51.398064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:51.398064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] PATH_INFO: `/v3/users/a19e48a4f0cb40f18f026cb3c38816b6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:51.400196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a19e48a4f0cb40f18f026cb3c38816b6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:51.403979 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:51.627682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a19e48a4f0cb40f18f026cb3c38816b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:51.628916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a19e48a4f0cb40f18f026cb3c38816b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:51.644379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a19e48a4f0cb40f18f026cb3c38816b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:51.645639 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a19e48a4f0cb40f18f026cb3c38816b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:51.656862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11e2f1cd-5d3f-4e24-a020-f9e92f05a320 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a19e48a4f0cb40f18f026cb3c38816b6'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:51.699259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 889/1775] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:50 2022] DELETE /identity/v3/users/a19e48a4f0cb40f18f026cb3c38816b6 => generated 0 bytes in 931 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:52.786758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d60ce2-898a-4a15-b6b7-ef69b394a2b2 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:52.787830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d60ce2-898a-4a15-b6b7-ef69b394a2b2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:52.788354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d60ce2-898a-4a15-b6b7-ef69b394a2b2 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:52.789934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 887/1776] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:26:53.129544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2399d-0549-4a74-8845-7fedefe7934b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:53.129544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2399d-0549-4a74-8845-7fedefe7934b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:53.130205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c2399d-0549-4a74-8845-7fedefe7934b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:53.174501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-37c2399d-0549-4a74-8845-7fedefe7934b None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:53.177584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-37c2399d-0549-4a74-8845-7fedefe7934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:53.434447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 890/1777] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:26:53 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:53.814826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d60ce2-898a-4a15-b6b7-ef69b394a2b2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:53.817296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-90d60ce2-898a-4a15-b6b7-ef69b394a2b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:53.883901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d60ce2-898a-4a15-b6b7-ef69b394a2b2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:53.899249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fb0bc-d4ce-481c-838e-78ad96daaa4d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:53.900069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fb0bc-d4ce-481c-838e-78ad96daaa4d service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:53.900518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fb0bc-d4ce-481c-838e-78ad96daaa4d service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:53.901242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981fb0bc-d4ce-481c-838e-78ad96daaa4d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:53.923965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fb0bc-d4ce-481c-838e-78ad96daaa4d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:53.925683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-981fb0bc-d4ce-481c-838e-78ad96daaa4d service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:53.961005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 888/1778] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:53 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:54.378446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2399d-0549-4a74-8845-7fedefe7934b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:54.381213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-37c2399d-0549-4a74-8845-7fedefe7934b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:54.529272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:54.602041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c2399d-0549-4a74-8845-7fedefe7934b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:54.623921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:54.624868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:54.625328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:54.626465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] PATH_INFO: `/v3/projects/1ade7b670b5b49c19f7b7df4ab24c6de` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:54.628621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ade7b670b5b49c19f7b7df4ab24c6de)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:54.631853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:54.767143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ade7b670b5b49c19f7b7df4ab24c6de', 'request_id': 'req-018402d0-2bf1-47ad-a053-b785af1af365'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:54.784584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ade7b670b5b49c19f7b7df4ab24c6de', 'request_id': 'req-018402d0-2bf1-47ad-a053-b785af1af365'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:54.833109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ade7b670b5b49c19f7b7df4ab24c6de', 'request_id': 'req-018402d0-2bf1-47ad-a053-b785af1af365'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:54.888496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] The token cache is being invalidate because project 1ade7b670b5b49c19f7b7df4ab24c6de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:54.889532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:54.890467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-018402d0-2bf1-47ad-a053-b785af1af365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:54.897886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 891/1779] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:54 2022] DELETE /identity/v3/projects/1ade7b670b5b49c19f7b7df4ab24c6de => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:54.902700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fb0bc-d4ce-481c-838e-78ad96daaa4d service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:54.923197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-981fb0bc-d4ce-481c-838e-78ad96daaa4d service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:55.197767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:55.198718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:55.199168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:55.200612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] PATH_INFO: `/v3/users/17ddb84699af48b78bfd9eb9595e7a67` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:55.206144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] RBAC: Authorizing `identity:delete_user(user_id=17ddb84699af48b78bfd9eb9595e7a67)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:55.208642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:55.393895 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '17ddb84699af48b78bfd9eb9595e7a67'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:55.396129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '17ddb84699af48b78bfd9eb9595e7a67'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:55.397567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '17ddb84699af48b78bfd9eb9595e7a67'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:55.434216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '17ddb84699af48b78bfd9eb9595e7a67'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:55.510373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e4ab9021-79a4-460c-ad37-13931f3d165f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '17ddb84699af48b78bfd9eb9595e7a67'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:55.569168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 889/1780] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:26:54 2022] DELETE /identity/v3/users/17ddb84699af48b78bfd9eb9595e7a67 => generated 0 bytes in 664 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:56.554785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38922883-bc9b-4d04-b415-a8fd40efa1bf None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:56.555403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38922883-bc9b-4d04-b415-a8fd40efa1bf None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:56.555591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38922883-bc9b-4d04-b415-a8fd40efa1bf None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:56.560111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 892/1781] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:26:56 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:26:56.657956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9925b7-987c-4e11-beb2-45c5b6c1adc9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:56.658878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9925b7-987c-4e11-beb2-45c5b6c1adc9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:56.659351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9925b7-987c-4e11-beb2-45c5b6c1adc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:56.692754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fb9925b7-987c-4e11-beb2-45c5b6c1adc9 None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:56.701702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fb9925b7-987c-4e11-beb2-45c5b6c1adc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:56.725736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:56.879382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 890/1782] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:26:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:57.967503 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38922883-bc9b-4d04-b415-a8fd40efa1bf None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:57.970613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-38922883-bc9b-4d04-b415-a8fd40efa1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:58.174730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38922883-bc9b-4d04-b415-a8fd40efa1bf None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:58.183837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:58.184065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:58.184765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:58.185248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] PATH_INFO: `/v3/projects/7ce65948e0b54597a217baaf1d117537` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:58.187275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ce65948e0b54597a217baaf1d117537)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:58.190198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:58.293531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ce65948e0b54597a217baaf1d117537', 'request_id': 'req-ce98028d-d330-43c9-bd3c-4e8dc60147ae'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:58.301546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ce65948e0b54597a217baaf1d117537', 'request_id': 'req-ce98028d-d330-43c9-bd3c-4e8dc60147ae'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:58.316248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ce65948e0b54597a217baaf1d117537', 'request_id': 'req-ce98028d-d330-43c9-bd3c-4e8dc60147ae'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:58.361579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] The token cache is being invalidate because project 7ce65948e0b54597a217baaf1d117537 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:58.362339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:58.363661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:58.367574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 893/1783] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:57 2022] DELETE /identity/v3/projects/7ce65948e0b54597a217baaf1d117537 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:58.374827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6994-3bc6-4261-9f43-444c8e514395 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:58.375439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6994-3bc6-4261-9f43-444c8e514395 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:58.375439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713a6994-3bc6-4261-9f43-444c8e514395 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:58.442416 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-713a6994-3bc6-4261-9f43-444c8e514395 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:58.444035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-713a6994-3bc6-4261-9f43-444c8e514395 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:58.479676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:58.481647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:58.514579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:58.600201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 891/1784] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:58.607769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798fd5c-2b00-422b-b914-150c5c666a8f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:58.608339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798fd5c-2b00-422b-b914-150c5c666a8f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:58.609207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2798fd5c-2b00-422b-b914-150c5c666a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:58.681429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2798fd5c-2b00-422b-b914-150c5c666a8f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:58.686148 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2798fd5c-2b00-422b-b914-150c5c666a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:58.727137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce98028d-d330-43c9-bd3c-4e8dc60147ae admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:58.735404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 892/1785] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:58.742890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798fd5c-2b00-422b-b914-150c5c666a8f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:58.762747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3523d16-7e67-42b9-b26b-2fdb6b6377fb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:58.766389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3523d16-7e67-42b9-b26b-2fdb6b6377fb service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:58.766731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3523d16-7e67-42b9-b26b-2fdb6b6377fb service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:58.767053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3523d16-7e67-42b9-b26b-2fdb6b6377fb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:58.778350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b3523d16-7e67-42b9-b26b-2fdb6b6377fb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:58.804816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3523d16-7e67-42b9-b26b-2fdb6b6377fb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:58.809307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3523d16-7e67-42b9-b26b-2fdb6b6377fb service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:58.816250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2798fd5c-2b00-422b-b914-150c5c666a8f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:58.846186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 894/1786] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:26:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:26:58.861914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764418-46cb-4420-b576-789e5b2a8dca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:58.862626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764418-46cb-4420-b576-789e5b2a8dca admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:58.862921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764418-46cb-4420-b576-789e5b2a8dca admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:58.863181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5764418-46cb-4420-b576-789e5b2a8dca admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:58.863922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5764418-46cb-4420-b576-789e5b2a8dca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:58.869132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5764418-46cb-4420-b576-789e5b2a8dca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:58.872297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5764418-46cb-4420-b576-789e5b2a8dca admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:58.949785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 893/1787] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:58.955247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3523d16-7e67-42b9-b26b-2fdb6b6377fb service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:58.969946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3523d16-7e67-42b9-b26b-2fdb6b6377fb service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:58.978111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b34bf2-1cc5-4b3e-a0dd-d05fa2414006 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:58.978844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b34bf2-1cc5-4b3e-a0dd-d05fa2414006 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:58.979249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b34bf2-1cc5-4b3e-a0dd-d05fa2414006 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:58.979572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b34bf2-1cc5-4b3e-a0dd-d05fa2414006 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:58.980461 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b34bf2-1cc5-4b3e-a0dd-d05fa2414006 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:58.983156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b34bf2-1cc5-4b3e-a0dd-d05fa2414006 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:58.996715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764418-46cb-4420-b576-789e5b2a8dca admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:58.998943 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b5764418-46cb-4420-b576-789e5b2a8dca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:59.023199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5764418-46cb-4420-b576-789e5b2a8dca admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:59.033536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:59.034191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.034473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.034789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] PATH_INFO: `/v3/projects/4aa7582e2baf44fbbc8c9795ed51317e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.037293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4aa7582e2baf44fbbc8c9795ed51317e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:59.039931 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:59.059974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 895/1788] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:58 2022] POST /identity/v3/projects => generated 357 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:59.060995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b34bf2-1cc5-4b3e-a0dd-d05fa2414006 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:59.202008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4aa7582e2baf44fbbc8c9795ed51317e', 'request_id': 'req-da69e398-13f2-4634-81fc-6eccddcc1779'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:59.204531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b34bf2-1cc5-4b3e-a0dd-d05fa2414006 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:59.216401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4aa7582e2baf44fbbc8c9795ed51317e', 'request_id': 'req-da69e398-13f2-4634-81fc-6eccddcc1779'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:59.233025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4aa7582e2baf44fbbc8c9795ed51317e', 'request_id': 'req-da69e398-13f2-4634-81fc-6eccddcc1779'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:59.273690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] The token cache is being invalidate because project 4aa7582e2baf44fbbc8c9795ed51317e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:26:59.274268 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:59.275866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da69e398-13f2-4634-81fc-6eccddcc1779 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:26:59.278029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 894/1789] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:26:58 2022] DELETE /identity/v3/projects/4aa7582e2baf44fbbc8c9795ed51317e => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:59.288031 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4b2e-da7f-4c93-bfd7-5613ffc0e59c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.288351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4b2e-da7f-4c93-bfd7-5613ffc0e59c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.288612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e79e4b2e-da7f-4c93-bfd7-5613ffc0e59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.323298 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:59.327732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8365a50-a25e-44d7-b6e1-62ae8990fb8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:59.337021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365a50-a25e-44d7-b6e1-62ae8990fb8d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.339457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365a50-a25e-44d7-b6e1-62ae8990fb8d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.342194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8365a50-a25e-44d7-b6e1-62ae8990fb8d admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.343346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8365a50-a25e-44d7-b6e1-62ae8990fb8d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:59.347934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8365a50-a25e-44d7-b6e1-62ae8990fb8d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:59.349465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e79e4b2e-da7f-4c93-bfd7-5613ffc0e59c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:59.353894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e79e4b2e-da7f-4c93-bfd7-5613ffc0e59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:59.376365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 895/1790] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:59.383748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066e79a-abbd-4bfe-9e8f-31b8cf3a7f42 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.384891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066e79a-abbd-4bfe-9e8f-31b8cf3a7f42 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.386208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f066e79a-abbd-4bfe-9e8f-31b8cf3a7f42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.409663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 896/1791] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:59 2022] POST /identity/v3/users => generated 279 bytes in 349 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:59.411698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8365a50-a25e-44d7-b6e1-62ae8990fb8d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:59.415599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8365a50-a25e-44d7-b6e1-62ae8990fb8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:59.447301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8365a50-a25e-44d7-b6e1-62ae8990fb8d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:59.449693 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f066e79a-abbd-4bfe-9e8f-31b8cf3a7f42 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:59.454872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f066e79a-abbd-4bfe-9e8f-31b8cf3a7f42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:59.460190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4e329-d0b3-4f2d-81a9-c17601338c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:59.463275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e329-d0b3-4f2d-81a9-c17601338c5f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.463881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e329-d0b3-4f2d-81a9-c17601338c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.464506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4e329-d0b3-4f2d-81a9-c17601338c5f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.467304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4e329-d0b3-4f2d-81a9-c17601338c5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:59.474370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 896/1792] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:59.479092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d4e329-d0b3-4f2d-81a9-c17601338c5f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:59.480137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066e79a-abbd-4bfe-9e8f-31b8cf3a7f42 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:59.493069 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:26:59.505615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f066e79a-abbd-4bfe-9e8f-31b8cf3a7f42 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:59.523764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ec511-11dd-4240-99b1-f8035e44ddf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:59.524426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec511-11dd-4240-99b1-f8035e44ddf3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.525096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 897/1793] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 115 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:59.528255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec511-11dd-4240-99b1-f8035e44ddf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.528576 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ec511-11dd-4240-99b1-f8035e44ddf3 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.529004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4e329-d0b3-4f2d-81a9-c17601338c5f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:59.529275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ec511-11dd-4240-99b1-f8035e44ddf3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:26:59.529589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ec511-11dd-4240-99b1-f8035e44ddf3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:59.531278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ec511-11dd-4240-99b1-f8035e44ddf3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:59.545357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d4e329-d0b3-4f2d-81a9-c17601338c5f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:59.554839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742580-a617-4c0b-8c62-92091e3044f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:59.555860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742580-a617-4c0b-8c62-92091e3044f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.557201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742580-a617-4c0b-8c62-92091e3044f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.557688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e742580-a617-4c0b-8c62-92091e3044f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.561098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 897/1794] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:26:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:26:59.562228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742580-a617-4c0b-8c62-92091e3044f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:59.562485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ec511-11dd-4240-99b1-f8035e44ddf3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:59.564448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e742580-a617-4c0b-8c62-92091e3044f0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:59.578697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 898/1795] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:59.583011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742580-a617-4c0b-8c62-92091e3044f0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:59.588019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ec511-11dd-4240-99b1-f8035e44ddf3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:59.593371 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef9f66-1f8c-4d65-a873-263a8c970fbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:59.594319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef9f66-1f8c-4d65-a873-263a8c970fbc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.595066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef9f66-1f8c-4d65-a873-263a8c970fbc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.595571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07ef9f66-1f8c-4d65-a873-263a8c970fbc admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.598098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef9f66-1f8c-4d65-a873-263a8c970fbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:59.601153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07ef9f66-1f8c-4d65-a873-263a8c970fbc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:59.606178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e742580-a617-4c0b-8c62-92091e3044f0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:59.620773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df68c5a8-f0a1-458a-a10f-e7454c6107df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:59.622929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68c5a8-f0a1-458a-a10f-e7454c6107df admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.623214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68c5a8-f0a1-458a-a10f-e7454c6107df admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.623492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df68c5a8-f0a1-458a-a10f-e7454c6107df admin admin] PATH_INFO: `/v3/projects/6cdb6271bdc3463a8ec68a232d851fc1/users/3046ad9d12f543a8ba28cec0eb765bc4/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.639616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 898/1796] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:59 2022] POST /identity/v3/projects => generated 367 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:26:59.644117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef9f66-1f8c-4d65-a873-263a8c970fbc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:59.655956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68c5a8-f0a1-458a-a10f-e7454c6107df admin admin] RBAC: Authorizing `identity:create_grant(project_id=6cdb6271bdc3463a8ec68a232d851fc1, user_id=3046ad9d12f543a8ba28cec0eb765bc4, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:59.658989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df68c5a8-f0a1-458a-a10f-e7454c6107df admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:59.700249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 899/1797] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:26:59 2022] PUT /identity/v3/projects/6cdb6271bdc3463a8ec68a232d851fc1/users/3046ad9d12f543a8ba28cec0eb765bc4/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:26:59.711626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334e2dc-1ebe-4e8b-a97b-dd759f86ffc9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.712266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334e2dc-1ebe-4e8b-a97b-dd759f86ffc9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.713771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334e2dc-1ebe-4e8b-a97b-dd759f86ffc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.750653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e334e2dc-1ebe-4e8b-a97b-dd759f86ffc9 None None] MFA Rules not processed for user `3046ad9d12f543a8ba28cec0eb765bc4`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:26:59.752384 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e334e2dc-1ebe-4e8b-a97b-dd759f86ffc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:26:59.754294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07ef9f66-1f8c-4d65-a873-263a8c970fbc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:59.842459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffd7ed-9c8f-4885-ae6b-d5ce5f9ee773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:59.844201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffd7ed-9c8f-4885-ae6b-d5ce5f9ee773 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.844555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffd7ed-9c8f-4885-ae6b-d5ce5f9ee773 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.845113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fffd7ed-9c8f-4885-ae6b-d5ce5f9ee773 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.846517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffd7ed-9c8f-4885-ae6b-d5ce5f9ee773 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:59.851401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fffd7ed-9c8f-4885-ae6b-d5ce5f9ee773 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:59.852126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 900/1798] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:26:59 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:26:59.853986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334e2dc-1ebe-4e8b-a97b-dd759f86ffc9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:59.872753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334e2dc-1ebe-4e8b-a97b-dd759f86ffc9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:59.900454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c61e3-b985-4259-8019-8f65b84a8ea8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:59.901294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c61e3-b985-4259-8019-8f65b84a8ea8 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.901895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c61e3-b985-4259-8019-8f65b84a8ea8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.902472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0c61e3-b985-4259-8019-8f65b84a8ea8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.903341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c61e3-b985-4259-8019-8f65b84a8ea8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:59.903574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 899/1799] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:59 2022] POST /identity/v3/users => generated 284 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:59.906208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0c61e3-b985-4259-8019-8f65b84a8ea8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:59.909846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffd7ed-9c8f-4885-ae6b-d5ce5f9ee773 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:59.930869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fffd7ed-9c8f-4885-ae6b-d5ce5f9ee773 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:26:59.938661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e9214-aa21-493e-a389-85dbe3e3126a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:26:59.938661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e9214-aa21-493e-a389-85dbe3e3126a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:26:59.938970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e9214-aa21-493e-a389-85dbe3e3126a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:26:59.939179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d71e9214-aa21-493e-a389-85dbe3e3126a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:26:59.939955 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e9214-aa21-493e-a389-85dbe3e3126a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:26:59.941853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d71e9214-aa21-493e-a389-85dbe3e3126a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:26:59.955177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 901/1800] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:26:59 2022] POST /identity/v3/projects => generated 357 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:26:59.959862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c61e3-b985-4259-8019-8f65b84a8ea8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:26:59.964883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 900/1801] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:26:59.982904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e9214-aa21-493e-a389-85dbe3e3126a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.007372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d71e9214-aa21-493e-a389-85dbe3e3126a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.067705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0c61e3-b985-4259-8019-8f65b84a8ea8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.075791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d75cc-7d37-4133-b27b-8adb74c556f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.077057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d75cc-7d37-4133-b27b-8adb74c556f2 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.077372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d75cc-7d37-4133-b27b-8adb74c556f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.077621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be0d75cc-7d37-4133-b27b-8adb74c556f2 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.078272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d75cc-7d37-4133-b27b-8adb74c556f2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.080304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be0d75cc-7d37-4133-b27b-8adb74c556f2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.084549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:00.128087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e2ffb-860d-4d54-8215-439c0af44816 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.129747 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2ffb-860d-4d54-8215-439c0af44816 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.130249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2ffb-860d-4d54-8215-439c0af44816 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.134938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 902/1802] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:26:59 2022] POST /identity/v3/users => generated 285 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:00.135634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d75cc-7d37-4133-b27b-8adb74c556f2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.136036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564e2ffb-860d-4d54-8215-439c0af44816 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.137330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e2ffb-860d-4d54-8215-439c0af44816 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.139254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564e2ffb-860d-4d54-8215-439c0af44816 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.150967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be0d75cc-7d37-4133-b27b-8adb74c556f2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.155550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 901/1803] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:26:59 2022] GET /identity/v3/roles => generated 1420 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:00.156382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f828658-0d72-49f5-90fd-a4d7d651c214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.157006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f828658-0d72-49f5-90fd-a4d7d651c214 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.157290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f828658-0d72-49f5-90fd-a4d7d651c214 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.157572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f828658-0d72-49f5-90fd-a4d7d651c214 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.158237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f828658-0d72-49f5-90fd-a4d7d651c214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.160001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e2ffb-860d-4d54-8215-439c0af44816 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.160366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f828658-0d72-49f5-90fd-a4d7d651c214 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.176197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 903/1804] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:00.177938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f828658-0d72-49f5-90fd-a4d7d651c214 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.183012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564e2ffb-860d-4d54-8215-439c0af44816 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.196557 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c88ebf8-5da6-4812-9de8-059fe36efa1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.198202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88ebf8-5da6-4812-9de8-059fe36efa1e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.198811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88ebf8-5da6-4812-9de8-059fe36efa1e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.199100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f828658-0d72-49f5-90fd-a4d7d651c214 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.200687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c88ebf8-5da6-4812-9de8-059fe36efa1e admin admin] PATH_INFO: `/v3/projects/d516889a67c542928d767788f939963b/users/4d8a616843ff4085b3b10c9ba114d679/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.207165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987b857-120e-4f62-8bd0-834c89e23c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.208190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987b857-120e-4f62-8bd0-834c89e23c0f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.208519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987b857-120e-4f62-8bd0-834c89e23c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.208893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6987b857-120e-4f62-8bd0-834c89e23c0f admin admin] PATH_INFO: `/v3/projects/9c37d48bc5de4e748b0a037d1ae81201/users/6b86bf2dfb074b27a5814af03b37421d/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.213620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:00.240446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88ebf8-5da6-4812-9de8-059fe36efa1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d516889a67c542928d767788f939963b, user_id=4d8a616843ff4085b3b10c9ba114d679, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.240997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987b857-120e-4f62-8bd0-834c89e23c0f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c37d48bc5de4e748b0a037d1ae81201, user_id=6b86bf2dfb074b27a5814af03b37421d, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.244925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6987b857-120e-4f62-8bd0-834c89e23c0f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.247688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c88ebf8-5da6-4812-9de8-059fe36efa1e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.272509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 902/1805] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:00 2022] PUT /identity/v3/projects/d516889a67c542928d767788f939963b/users/4d8a616843ff4085b3b10c9ba114d679/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:00.280539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 904/1806] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:00 2022] PUT /identity/v3/projects/9c37d48bc5de4e748b0a037d1ae81201/users/6b86bf2dfb074b27a5814af03b37421d/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:00.283457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45be1-4ab9-4762-ac9c-653ee670dae1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.283728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45be1-4ab9-4762-ac9c-653ee670dae1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.284107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac45be1-4ab9-4762-ac9c-653ee670dae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.284251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987b857-120e-4f62-8bd0-834c89e23c0f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.352295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0ac45be1-4ab9-4762-ac9c-653ee670dae1 None None] MFA Rules not processed for user `4d8a616843ff4085b3b10c9ba114d679`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:00.354662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0ac45be1-4ab9-4762-ac9c-653ee670dae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:00.405266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6987b857-120e-4f62-8bd0-834c89e23c0f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.410886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e531f6-24e3-4733-964f-9041706fd94a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.411614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e531f6-24e3-4733-964f-9041706fd94a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.411945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e531f6-24e3-4733-964f-9041706fd94a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.412319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e531f6-24e3-4733-964f-9041706fd94a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.413042 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e531f6-24e3-4733-964f-9041706fd94a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.414746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e531f6-24e3-4733-964f-9041706fd94a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.434075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 905/1807] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:00.437947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e531f6-24e3-4733-964f-9041706fd94a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.451151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 903/1808] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:00.456460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac45be1-4ab9-4762-ac9c-653ee670dae1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.458162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e531f6-24e3-4733-964f-9041706fd94a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.466290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e542555-08ff-4941-9e7f-e1cfa167c27f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.467078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e542555-08ff-4941-9e7f-e1cfa167c27f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.467488 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e542555-08ff-4941-9e7f-e1cfa167c27f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.467872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e542555-08ff-4941-9e7f-e1cfa167c27f admin admin] PATH_INFO: `/v3/projects/9c37d48bc5de4e748b0a037d1ae81201/users/6b86bf2dfb074b27a5814af03b37421d/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.470076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac45be1-4ab9-4762-ac9c-653ee670dae1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.476146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dfc50-e91b-4fa5-b1b9-31b474e1fae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.476342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e542555-08ff-4941-9e7f-e1cfa167c27f admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c37d48bc5de4e748b0a037d1ae81201, user_id=6b86bf2dfb074b27a5814af03b37421d, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.477124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dfc50-e91b-4fa5-b1b9-31b474e1fae5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.477564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dfc50-e91b-4fa5-b1b9-31b474e1fae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.478922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0dfc50-e91b-4fa5-b1b9-31b474e1fae5 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.479720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dfc50-e91b-4fa5-b1b9-31b474e1fae5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.481883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c0dfc50-e91b-4fa5-b1b9-31b474e1fae5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.485707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e542555-08ff-4941-9e7f-e1cfa167c27f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.505330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 906/1809] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:00 2022] PUT /identity/v3/projects/9c37d48bc5de4e748b0a037d1ae81201/users/6b86bf2dfb074b27a5814af03b37421d/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:00.522955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bd10b-bf4d-4280-8842-b1bdcdb5e0da None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.522955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bd10b-bf4d-4280-8842-b1bdcdb5e0da None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.523417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19bd10b-bf4d-4280-8842-b1bdcdb5e0da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.539854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 904/1810] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:00 2022] POST /identity/v3/projects => generated 367 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:00.541844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dfc50-e91b-4fa5-b1b9-31b474e1fae5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.597708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f19bd10b-bf4d-4280-8842-b1bdcdb5e0da None None] MFA Rules not processed for user `6b86bf2dfb074b27a5814af03b37421d`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:00.599387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f19bd10b-bf4d-4280-8842-b1bdcdb5e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:00.707047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c0dfc50-e91b-4fa5-b1b9-31b474e1fae5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.717067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17867a57-a972-45f1-9a50-eda8f3ceeee2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.717757 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17867a57-a972-45f1-9a50-eda8f3ceeee2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.718188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17867a57-a972-45f1-9a50-eda8f3ceeee2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.718473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17867a57-a972-45f1-9a50-eda8f3ceeee2 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.719748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17867a57-a972-45f1-9a50-eda8f3ceeee2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.722207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17867a57-a972-45f1-9a50-eda8f3ceeee2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.729876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 907/1811] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:00 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:00.743808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bd10b-bf4d-4280-8842-b1bdcdb5e0da None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.747470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f19bd10b-bf4d-4280-8842-b1bdcdb5e0da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:00.752375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 905/1812] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:00 2022] POST /identity/v3/users => generated 290 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:00.753432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17867a57-a972-45f1-9a50-eda8f3ceeee2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.784928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17867a57-a972-45f1-9a50-eda8f3ceeee2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.805584 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc1126-ee1c-4f87-b090-1730a295312b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.810669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc1126-ee1c-4f87-b090-1730a295312b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.810970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc1126-ee1c-4f87-b090-1730a295312b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.811254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fc1126-ee1c-4f87-b090-1730a295312b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.815133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc1126-ee1c-4f87-b090-1730a295312b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.823447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fc1126-ee1c-4f87-b090-1730a295312b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.852810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 906/1813] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:00.858709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc1126-ee1c-4f87-b090-1730a295312b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.866831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:00.873014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fc1126-ee1c-4f87-b090-1730a295312b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.880073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135f7d6-9777-4866-a3cc-20abfafd8964 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.880993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135f7d6-9777-4866-a3cc-20abfafd8964 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.881280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135f7d6-9777-4866-a3cc-20abfafd8964 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.881568 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a135f7d6-9777-4866-a3cc-20abfafd8964 admin admin] PATH_INFO: `/v3/projects/27e994321edd4b76a035848aac2216a4/users/5634dd0b7f6d4e6585904d36bc622a0c/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.901682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135f7d6-9777-4866-a3cc-20abfafd8964 admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e994321edd4b76a035848aac2216a4, user_id=5634dd0b7f6d4e6585904d36bc622a0c, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.903667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19bd10b-bf4d-4280-8842-b1bdcdb5e0da None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:00.907408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a135f7d6-9777-4866-a3cc-20abfafd8964 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.907576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630246-bde9-4297-85aa-a9babf5b4655 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:00.908662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630246-bde9-4297-85aa-a9babf5b4655 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:00.908662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630246-bde9-4297-85aa-a9babf5b4655 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:00.908857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28630246-bde9-4297-85aa-a9babf5b4655 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:00.919185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:00.922740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28630246-bde9-4297-85aa-a9babf5b4655 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:00.925981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28630246-bde9-4297-85aa-a9babf5b4655 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:00.942595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 907/1815] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:00 2022] PUT /identity/v3/projects/27e994321edd4b76a035848aac2216a4/users/5634dd0b7f6d4e6585904d36bc622a0c/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:00.947959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135f7d6-9777-4866-a3cc-20abfafd8964 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:00.951180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 908/1815] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:00 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:01.053562 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630246-bde9-4297-85aa-a9babf5b4655 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:01.070184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28630246-bde9-4297-85aa-a9babf5b4655 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:01.073562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a135f7d6-9777-4866-a3cc-20abfafd8964 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:01.083323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419a874-a847-413e-b031-b972f30d109c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:01.085129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419a874-a847-413e-b031-b972f30d109c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:01.085647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419a874-a847-413e-b031-b972f30d109c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:01.086118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7419a874-a847-413e-b031-b972f30d109c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:01.087299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419a874-a847-413e-b031-b972f30d109c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:01.090807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7419a874-a847-413e-b031-b972f30d109c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:01.108776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 908/1816] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:00 2022] GET /identity/v3/roles => generated 1420 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:01.115298 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419a874-a847-413e-b031-b972f30d109c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:01.135911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7419a874-a847-413e-b031-b972f30d109c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:01.141913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a23371-bc9f-4fd4-8735-8ebfab029c6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:01.142600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23371-bc9f-4fd4-8735-8ebfab029c6a admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:01.142885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23371-bc9f-4fd4-8735-8ebfab029c6a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:01.143168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a23371-bc9f-4fd4-8735-8ebfab029c6a admin admin] PATH_INFO: `/v3/projects/27e994321edd4b76a035848aac2216a4/users/5634dd0b7f6d4e6585904d36bc622a0c/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:01.149536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5887d1-fa90-43b9-924b-055e2274ab29 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:01.149777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a23371-bc9f-4fd4-8735-8ebfab029c6a admin admin] RBAC: Authorizing `identity:create_grant(project_id=27e994321edd4b76a035848aac2216a4, user_id=5634dd0b7f6d4e6585904d36bc622a0c, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:01.150193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5887d1-fa90-43b9-924b-055e2274ab29 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:01.150474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5887d1-fa90-43b9-924b-055e2274ab29 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:01.150746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5887d1-fa90-43b9-924b-055e2274ab29 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:01.152513 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a23371-bc9f-4fd4-8735-8ebfab029c6a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:01.166276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 909/1817] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:01 2022] PUT /identity/v3/projects/27e994321edd4b76a035848aac2216a4/users/5634dd0b7f6d4e6585904d36bc622a0c/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:01.182198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738fb1d-199b-4485-af7b-e14faf47abaf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:01.184235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738fb1d-199b-4485-af7b-e14faf47abaf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:01.187152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6738fb1d-199b-4485-af7b-e14faf47abaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:01.229386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6738fb1d-199b-4485-af7b-e14faf47abaf None None] MFA Rules not processed for user `5634dd0b7f6d4e6585904d36bc622a0c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:01.231350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6738fb1d-199b-4485-af7b-e14faf47abaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:01.233318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5887d1-fa90-43b9-924b-055e2274ab29 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:01.234819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5887d1-fa90-43b9-924b-055e2274ab29 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:01.260088 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 909/1818] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:01 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:01.365739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 910/1819] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:01 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:01.421924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5887d1-fa90-43b9-924b-055e2274ab29 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:01.423868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fc5887d1-fa90-43b9-924b-055e2274ab29 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:01.451039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5887d1-fa90-43b9-924b-055e2274ab29 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:01.560555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a5d8c0-1ae5-4f26-8c56-a53d41b82b4c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:01.561062 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5d8c0-1ae5-4f26-8c56-a53d41b82b4c service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:01.561339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5d8c0-1ae5-4f26-8c56-a53d41b82b4c service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:01.561673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a5d8c0-1ae5-4f26-8c56-a53d41b82b4c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:01.573898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5d8c0-1ae5-4f26-8c56-a53d41b82b4c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:01.574842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a5d8c0-1ae5-4f26-8c56-a53d41b82b4c service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:01.585936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 910/1820] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:01 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:01.897649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738fb1d-199b-4485-af7b-e14faf47abaf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:01.919107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6738fb1d-199b-4485-af7b-e14faf47abaf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:01.926668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71be14d-b728-40c7-8f60-b4d9a7a92708 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:01.928146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be14d-b728-40c7-8f60-b4d9a7a92708 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:01.928146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be14d-b728-40c7-8f60-b4d9a7a92708 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:01.928681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71be14d-b728-40c7-8f60-b4d9a7a92708 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:02.094241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:02.160513 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71be14d-b728-40c7-8f60-b4d9a7a92708 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:02.162499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71be14d-b728-40c7-8f60-b4d9a7a92708 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:02.177971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 911/1821] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:01 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:05.133189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7f8d2-0e13-471b-8845-7270cdf35893 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:05.136864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7f8d2-0e13-471b-8845-7270cdf35893 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:05.137378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7f8d2-0e13-471b-8845-7270cdf35893 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:05.139284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 911/1822] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:27:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:27:05.198979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93375b29-2612-42fb-8bf7-ae3b4abf26a8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:05.200333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93375b29-2612-42fb-8bf7-ae3b4abf26a8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:05.200758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93375b29-2612-42fb-8bf7-ae3b4abf26a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:05.238808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-93375b29-2612-42fb-8bf7-ae3b4abf26a8 None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:05.240251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-93375b29-2612-42fb-8bf7-ae3b4abf26a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:05.386621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 912/1823] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:27:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:05.408940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7f8d2-0e13-471b-8845-7270cdf35893 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:05.411095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-54a7f8d2-0e13-471b-8845-7270cdf35893 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:05.439354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7f8d2-0e13-471b-8845-7270cdf35893 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:05.446235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0a5e143-56f9-4749-857f-96435027593e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:05.446937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e143-56f9-4749-857f-96435027593e service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:05.447152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e143-56f9-4749-857f-96435027593e service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:05.447427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0a5e143-56f9-4749-857f-96435027593e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:05.467346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5e143-56f9-4749-857f-96435027593e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:05.473491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0a5e143-56f9-4749-857f-96435027593e service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:05.498694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 912/1824] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:07.775878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93375b29-2612-42fb-8bf7-ae3b4abf26a8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:07.852598 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93375b29-2612-42fb-8bf7-ae3b4abf26a8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:07.857688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:07.858323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:07.858597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:07.858867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] PATH_INFO: `/v3/users/4d8a616843ff4085b3b10c9ba114d679` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:07.859997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8a616843ff4085b3b10c9ba114d679)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:07.861939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:07.918397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8a616843ff4085b3b10c9ba114d679'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:07.919294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8a616843ff4085b3b10c9ba114d679'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:07.919908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8a616843ff4085b3b10c9ba114d679'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:07.927954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8a616843ff4085b3b10c9ba114d679'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:07.940502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8a616843ff4085b3b10c9ba114d679'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:07.944376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:07.960316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 913/1825] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:07 2022] DELETE /identity/v3/users/4d8a616843ff4085b3b10c9ba114d679 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:07.964806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b5c8-2d45-4466-b8e0-9876e31ea4c8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:07.965301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b5c8-2d45-4466-b8e0-9876e31ea4c8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:07.965374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b49b5c8-2d45-4466-b8e0-9876e31ea4c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:07.995894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7b49b5c8-2d45-4466-b8e0-9876e31ea4c8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:07.997343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7b49b5c8-2d45-4466-b8e0-9876e31ea4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:08.066365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:08.099075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 913/1826] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:08.109815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:08.111404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:08.176816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-528f7159-6233-4b10-9204-86a3224e6fb8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:08.181455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd7f2e-f960-48c9-84b7-11e58df4e239 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:08.182111 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7f2e-f960-48c9-84b7-11e58df4e239 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:08.182522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7f2e-f960-48c9-84b7-11e58df4e239 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:08.182826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24bd7f2e-f960-48c9-84b7-11e58df4e239 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:08.195270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd7f2e-f960-48c9-84b7-11e58df4e239 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:08.197285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24bd7f2e-f960-48c9-84b7-11e58df4e239 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:08.208684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 914/1827] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:08.597603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b5c8-2d45-4466-b8e0-9876e31ea4c8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:08.599263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7b49b5c8-2d45-4466-b8e0-9876e31ea4c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:08.620311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b49b5c8-2d45-4466-b8e0-9876e31ea4c8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:08.626858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:08.627497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:08.627774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:08.628046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] PATH_INFO: `/v3/projects/d516889a67c542928d767788f939963b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:08.629207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d516889a67c542928d767788f939963b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:08.631112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:08.694530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd516889a67c542928d767788f939963b', 'request_id': 'req-172eff97-db40-4453-ac87-6efe3199ca56'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:08.701952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd516889a67c542928d767788f939963b', 'request_id': 'req-172eff97-db40-4453-ac87-6efe3199ca56'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:08.719966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd516889a67c542928d767788f939963b', 'request_id': 'req-172eff97-db40-4453-ac87-6efe3199ca56'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:08.738565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] The token cache is being invalidate because project d516889a67c542928d767788f939963b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:08.739000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:08.740436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:08.742346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 914/1828] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:08 2022] DELETE /identity/v3/projects/d516889a67c542928d767788f939963b => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:08.747186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd7f2e-f960-48c9-84b7-11e58df4e239 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:08.757465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24bd7f2e-f960-48c9-84b7-11e58df4e239 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:08.844401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:08.845042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:08.845331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:08.845616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] PATH_INFO: `/v3/users/5634dd0b7f6d4e6585904d36bc622a0c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:08.847631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5634dd0b7f6d4e6585904d36bc622a0c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:08.849602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:08.922016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5634dd0b7f6d4e6585904d36bc622a0c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:08.922749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5634dd0b7f6d4e6585904d36bc622a0c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:08.923373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5634dd0b7f6d4e6585904d36bc622a0c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:08.932148 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5634dd0b7f6d4e6585904d36bc622a0c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:08.946052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e1dbab6-9e8c-47e7-a179-7cfd44e9d769 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5634dd0b7f6d4e6585904d36bc622a0c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:08.966980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 915/1829] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:08 2022] DELETE /identity/v3/users/5634dd0b7f6d4e6585904d36bc622a0c => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:09.396600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:09.398277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:09.429533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172eff97-db40-4453-ac87-6efe3199ca56 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:09.528430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:09.529924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:09.530371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:09.530804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] PATH_INFO: `/v3/projects/27e994321edd4b76a035848aac2216a4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:09.532886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=27e994321edd4b76a035848aac2216a4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:09.536389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:09.631009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '27e994321edd4b76a035848aac2216a4', 'request_id': 'req-946be4e0-7415-4ae0-8440-e8c88ffd61fc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:09.640817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '27e994321edd4b76a035848aac2216a4', 'request_id': 'req-946be4e0-7415-4ae0-8440-e8c88ffd61fc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:09.654623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '27e994321edd4b76a035848aac2216a4', 'request_id': 'req-946be4e0-7415-4ae0-8440-e8c88ffd61fc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:09.657345 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:09.680279 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] The token cache is being invalidate because project 27e994321edd4b76a035848aac2216a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:09.681146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:09.688636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-946be4e0-7415-4ae0-8440-e8c88ffd61fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:09.690424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 915/1830] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:09 2022] DELETE /identity/v3/projects/27e994321edd4b76a035848aac2216a4 => generated 0 bytes in 294 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:09.695500 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390f37-0e74-488b-a030-f05079286b78 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:09.695790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390f37-0e74-488b-a030-f05079286b78 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:09.696171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf390f37-0e74-488b-a030-f05079286b78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:09.732287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cf390f37-0e74-488b-a030-f05079286b78 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:09.734158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cf390f37-0e74-488b-a030-f05079286b78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:09.767108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:09.889049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 916/1831] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:09.892508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7ebde-048e-4b3f-b0b2-6fc8db7eda56 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:09.892867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7ebde-048e-4b3f-b0b2-6fc8db7eda56 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:09.893153 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f7ebde-048e-4b3f-b0b2-6fc8db7eda56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:09.928686 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-48f7ebde-048e-4b3f-b0b2-6fc8db7eda56 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:09.929928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-48f7ebde-048e-4b3f-b0b2-6fc8db7eda56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:09.940812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 916/1832] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:09.944993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390f37-0e74-488b-a030-f05079286b78 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:09.960771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf390f37-0e74-488b-a030-f05079286b78 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:09.966527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093b09b-b665-433f-9cad-c05dad74141c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:09.967158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093b09b-b665-433f-9cad-c05dad74141c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:09.967440 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093b09b-b665-433f-9cad-c05dad74141c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:09.967971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9093b09b-b665-433f-9cad-c05dad74141c admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:09.968676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093b09b-b665-433f-9cad-c05dad74141c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:09.969176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093b09b-b665-433f-9cad-c05dad74141c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:09.970939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9093b09b-b665-433f-9cad-c05dad74141c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:09.985687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 917/1833] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:27:09.989570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7ebde-048e-4b3f-b0b2-6fc8db7eda56 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:10.000008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f7ebde-048e-4b3f-b0b2-6fc8db7eda56 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:10.005380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3ad6-6ff6-4c29-8e6f-dcf4656e12e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:10.006749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3ad6-6ff6-4c29-8e6f-dcf4656e12e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:10.006749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3ad6-6ff6-4c29-8e6f-dcf4656e12e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:10.006749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655c3ad6-6ff6-4c29-8e6f-dcf4656e12e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:10.007550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c3ad6-6ff6-4c29-8e6f-dcf4656e12e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:10.009658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655c3ad6-6ff6-4c29-8e6f-dcf4656e12e4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:10.055775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 917/1834] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:09 2022] POST /identity/v3/projects => generated 387 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:10.056211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093b09b-b665-433f-9cad-c05dad74141c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:10.070130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9093b09b-b665-433f-9cad-c05dad74141c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:10.206716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e61a1-726e-463b-9f44-6c554bfa2842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:10.207659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e61a1-726e-463b-9f44-6c554bfa2842 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:10.207943 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e61a1-726e-463b-9f44-6c554bfa2842 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:10.208227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e61a1-726e-463b-9f44-6c554bfa2842 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:10.208918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e61a1-726e-463b-9f44-6c554bfa2842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:10.211132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e61a1-726e-463b-9f44-6c554bfa2842 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:10.269742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3ad6-6ff6-4c29-8e6f-dcf4656e12e4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:10.270645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 918/1835] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:10 2022] POST /identity/v3/users => generated 294 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:10.283975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655c3ad6-6ff6-4c29-8e6f-dcf4656e12e4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:10.289655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7609c48-1a96-4187-ab6a-cb534c79f6cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:10.290865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7609c48-1a96-4187-ab6a-cb534c79f6cf admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:10.291238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7609c48-1a96-4187-ab6a-cb534c79f6cf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:10.292244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7609c48-1a96-4187-ab6a-cb534c79f6cf admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:10.293451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7609c48-1a96-4187-ab6a-cb534c79f6cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:10.295715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7609c48-1a96-4187-ab6a-cb534c79f6cf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:10.313963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 918/1836] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:10.317205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e61a1-726e-463b-9f44-6c554bfa2842 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:10.332207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e61a1-726e-463b-9f44-6c554bfa2842 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:10.338448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-362d8a23-d9d1-4f8b-8f2f-f26e797dbeb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:10.339131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8a23-d9d1-4f8b-8f2f-f26e797dbeb7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:10.339470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8a23-d9d1-4f8b-8f2f-f26e797dbeb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:10.339691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-362d8a23-d9d1-4f8b-8f2f-f26e797dbeb7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:10.340479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d8a23-d9d1-4f8b-8f2f-f26e797dbeb7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:10.342260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-362d8a23-d9d1-4f8b-8f2f-f26e797dbeb7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:10.365304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 919/1837] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:10.372204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7609c48-1a96-4187-ab6a-cb534c79f6cf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:10.382898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7609c48-1a96-4187-ab6a-cb534c79f6cf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:10.390339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b069b-66ac-447f-99ed-58ae3f66b886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:10.391238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b069b-66ac-447f-99ed-58ae3f66b886 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:10.391519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b069b-66ac-447f-99ed-58ae3f66b886 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:10.391795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e7b069b-66ac-447f-99ed-58ae3f66b886 admin admin] PATH_INFO: `/v3/projects/13adb1e048664725aeae433d0bbdba52/users/a2778c9b9c3846258abac7f659b25702/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:10.407740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b069b-66ac-447f-99ed-58ae3f66b886 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13adb1e048664725aeae433d0bbdba52, user_id=a2778c9b9c3846258abac7f659b25702, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:10.410452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e7b069b-66ac-447f-99ed-58ae3f66b886 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:10.425756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 919/1838] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:10 2022] PUT /identity/v3/projects/13adb1e048664725aeae433d0bbdba52/users/a2778c9b9c3846258abac7f659b25702/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:10.439089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee75a7-c199-40ca-ba44-f6038275074b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:10.439373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee75a7-c199-40ca-ba44-f6038275074b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:10.440188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ee75a7-c199-40ca-ba44-f6038275074b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:10.473107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c6ee75a7-c199-40ca-ba44-f6038275074b None None] MFA Rules not processed for user `a2778c9b9c3846258abac7f659b25702`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:10.475651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c6ee75a7-c199-40ca-ba44-f6038275074b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:10.548925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 920/1839] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:10 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:10.553457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b069b-66ac-447f-99ed-58ae3f66b886 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:10.646723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e7b069b-66ac-447f-99ed-58ae3f66b886 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:10.655448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0d3be-04ef-4581-b154-62dbd687393b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:10.656194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d3be-04ef-4581-b154-62dbd687393b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:10.656543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d3be-04ef-4581-b154-62dbd687393b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:10.656884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0d3be-04ef-4581-b154-62dbd687393b admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:10.657667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0d3be-04ef-4581-b154-62dbd687393b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:10.659867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0d3be-04ef-4581-b154-62dbd687393b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:10.692360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 920/1840] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:10 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:10.694822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee75a7-c199-40ca-ba44-f6038275074b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:10.707972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ee75a7-c199-40ca-ba44-f6038275074b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:10.721508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:10.794552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8c823-f593-4aba-be9d-0de47cc47159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:10.795277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8c823-f593-4aba-be9d-0de47cc47159 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:10.795560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8c823-f593-4aba-be9d-0de47cc47159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:10.795832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aea8c823-f593-4aba-be9d-0de47cc47159 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:10.796542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8c823-f593-4aba-be9d-0de47cc47159 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:10.798784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aea8c823-f593-4aba-be9d-0de47cc47159 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:10.826321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 921/1841] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:10 2022] POST /identity/v3/users => generated 300 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:10.830088 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0d3be-04ef-4581-b154-62dbd687393b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:10.842567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0d3be-04ef-4581-b154-62dbd687393b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:10.848439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eff5f-8f7a-4710-a97a-2b2d2ec04f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:10.849274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eff5f-8f7a-4710-a97a-2b2d2ec04f8c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:10.849629 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eff5f-8f7a-4710-a97a-2b2d2ec04f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:10.850544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5eff5f-8f7a-4710-a97a-2b2d2ec04f8c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:10.851425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5eff5f-8f7a-4710-a97a-2b2d2ec04f8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:10.854784 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5eff5f-8f7a-4710-a97a-2b2d2ec04f8c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:10.867395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 921/1842] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:10.871387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8c823-f593-4aba-be9d-0de47cc47159 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:10.888718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aea8c823-f593-4aba-be9d-0de47cc47159 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:10.894647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f2a96-690d-494d-8141-70876b27a94b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:10.895503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f2a96-690d-494d-8141-70876b27a94b admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:10.895789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f2a96-690d-494d-8141-70876b27a94b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:10.896064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f2a96-690d-494d-8141-70876b27a94b admin admin] PATH_INFO: `/v3/projects/a53f2e8acbe2416098362a47de2e7215/users/99fbd66c5d554c2fbe40fbd91a959b04/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:10.915560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f2a96-690d-494d-8141-70876b27a94b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53f2e8acbe2416098362a47de2e7215, user_id=99fbd66c5d554c2fbe40fbd91a959b04, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:10.918292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-083f2a96-690d-494d-8141-70876b27a94b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:10.941910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 922/1843] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:10 2022] PUT /identity/v3/projects/a53f2e8acbe2416098362a47de2e7215/users/99fbd66c5d554c2fbe40fbd91a959b04/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:10.945514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eff5f-8f7a-4710-a97a-2b2d2ec04f8c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:10.963405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5eff5f-8f7a-4710-a97a-2b2d2ec04f8c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:11.041206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38da4f5-4d26-40cc-9e27-58a0ce417137 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:11.041942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38da4f5-4d26-40cc-9e27-58a0ce417137 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:11.042289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38da4f5-4d26-40cc-9e27-58a0ce417137 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:11.042635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38da4f5-4d26-40cc-9e27-58a0ce417137 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:11.043348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38da4f5-4d26-40cc-9e27-58a0ce417137 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:11.045075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38da4f5-4d26-40cc-9e27-58a0ce417137 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:11.050958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:11.060272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 922/1844] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:10 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:11.062233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f2a96-690d-494d-8141-70876b27a94b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:11.074715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f2a96-690d-494d-8141-70876b27a94b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:11.079636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10a5ea-d155-4963-bf46-93396831c743 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:11.080419 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10a5ea-d155-4963-bf46-93396831c743 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:11.080702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10a5ea-d155-4963-bf46-93396831c743 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:11.080977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc10a5ea-d155-4963-bf46-93396831c743 admin admin] PATH_INFO: `/v3/projects/a53f2e8acbe2416098362a47de2e7215/users/99fbd66c5d554c2fbe40fbd91a959b04/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:11.082928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10a5ea-d155-4963-bf46-93396831c743 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a53f2e8acbe2416098362a47de2e7215, user_id=99fbd66c5d554c2fbe40fbd91a959b04, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:11.085609 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc10a5ea-d155-4963-bf46-93396831c743 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:11.097809 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 923/1845] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:11 2022] PUT /identity/v3/projects/a53f2e8acbe2416098362a47de2e7215/users/99fbd66c5d554c2fbe40fbd91a959b04/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:11.109321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433da02d-50da-4b01-8432-68501a5d287c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:11.109608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433da02d-50da-4b01-8432-68501a5d287c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:11.109887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433da02d-50da-4b01-8432-68501a5d287c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:11.141932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-433da02d-50da-4b01-8432-68501a5d287c None None] MFA Rules not processed for user `99fbd66c5d554c2fbe40fbd91a959b04`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:11.143549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-433da02d-50da-4b01-8432-68501a5d287c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:11.233644 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 923/1846] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:11 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:11.245594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10a5ea-d155-4963-bf46-93396831c743 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:11.247447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dc10a5ea-d155-4963-bf46-93396831c743 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:11.318443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc10a5ea-d155-4963-bf46-93396831c743 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:11.323129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee306724-4c51-4461-9bd1-66514f1c96df service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:11.323754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306724-4c51-4461-9bd1-66514f1c96df service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:11.324038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306724-4c51-4461-9bd1-66514f1c96df service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:11.324339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee306724-4c51-4461-9bd1-66514f1c96df service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:11.337688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee306724-4c51-4461-9bd1-66514f1c96df service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:11.339176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee306724-4c51-4461-9bd1-66514f1c96df service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:11.353779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 924/1847] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:11 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:13.028750 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433da02d-50da-4b01-8432-68501a5d287c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:13.105924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433da02d-50da-4b01-8432-68501a5d287c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:13.110509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:13.111293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:13.111577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:13.111850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] PATH_INFO: `/v3/users/a2778c9b9c3846258abac7f659b25702` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:13.113064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2778c9b9c3846258abac7f659b25702)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:13.114951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:13.170999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2778c9b9c3846258abac7f659b25702'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:13.171597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2778c9b9c3846258abac7f659b25702'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:13.183445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2778c9b9c3846258abac7f659b25702'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:13.184098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2778c9b9c3846258abac7f659b25702'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:13.191511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2778c9b9c3846258abac7f659b25702'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:13.207868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 924/1848] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:13 2022] DELETE /identity/v3/users/a2778c9b9c3846258abac7f659b25702 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:13.213218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7088-5c48-425b-a64d-93967de5514e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:13.213687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7088-5c48-425b-a64d-93967de5514e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:13.213774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3b7088-5c48-425b-a64d-93967de5514e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:13.233752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fc3b7088-5c48-425b-a64d-93967de5514e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:13.235853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fc3b7088-5c48-425b-a64d-93967de5514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:13.307363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 925/1849] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:13.316995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:13.319053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:13.325797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:13.414277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce48ef3-1c81-4a13-b2e3-2681d947a082 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:13.427908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7364a-9601-43af-bfe7-c32e80cbfcdc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:13.428685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7364a-9601-43af-bfe7-c32e80cbfcdc service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:13.429072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7364a-9601-43af-bfe7-c32e80cbfcdc service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:13.429447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a7364a-9601-43af-bfe7-c32e80cbfcdc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:13.441226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7364a-9601-43af-bfe7-c32e80cbfcdc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:13.443187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a7364a-9601-43af-bfe7-c32e80cbfcdc service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:13.456303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 925/1850] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:14.372126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b7088-5c48-425b-a64d-93967de5514e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:14.373807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fc3b7088-5c48-425b-a64d-93967de5514e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:14.386589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3b7088-5c48-425b-a64d-93967de5514e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:14.392323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:14.393033 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:14.393408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:14.393575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] PATH_INFO: `/v3/projects/13adb1e048664725aeae433d0bbdba52` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:14.394704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13adb1e048664725aeae433d0bbdba52)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:14.396731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:14.400217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:14.456198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13adb1e048664725aeae433d0bbdba52', 'request_id': 'req-7c939f37-0015-4023-ab2e-ea9133f249b2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:14.465650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13adb1e048664725aeae433d0bbdba52', 'request_id': 'req-7c939f37-0015-4023-ab2e-ea9133f249b2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:14.473080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13adb1e048664725aeae433d0bbdba52', 'request_id': 'req-7c939f37-0015-4023-ab2e-ea9133f249b2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:14.501696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] The token cache is being invalidate because project 13adb1e048664725aeae433d0bbdba52 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:14.502005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:14.502655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:14.505898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 926/1851] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:14 2022] DELETE /identity/v3/projects/13adb1e048664725aeae433d0bbdba52 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:14.509619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7364a-9601-43af-bfe7-c32e80cbfcdc service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:14.520534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a7364a-9601-43af-bfe7-c32e80cbfcdc service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:14.580320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:14.580968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:14.581249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:14.581521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] PATH_INFO: `/v3/users/99fbd66c5d554c2fbe40fbd91a959b04` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:14.582645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99fbd66c5d554c2fbe40fbd91a959b04)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:14.584599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:14.640040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99fbd66c5d554c2fbe40fbd91a959b04'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:14.640885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99fbd66c5d554c2fbe40fbd91a959b04'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:14.654220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99fbd66c5d554c2fbe40fbd91a959b04'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:14.655106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99fbd66c5d554c2fbe40fbd91a959b04'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:14.668494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-274410e8-6f11-4849-b69b-b6390b5cb3b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99fbd66c5d554c2fbe40fbd91a959b04'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:14.684145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 926/1852] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:14 2022] DELETE /identity/v3/users/99fbd66c5d554c2fbe40fbd91a959b04 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:15.038961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:15.040646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:15.057834 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c939f37-0015-4023-ab2e-ea9133f249b2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:15.136881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:15.137614 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:15.137976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:15.138318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] PATH_INFO: `/v3/projects/a53f2e8acbe2416098362a47de2e7215` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:15.139837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a53f2e8acbe2416098362a47de2e7215)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:15.142032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:15.205474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a53f2e8acbe2416098362a47de2e7215', 'request_id': 'req-da3302e4-7113-4089-8782-1701b00d3517'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:15.216177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a53f2e8acbe2416098362a47de2e7215', 'request_id': 'req-da3302e4-7113-4089-8782-1701b00d3517'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:15.222387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a53f2e8acbe2416098362a47de2e7215', 'request_id': 'req-da3302e4-7113-4089-8782-1701b00d3517'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:15.235426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] The token cache is being invalidate because project a53f2e8acbe2416098362a47de2e7215 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:15.235814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:15.236376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da3302e4-7113-4089-8782-1701b00d3517 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:15.237947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 927/1853] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:15 2022] DELETE /identity/v3/projects/a53f2e8acbe2416098362a47de2e7215 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:15.244714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a0da-40ca-4263-86b2-5d115de6411c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:15.245080 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a0da-40ca-4263-86b2-5d115de6411c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:15.245424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3136a0da-40ca-4263-86b2-5d115de6411c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:15.267104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3136a0da-40ca-4263-86b2-5d115de6411c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:15.268957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3136a0da-40ca-4263-86b2-5d115de6411c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:15.296147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:15.352367 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 927/1854] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:15.355296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cb087-d447-4d9b-8b87-5b239bf8ee3e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:15.355732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cb087-d447-4d9b-8b87-5b239bf8ee3e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:15.356129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-982cb087-d447-4d9b-8b87-5b239bf8ee3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:15.390379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-982cb087-d447-4d9b-8b87-5b239bf8ee3e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:15.391426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-982cb087-d447-4d9b-8b87-5b239bf8ee3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:15.401976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 928/1855] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:15.406371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a0da-40ca-4263-86b2-5d115de6411c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:15.425098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3136a0da-40ca-4263-86b2-5d115de6411c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:15.444106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc3d1d-77dd-41f5-bd29-e45aa101dff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:15.447744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3d1d-77dd-41f5-bd29-e45aa101dff0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:15.448238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3d1d-77dd-41f5-bd29-e45aa101dff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:15.448445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fc3d1d-77dd-41f5-bd29-e45aa101dff0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:15.449278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc3d1d-77dd-41f5-bd29-e45aa101dff0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:15.449635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc3d1d-77dd-41f5-bd29-e45aa101dff0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:15.461775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fc3d1d-77dd-41f5-bd29-e45aa101dff0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:15.518118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 928/1856] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:27:15.523397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cb087-d447-4d9b-8b87-5b239bf8ee3e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:15.537649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-982cb087-d447-4d9b-8b87-5b239bf8ee3e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:15.552258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc791f4e-b750-4373-9f81-b641768f4634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:15.553095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791f4e-b750-4373-9f81-b641768f4634 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:15.553396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791f4e-b750-4373-9f81-b641768f4634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:15.553867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc791f4e-b750-4373-9f81-b641768f4634 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:15.554652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc791f4e-b750-4373-9f81-b641768f4634 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:15.559186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc791f4e-b750-4373-9f81-b641768f4634 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:15.595737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:15.635911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 929/1857] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:15 2022] POST /identity/v3/projects => generated 383 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:15.640649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc3d1d-77dd-41f5-bd29-e45aa101dff0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:15.654571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fc3d1d-77dd-41f5-bd29-e45aa101dff0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:15.760932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9cdca-c0da-4410-aa30-60efac368a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:15.761669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9cdca-c0da-4410-aa30-60efac368a9a admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:15.761961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9cdca-c0da-4410-aa30-60efac368a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:15.762297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb9cdca-c0da-4410-aa30-60efac368a9a admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:15.762956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9cdca-c0da-4410-aa30-60efac368a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:15.766990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb9cdca-c0da-4410-aa30-60efac368a9a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:15.800398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 929/1858] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:15 2022] POST /identity/v3/users => generated 292 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:15.803959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc791f4e-b750-4373-9f81-b641768f4634 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:15.814861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc791f4e-b750-4373-9f81-b641768f4634 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:15.820607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab204bc3-3efa-42da-b636-2b45e0e3ee57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:15.821954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab204bc3-3efa-42da-b636-2b45e0e3ee57 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:15.822387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab204bc3-3efa-42da-b636-2b45e0e3ee57 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:15.822835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab204bc3-3efa-42da-b636-2b45e0e3ee57 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:15.823636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab204bc3-3efa-42da-b636-2b45e0e3ee57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:15.825432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab204bc3-3efa-42da-b636-2b45e0e3ee57 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:15.840835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 930/1859] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:15.844801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9cdca-c0da-4410-aa30-60efac368a9a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:15.879526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb9cdca-c0da-4410-aa30-60efac368a9a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:15.898466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2180f2-752e-4311-9b2b-7803db888f52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:15.900932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2180f2-752e-4311-9b2b-7803db888f52 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:15.901429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2180f2-752e-4311-9b2b-7803db888f52 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:15.901911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2180f2-752e-4311-9b2b-7803db888f52 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:15.902836 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2180f2-752e-4311-9b2b-7803db888f52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:15.904818 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2180f2-752e-4311-9b2b-7803db888f52 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:15.926662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 930/1860] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:15 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:15.931587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab204bc3-3efa-42da-b636-2b45e0e3ee57 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:15.951383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab204bc3-3efa-42da-b636-2b45e0e3ee57 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:15.968582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475eed-19f2-467e-a23b-432482375d31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:15.969413 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475eed-19f2-467e-a23b-432482375d31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:15.969805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475eed-19f2-467e-a23b-432482375d31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:15.970201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8475eed-19f2-467e-a23b-432482375d31 admin admin] PATH_INFO: `/v3/projects/96a4598856a54c6c88478c1100993361/users/8bddb0be70a04b21b4ebda512cf40d7a/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:15.989056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8475eed-19f2-467e-a23b-432482375d31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a4598856a54c6c88478c1100993361, user_id=8bddb0be70a04b21b4ebda512cf40d7a, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:15.992221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8475eed-19f2-467e-a23b-432482375d31 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:16.009440 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 931/1861] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:15 2022] PUT /identity/v3/projects/96a4598856a54c6c88478c1100993361/users/8bddb0be70a04b21b4ebda512cf40d7a/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:16.020908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e9fbf-7b11-43ef-bb92-dbcfb06aff4c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:16.021586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e9fbf-7b11-43ef-bb92-dbcfb06aff4c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:16.022052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e9fbf-7b11-43ef-bb92-dbcfb06aff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:16.052637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8d9e9fbf-7b11-43ef-bb92-dbcfb06aff4c None None] MFA Rules not processed for user `8bddb0be70a04b21b4ebda512cf40d7a`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:16.054045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8d9e9fbf-7b11-43ef-bb92-dbcfb06aff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:16.129325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 931/1862] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:16.145738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475eed-19f2-467e-a23b-432482375d31 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:16.152039 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e8475eed-19f2-467e-a23b-432482375d31 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:16.241898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8475eed-19f2-467e-a23b-432482375d31 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:16.246786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d34605-bda9-4811-a108-5dc3ce120694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:16.247418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d34605-bda9-4811-a108-5dc3ce120694 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:16.247701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d34605-bda9-4811-a108-5dc3ce120694 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:16.247978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d34605-bda9-4811-a108-5dc3ce120694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:16.260569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d34605-bda9-4811-a108-5dc3ce120694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:16.262820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39d34605-bda9-4811-a108-5dc3ce120694 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:16.274509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 932/1863] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:16.296744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e9fbf-7b11-43ef-bb92-dbcfb06aff4c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:16.347736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:16.396072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e9fbf-7b11-43ef-bb92-dbcfb06aff4c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:16.401891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:16.402549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:16.402946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:16.403112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] PATH_INFO: `/v3/users/8bddb0be70a04b21b4ebda512cf40d7a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:16.404390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8bddb0be70a04b21b4ebda512cf40d7a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:16.406394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:16.455971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8bddb0be70a04b21b4ebda512cf40d7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:16.457082 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8bddb0be70a04b21b4ebda512cf40d7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:16.478422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8bddb0be70a04b21b4ebda512cf40d7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:16.479225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8bddb0be70a04b21b4ebda512cf40d7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:16.487873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8bddb0be70a04b21b4ebda512cf40d7a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:16.504192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 932/1864] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:16 2022] DELETE /identity/v3/users/8bddb0be70a04b21b4ebda512cf40d7a => generated 0 bytes in 208 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:16.508959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb872-cbfc-410c-82e9-683a31a147c7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:16.509559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb872-cbfc-410c-82e9-683a31a147c7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:16.509559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbb872-cbfc-410c-82e9-683a31a147c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:16.533401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-aacbb872-cbfc-410c-82e9-683a31a147c7 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:16.534978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aacbb872-cbfc-410c-82e9-683a31a147c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:16.614763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 933/1865] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:16.621787 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:16.628854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:16.720831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f65fa2-e058-4944-bf5a-401f7de40c91 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:16.725028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34826bc4-76e6-489b-b7bd-cb23fe9c63df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:16.725641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826bc4-76e6-489b-b7bd-cb23fe9c63df service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:16.725921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826bc4-76e6-489b-b7bd-cb23fe9c63df service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:16.726198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34826bc4-76e6-489b-b7bd-cb23fe9c63df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:16.737026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34826bc4-76e6-489b-b7bd-cb23fe9c63df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:16.738458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34826bc4-76e6-489b-b7bd-cb23fe9c63df service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:16.749419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 933/1866] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:17.201364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbb872-cbfc-410c-82e9-683a31a147c7 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:17.204037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aacbb872-cbfc-410c-82e9-683a31a147c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:17.230857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbb872-cbfc-410c-82e9-683a31a147c7 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:17.246398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:17.247122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:17.247575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:17.247905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] PATH_INFO: `/v3/projects/96a4598856a54c6c88478c1100993361` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:17.250774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a4598856a54c6c88478c1100993361)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:17.255989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:17.364702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a4598856a54c6c88478c1100993361', 'request_id': 'req-2a28e412-42ac-4b80-95fb-92efae5e01f3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:17.368853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34826bc4-76e6-489b-b7bd-cb23fe9c63df service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:17.370277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-34826bc4-76e6-489b-b7bd-cb23fe9c63df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:17.373108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a4598856a54c6c88478c1100993361', 'request_id': 'req-2a28e412-42ac-4b80-95fb-92efae5e01f3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:17.375648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=2,keystone:SELECT=93,keystone:DELETE=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:17.385321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a4598856a54c6c88478c1100993361', 'request_id': 'req-2a28e412-42ac-4b80-95fb-92efae5e01f3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:17.389055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34826bc4-76e6-489b-b7bd-cb23fe9c63df service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:17.404058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] The token cache is being invalidate because project 96a4598856a54c6c88478c1100993361 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:17.404649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:17.415322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a28e412-42ac-4b80-95fb-92efae5e01f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:17.427600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 934/1867] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:17 2022] DELETE /identity/v3/projects/96a4598856a54c6c88478c1100993361 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:17.429317 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7e80-8312-4bb4-ab64-94b26c444758 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:17.431412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7e80-8312-4bb4-ab64-94b26c444758 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:17.432857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502c7e80-8312-4bb4-ab64-94b26c444758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:17.450343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:17.474073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-502c7e80-8312-4bb4-ab64-94b26c444758 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:17.477114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-502c7e80-8312-4bb4-ab64-94b26c444758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:17.509627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:17.514975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:17.515355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:17.515712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] PATH_INFO: `/v3/users/3046ad9d12f543a8ba28cec0eb765bc4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:17.521288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3046ad9d12f543a8ba28cec0eb765bc4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:17.530813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:17.592104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3046ad9d12f543a8ba28cec0eb765bc4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:17.592908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3046ad9d12f543a8ba28cec0eb765bc4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:17.597007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 935/1868] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:17.605509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef4e7-b25a-4f0c-9aea-790344888c3d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:17.605802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef4e7-b25a-4f0c-9aea-790344888c3d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:17.606078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cef4e7-b25a-4f0c-9aea-790344888c3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:17.613659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3046ad9d12f543a8ba28cec0eb765bc4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:17.614370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3046ad9d12f543a8ba28cec0eb765bc4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:17.622880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3046ad9d12f543a8ba28cec0eb765bc4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:17.632902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b1cef4e7-b25a-4f0c-9aea-790344888c3d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:17.634954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b1cef4e7-b25a-4f0c-9aea-790344888c3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:17.645892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 936/1870] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:17.646431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 934/1870] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:17 2022] DELETE /identity/v3/users/3046ad9d12f543a8ba28cec0eb765bc4 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:17.648714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2ec5b-8034-498e-88bb-90f46f2538a4 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:17.649118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2ec5b-8034-498e-88bb-90f46f2538a4 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:17.649564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3b2ec5b-8034-498e-88bb-90f46f2538a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:17.653926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:17.676886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b3b2ec5b-8034-498e-88bb-90f46f2538a4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:17.678106 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b3b2ec5b-8034-498e-88bb-90f46f2538a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:17.735963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec209337-c410-4024-a0d4-ae48b9c2f55a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:17.743258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c241b-38f9-4177-a5d3-e07adb56ed96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:17.744844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c241b-38f9-4177-a5d3-e07adb56ed96 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:17.745136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c241b-38f9-4177-a5d3-e07adb56ed96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:17.745428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702c241b-38f9-4177-a5d3-e07adb56ed96 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:17.746101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c241b-38f9-4177-a5d3-e07adb56ed96 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:17.746388 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c241b-38f9-4177-a5d3-e07adb56ed96 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:17.748236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702c241b-38f9-4177-a5d3-e07adb56ed96 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:17.753382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 937/1871] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:17.769125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2ec5b-8034-498e-88bb-90f46f2538a4 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:17.770602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b3b2ec5b-8034-498e-88bb-90f46f2538a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:17.773844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 935/1872] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:27:17.776765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c241b-38f9-4177-a5d3-e07adb56ed96 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:17.793788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702c241b-38f9-4177-a5d3-e07adb56ed96 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:17.801398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907668b-14fd-4075-898d-4b247cdbd8c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:17.802700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907668b-14fd-4075-898d-4b247cdbd8c6 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:17.803132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907668b-14fd-4075-898d-4b247cdbd8c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:17.803540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2907668b-14fd-4075-898d-4b247cdbd8c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:17.804682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907668b-14fd-4075-898d-4b247cdbd8c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:17.808261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2907668b-14fd-4075-898d-4b247cdbd8c6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:17.852526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 936/1873] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:17 2022] POST /identity/v3/projects => generated 375 bytes in 76 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:17.857948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907668b-14fd-4075-898d-4b247cdbd8c6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:17.870047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3b2ec5b-8034-498e-88bb-90f46f2538a4 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:17.914384 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:17.939096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:17.956884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa9e33-b7f3-48c0-a63a-b412af560281 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:17.957677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa9e33-b7f3-48c0-a63a-b412af560281 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:17.958600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa9e33-b7f3-48c0-a63a-b412af560281 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:17.959951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7daa9e33-b7f3-48c0-a63a-b412af560281 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:17.980231 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2907668b-14fd-4075-898d-4b247cdbd8c6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:17.988177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e36a48-451b-46d3-9598-405a803f7609 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:17.988961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36a48-451b-46d3-9598-405a803f7609 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:17.989345 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36a48-451b-46d3-9598-405a803f7609 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:17.989729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e36a48-451b-46d3-9598-405a803f7609 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:17.990565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e36a48-451b-46d3-9598-405a803f7609 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:17.993232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e36a48-451b-46d3-9598-405a803f7609 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.017890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 937/1874] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:17 2022] POST /identity/v3/users => generated 288 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:18.032320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e36a48-451b-46d3-9598-405a803f7609 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:18.051424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e36a48-451b-46d3-9598-405a803f7609 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:18.059725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de2a40-f1ae-4150-8669-fc525594e9e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:18.059975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa9e33-b7f3-48c0-a63a-b412af560281 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:18.060433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de2a40-f1ae-4150-8669-fc525594e9e5 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.060710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de2a40-f1ae-4150-8669-fc525594e9e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.060996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4de2a40-f1ae-4150-8669-fc525594e9e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.061559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7daa9e33-b7f3-48c0-a63a-b412af560281 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.061668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de2a40-f1ae-4150-8669-fc525594e9e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:18.063303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4de2a40-f1ae-4150-8669-fc525594e9e5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.081735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 938/1875] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:18.085303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de2a40-f1ae-4150-8669-fc525594e9e5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:18.087440 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 938/1876] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:18.096803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4de2a40-f1ae-4150-8669-fc525594e9e5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:18.103592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ad48583-e22f-4e61-928e-e8182a00f577 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:18.104899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad48583-e22f-4e61-928e-e8182a00f577 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.104899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad48583-e22f-4e61-928e-e8182a00f577 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.104899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ad48583-e22f-4e61-928e-e8182a00f577 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.105429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad48583-e22f-4e61-928e-e8182a00f577 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:18.107150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ad48583-e22f-4e61-928e-e8182a00f577 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.128777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 939/1877] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:18.133949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa9e33-b7f3-48c0-a63a-b412af560281 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:18.146266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7daa9e33-b7f3-48c0-a63a-b412af560281 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:18.153283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b04300-3793-4684-8a7b-9e394eb90324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:18.154552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b04300-3793-4684-8a7b-9e394eb90324 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.155184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b04300-3793-4684-8a7b-9e394eb90324 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.155616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b04300-3793-4684-8a7b-9e394eb90324 admin admin] PATH_INFO: `/v3/projects/486dc3e5b0ac4e189d1be61a06f36ed4/users/10a076ffa8934de9a90ee563ad3d87cb/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.181628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b04300-3793-4684-8a7b-9e394eb90324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=486dc3e5b0ac4e189d1be61a06f36ed4, user_id=10a076ffa8934de9a90ee563ad3d87cb, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:18.186796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b04300-3793-4684-8a7b-9e394eb90324 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.205636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 939/1878] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:18 2022] PUT /identity/v3/projects/486dc3e5b0ac4e189d1be61a06f36ed4/users/10a076ffa8934de9a90ee563ad3d87cb/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:18.216475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3258837-380e-42e5-ab94-fcc3e528c082 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.216826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3258837-380e-42e5-ab94-fcc3e528c082 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.217194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3258837-380e-42e5-ab94-fcc3e528c082 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.257286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f3258837-380e-42e5-ab94-fcc3e528c082 None None] MFA Rules not processed for user `10a076ffa8934de9a90ee563ad3d87cb`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:18.258800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f3258837-380e-42e5-ab94-fcc3e528c082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:18.401796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 940/1879] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:18.406971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b04300-3793-4684-8a7b-9e394eb90324 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:18.509792 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b04300-3793-4684-8a7b-9e394eb90324 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:18.514946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bc506-6a3c-4b01-8550-45c8195b0155 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:18.516799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bc506-6a3c-4b01-8550-45c8195b0155 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.517070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bc506-6a3c-4b01-8550-45c8195b0155 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.517344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d9bc506-6a3c-4b01-8550-45c8195b0155 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.517990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bc506-6a3c-4b01-8550-45c8195b0155 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:18.520207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d9bc506-6a3c-4b01-8550-45c8195b0155 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.558732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 940/1880] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:18 2022] POST /identity/v3/projects => generated 373 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:18.562465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3258837-380e-42e5-ab94-fcc3e528c082 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:18.574969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3258837-380e-42e5-ab94-fcc3e528c082 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:18.644575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded23dd-9368-4e98-8b79-0d7dff557889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:18.645327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded23dd-9368-4e98-8b79-0d7dff557889 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.645544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded23dd-9368-4e98-8b79-0d7dff557889 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.645816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded23dd-9368-4e98-8b79-0d7dff557889 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.646446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded23dd-9368-4e98-8b79-0d7dff557889 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:18.648446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded23dd-9368-4e98-8b79-0d7dff557889 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.676069 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 941/1881] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:18 2022] POST /identity/v3/users => generated 293 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:18.678726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bc506-6a3c-4b01-8550-45c8195b0155 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:18.689333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d9bc506-6a3c-4b01-8550-45c8195b0155 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:18.696260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf70078-0694-4593-9739-430924b3e6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:18.697088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70078-0694-4593-9739-430924b3e6f8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.697554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70078-0694-4593-9739-430924b3e6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.697947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf70078-0694-4593-9739-430924b3e6f8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.698714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf70078-0694-4593-9739-430924b3e6f8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:18.700585 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf70078-0694-4593-9739-430924b3e6f8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.716203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 941/1882] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:18.718356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded23dd-9368-4e98-8b79-0d7dff557889 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:18.728826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded23dd-9368-4e98-8b79-0d7dff557889 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:18.733887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d34f9-7042-4719-a958-cab3e1625297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:18.734551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d34f9-7042-4719-a958-cab3e1625297 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.734834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d34f9-7042-4719-a958-cab3e1625297 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.735112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d8d34f9-7042-4719-a958-cab3e1625297 admin admin] PATH_INFO: `/v3/projects/3a001f4bec324ef59b1d0f0cc437d53d/users/648b580f7a914f09adf2685153f6bc9d/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.753305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d34f9-7042-4719-a958-cab3e1625297 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a001f4bec324ef59b1d0f0cc437d53d, user_id=648b580f7a914f09adf2685153f6bc9d, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:18.756135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d8d34f9-7042-4719-a958-cab3e1625297 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.766610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:18.773302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 942/1883] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:18 2022] PUT /identity/v3/projects/3a001f4bec324ef59b1d0f0cc437d53d/users/648b580f7a914f09adf2685153f6bc9d/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:18.778492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf70078-0694-4593-9739-430924b3e6f8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:18.792587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf70078-0694-4593-9739-430924b3e6f8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:18.835233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:18.877742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50fe4e5e-fc38-40af-a89f-66ab05be17f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:18.878366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4e5e-fc38-40af-a89f-66ab05be17f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.878642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4e5e-fc38-40af-a89f-66ab05be17f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.878919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50fe4e5e-fc38-40af-a89f-66ab05be17f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.879649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe4e5e-fc38-40af-a89f-66ab05be17f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:18.881299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50fe4e5e-fc38-40af-a89f-66ab05be17f0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.894753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 942/1884] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:18 2022] GET /identity/v3/roles => generated 1420 bytes in 117 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:18.899827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d34f9-7042-4719-a958-cab3e1625297 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:18.910701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d8d34f9-7042-4719-a958-cab3e1625297 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:18.915243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ef067-a589-4c63-a56d-a6a2fb9cee7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:18.915896 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ef067-a589-4c63-a56d-a6a2fb9cee7e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.916194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ef067-a589-4c63-a56d-a6a2fb9cee7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.916470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ef067-a589-4c63-a56d-a6a2fb9cee7e admin admin] PATH_INFO: `/v3/projects/3a001f4bec324ef59b1d0f0cc437d53d/users/648b580f7a914f09adf2685153f6bc9d/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.918438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ef067-a589-4c63-a56d-a6a2fb9cee7e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a001f4bec324ef59b1d0f0cc437d53d, user_id=648b580f7a914f09adf2685153f6bc9d, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:18.921085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4ef067-a589-4c63-a56d-a6a2fb9cee7e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:18.931873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 943/1885] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:18 2022] PUT /identity/v3/projects/3a001f4bec324ef59b1d0f0cc437d53d/users/648b580f7a914f09adf2685153f6bc9d/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:18.943393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1046e41-c394-41a1-9ac1-63c913b57a75 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:18.943691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1046e41-c394-41a1-9ac1-63c913b57a75 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:18.944006 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1046e41-c394-41a1-9ac1-63c913b57a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:18.948214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ef067-a589-4c63-a56d-a6a2fb9cee7e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:18.950630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7d4ef067-a589-4c63-a56d-a6a2fb9cee7e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:18.982193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d1046e41-c394-41a1-9ac1-63c913b57a75 None None] MFA Rules not processed for user `648b580f7a914f09adf2685153f6bc9d`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:18.984019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d1046e41-c394-41a1-9ac1-63c913b57a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:19.046302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ef067-a589-4c63-a56d-a6a2fb9cee7e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:19.051757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:19.052504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:19.052852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:19.053196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] PATH_INFO: `/v3/projects/6cdb6271bdc3463a8ec68a232d851fc1` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:19.054786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6cdb6271bdc3463a8ec68a232d851fc1)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:19.056957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:19.092254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 943/1886] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:19.106143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1046e41-c394-41a1-9ac1-63c913b57a75 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:19.107621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d1046e41-c394-41a1-9ac1-63c913b57a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:19.119681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6cdb6271bdc3463a8ec68a232d851fc1', 'request_id': 'req-87a49971-51f8-4959-86b8-6e9103ddfc20'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:19.126311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6cdb6271bdc3463a8ec68a232d851fc1', 'request_id': 'req-87a49971-51f8-4959-86b8-6e9103ddfc20'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:19.142696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6cdb6271bdc3463a8ec68a232d851fc1', 'request_id': 'req-87a49971-51f8-4959-86b8-6e9103ddfc20'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:19.158433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] The token cache is being invalidate because project 6cdb6271bdc3463a8ec68a232d851fc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:19.158752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:19.159583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:19.161992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 944/1887] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:18 2022] DELETE /identity/v3/projects/6cdb6271bdc3463a8ec68a232d851fc1 => generated 0 bytes in 214 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:19.166142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:19.167642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:19.202833 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1046e41-c394-41a1-9ac1-63c913b57a75 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:19.254185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a49971-51f8-4959-86b8-6e9103ddfc20 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:19.261722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:19.262438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:19.262790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:19.262980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] PATH_INFO: `/v3/users/6b86bf2dfb074b27a5814af03b37421d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:19.264659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b86bf2dfb074b27a5814af03b37421d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:19.267167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:19.289788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:19.338972 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b86bf2dfb074b27a5814af03b37421d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:19.339864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9488032-07d9-41b3-bb48-208d006b7c60 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:19.340228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b86bf2dfb074b27a5814af03b37421d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:19.343986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9488032-07d9-41b3-bb48-208d006b7c60 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:19.344772 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9488032-07d9-41b3-bb48-208d006b7c60 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:19.345072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9488032-07d9-41b3-bb48-208d006b7c60 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:19.350168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b9488032-07d9-41b3-bb48-208d006b7c60 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:19.361139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b86bf2dfb074b27a5814af03b37421d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:19.362491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b86bf2dfb074b27a5814af03b37421d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:19.373896 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b86bf2dfb074b27a5814af03b37421d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:19.395481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 945/1888] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:19 2022] DELETE /identity/v3/users/6b86bf2dfb074b27a5814af03b37421d => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:19.447970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:19.584541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9488032-07d9-41b3-bb48-208d006b7c60 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:19.588123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9488032-07d9-41b3-bb48-208d006b7c60 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:19.618370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 944/1889] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:19 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 513 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:19.977829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:19.980363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:20.158061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7e2e77-5ebc-4b7c-9f96-3bb6ab1784bc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:20.164311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:20.165061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:20.165394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:20.165851 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] PATH_INFO: `/v3/projects/9c37d48bc5de4e748b0a037d1ae81201` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:20.167128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c37d48bc5de4e748b0a037d1ae81201)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:20.169449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:20.259184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c37d48bc5de4e748b0a037d1ae81201', 'request_id': 'req-415f791d-c91d-4cff-97d6-9b18b0dd48a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:20.273150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c37d48bc5de4e748b0a037d1ae81201', 'request_id': 'req-415f791d-c91d-4cff-97d6-9b18b0dd48a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:20.292547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c37d48bc5de4e748b0a037d1ae81201', 'request_id': 'req-415f791d-c91d-4cff-97d6-9b18b0dd48a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:20.333640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] The token cache is being invalidate because project 9c37d48bc5de4e748b0a037d1ae81201 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:20.333940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:20.336964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-415f791d-c91d-4cff-97d6-9b18b0dd48a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:20.346810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 946/1890] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:19 2022] DELETE /identity/v3/projects/9c37d48bc5de4e748b0a037d1ae81201 => generated 0 bytes in 367 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:20.348704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe5d45-b357-46b2-8ed0-0a442fa7973d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:20.349204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe5d45-b357-46b2-8ed0-0a442fa7973d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:20.349310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe5d45-b357-46b2-8ed0-0a442fa7973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:20.377618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-14fe5d45-b357-46b2-8ed0-0a442fa7973d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:20.379006 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-14fe5d45-b357-46b2-8ed0-0a442fa7973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:20.526049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 945/1891] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:20.527340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a484-212c-47ee-bfab-377f5010532d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:20.527666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a484-212c-47ee-bfab-377f5010532d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:20.527913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee0a484-212c-47ee-bfab-377f5010532d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:20.560643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6ee0a484-212c-47ee-bfab-377f5010532d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:20.562503 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6ee0a484-212c-47ee-bfab-377f5010532d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:20.573294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 947/1892] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:20.578328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe5d45-b357-46b2-8ed0-0a442fa7973d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:20.590629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe5d45-b357-46b2-8ed0-0a442fa7973d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:20.596097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406d6a9-d6dc-46c8-8fa8-489dc60635b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:20.596745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406d6a9-d6dc-46c8-8fa8-489dc60635b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:20.597053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406d6a9-d6dc-46c8-8fa8-489dc60635b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:20.597324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a406d6a9-d6dc-46c8-8fa8-489dc60635b9 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:20.598137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406d6a9-d6dc-46c8-8fa8-489dc60635b9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:20.598441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406d6a9-d6dc-46c8-8fa8-489dc60635b9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:20.600044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a406d6a9-d6dc-46c8-8fa8-489dc60635b9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:20.619709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 946/1893] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:27:20.625074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a484-212c-47ee-bfab-377f5010532d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:20.635762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee0a484-212c-47ee-bfab-377f5010532d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:20.640506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7386e-d2d2-4c94-bfbe-c8f87ec4f1ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:20.641125 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7386e-d2d2-4c94-bfbe-c8f87ec4f1ac admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:20.641407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7386e-d2d2-4c94-bfbe-c8f87ec4f1ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:20.641677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d7386e-d2d2-4c94-bfbe-c8f87ec4f1ac admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:20.642327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7386e-d2d2-4c94-bfbe-c8f87ec4f1ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:20.644283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d7386e-d2d2-4c94-bfbe-c8f87ec4f1ac admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:20.661304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=16,keystone:SELECT=81,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:20.674264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 948/1894] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:20 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:20.678459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406d6a9-d6dc-46c8-8fa8-489dc60635b9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:20.688993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a406d6a9-d6dc-46c8-8fa8-489dc60635b9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:20.751491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37ec3f-b41f-40c6-bef3-ce49ea1106b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:20.752128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37ec3f-b41f-40c6-bef3-ce49ea1106b3 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:20.752444 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37ec3f-b41f-40c6-bef3-ce49ea1106b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:20.752854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea37ec3f-b41f-40c6-bef3-ce49ea1106b3 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:20.753577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37ec3f-b41f-40c6-bef3-ce49ea1106b3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:20.755607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea37ec3f-b41f-40c6-bef3-ce49ea1106b3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:20.786345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 947/1895] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:20 2022] POST /identity/v3/users => generated 282 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:20.788757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7386e-d2d2-4c94-bfbe-c8f87ec4f1ac admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:20.802042 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d7386e-d2d2-4c94-bfbe-c8f87ec4f1ac admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:20.809191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d683f57-61e7-46d9-bcc2-f1d087e9a620 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:20.810029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d683f57-61e7-46d9-bcc2-f1d087e9a620 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:20.810534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d683f57-61e7-46d9-bcc2-f1d087e9a620 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:20.811366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d683f57-61e7-46d9-bcc2-f1d087e9a620 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:20.811366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d683f57-61e7-46d9-bcc2-f1d087e9a620 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:20.813737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d683f57-61e7-46d9-bcc2-f1d087e9a620 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:20.830788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 949/1896] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:20.832248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37ec3f-b41f-40c6-bef3-ce49ea1106b3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:20.852696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea37ec3f-b41f-40c6-bef3-ce49ea1106b3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:20.863739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ba087b-0eb4-455f-8b9b-a2379bbe37de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:20.865320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba087b-0eb4-455f-8b9b-a2379bbe37de admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:20.865610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba087b-0eb4-455f-8b9b-a2379bbe37de admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:20.865892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ba087b-0eb4-455f-8b9b-a2379bbe37de admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:20.870069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba087b-0eb4-455f-8b9b-a2379bbe37de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:20.873140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ba087b-0eb4-455f-8b9b-a2379bbe37de admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:20.898128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 948/1897] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:20 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:20.902683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d683f57-61e7-46d9-bcc2-f1d087e9a620 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:20.917281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d683f57-61e7-46d9-bcc2-f1d087e9a620 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:20.924497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427febbc-96e7-4c3c-a54e-18ba069907d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:20.925915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427febbc-96e7-4c3c-a54e-18ba069907d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:20.926326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427febbc-96e7-4c3c-a54e-18ba069907d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:20.926731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427febbc-96e7-4c3c-a54e-18ba069907d5 admin admin] PATH_INFO: `/v3/projects/be68969c50e34ff895dbcbc09bd8ab80/users/de04e2c7a71447cbab8bdcd9c214e9b4/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:20.949890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427febbc-96e7-4c3c-a54e-18ba069907d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be68969c50e34ff895dbcbc09bd8ab80, user_id=de04e2c7a71447cbab8bdcd9c214e9b4, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:20.953266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427febbc-96e7-4c3c-a54e-18ba069907d5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:20.975543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 950/1898] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:20 2022] PUT /identity/v3/projects/be68969c50e34ff895dbcbc09bd8ab80/users/de04e2c7a71447cbab8bdcd9c214e9b4/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:20.987188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acbe5-963e-4853-b1f2-da77a9687c2d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:20.987646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acbe5-963e-4853-b1f2-da77a9687c2d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:20.988040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2acbe5-963e-4853-b1f2-da77a9687c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:21.020758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7b2acbe5-963e-4853-b1f2-da77a9687c2d None None] MFA Rules not processed for user `de04e2c7a71447cbab8bdcd9c214e9b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:21.021637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7b2acbe5-963e-4853-b1f2-da77a9687c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:21.047593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:21.103865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 949/1899] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:20 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:21.109322 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427febbc-96e7-4c3c-a54e-18ba069907d5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:21.212689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427febbc-96e7-4c3c-a54e-18ba069907d5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:21.218874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3931384-93f4-4b37-af41-48d79e341b4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:21.219767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3931384-93f4-4b37-af41-48d79e341b4d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:21.220196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3931384-93f4-4b37-af41-48d79e341b4d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:21.220591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3931384-93f4-4b37-af41-48d79e341b4d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:21.221334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3931384-93f4-4b37-af41-48d79e341b4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:21.223395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3931384-93f4-4b37-af41-48d79e341b4d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:21.274494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 951/1900] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:21 2022] POST /identity/v3/projects => generated 365 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:21.279781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2acbe5-963e-4853-b1f2-da77a9687c2d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:21.309485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2acbe5-963e-4853-b1f2-da77a9687c2d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:21.393877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417170f4-f509-4f9c-a038-c65990e9f80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:21.394783 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417170f4-f509-4f9c-a038-c65990e9f80f admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:21.395240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417170f4-f509-4f9c-a038-c65990e9f80f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:21.395523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417170f4-f509-4f9c-a038-c65990e9f80f admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:21.400579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417170f4-f509-4f9c-a038-c65990e9f80f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:21.403198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417170f4-f509-4f9c-a038-c65990e9f80f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:21.447130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3931384-93f4-4b37-af41-48d79e341b4d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:21.454196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 950/1901] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:21 2022] POST /identity/v3/users => generated 289 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:21.470654 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3931384-93f4-4b37-af41-48d79e341b4d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:21.480392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b55291-1365-4375-ba22-2a87d0493610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:21.481175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b55291-1365-4375-ba22-2a87d0493610 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:21.481565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b55291-1365-4375-ba22-2a87d0493610 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:21.481970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b55291-1365-4375-ba22-2a87d0493610 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:21.482786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b55291-1365-4375-ba22-2a87d0493610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:21.486694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b55291-1365-4375-ba22-2a87d0493610 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:21.504208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 952/1902] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:21.509418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417170f4-f509-4f9c-a038-c65990e9f80f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:21.523260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417170f4-f509-4f9c-a038-c65990e9f80f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:21.532275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb77c4-d320-42fc-a934-1e8026664dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:21.532966 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb77c4-d320-42fc-a934-1e8026664dac admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:21.533251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb77c4-d320-42fc-a934-1e8026664dac admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:21.534352 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81fb77c4-d320-42fc-a934-1e8026664dac admin admin] PATH_INFO: `/v3/projects/aee020854e504780bc281fc81dbf79a6/users/9051d74ff7e546dc80538f22841b0b33/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:21.557770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb77c4-d320-42fc-a934-1e8026664dac admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee020854e504780bc281fc81dbf79a6, user_id=9051d74ff7e546dc80538f22841b0b33, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:21.561120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81fb77c4-d320-42fc-a934-1e8026664dac admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:21.603513 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 951/1903] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:21 2022] PUT /identity/v3/projects/aee020854e504780bc281fc81dbf79a6/users/9051d74ff7e546dc80538f22841b0b33/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:21.607292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b55291-1365-4375-ba22-2a87d0493610 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:21.623781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b55291-1365-4375-ba22-2a87d0493610 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:21.755363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787b2325-7fa8-42e1-b14d-9ec1b5599a58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:21.756578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2325-7fa8-42e1-b14d-9ec1b5599a58 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:21.756578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2325-7fa8-42e1-b14d-9ec1b5599a58 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:21.756940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787b2325-7fa8-42e1-b14d-9ec1b5599a58 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:21.758186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b2325-7fa8-42e1-b14d-9ec1b5599a58 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:21.764218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-787b2325-7fa8-42e1-b14d-9ec1b5599a58 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:21.790978 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 953/1904] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:21.794638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb77c4-d320-42fc-a934-1e8026664dac admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:21.808988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81fb77c4-d320-42fc-a934-1e8026664dac admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:21.817882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e21c1-2aed-4f40-936c-31d53684a14f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:21.819625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e21c1-2aed-4f40-936c-31d53684a14f admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:21.820189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e21c1-2aed-4f40-936c-31d53684a14f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:21.820872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e21c1-2aed-4f40-936c-31d53684a14f admin admin] PATH_INFO: `/v3/projects/aee020854e504780bc281fc81dbf79a6/users/9051d74ff7e546dc80538f22841b0b33/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:21.823647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e21c1-2aed-4f40-936c-31d53684a14f admin admin] RBAC: Authorizing `identity:create_grant(project_id=aee020854e504780bc281fc81dbf79a6, user_id=9051d74ff7e546dc80538f22841b0b33, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:21.828582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e21c1-2aed-4f40-936c-31d53684a14f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:21.853689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 952/1905] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:21 2022] PUT /identity/v3/projects/aee020854e504780bc281fc81dbf79a6/users/9051d74ff7e546dc80538f22841b0b33/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:21.865150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b98629-8468-4297-9354-352db9aaea1d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:21.865439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b98629-8468-4297-9354-352db9aaea1d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:21.865727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b98629-8468-4297-9354-352db9aaea1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:21.915794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-27b98629-8468-4297-9354-352db9aaea1d None None] MFA Rules not processed for user `9051d74ff7e546dc80538f22841b0b33`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:21.917370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-27b98629-8468-4297-9354-352db9aaea1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:21.957186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:22.036211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 954/1906] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:21 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:22.049156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e21c1-2aed-4f40-936c-31d53684a14f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:22.051194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-470e21c1-2aed-4f40-936c-31d53684a14f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:22.146594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e21c1-2aed-4f40-936c-31d53684a14f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:22.153446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a43a52-aaa7-4987-b6ef-91b3dc52ed83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:22.154323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a43a52-aaa7-4987-b6ef-91b3dc52ed83 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:22.154797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a43a52-aaa7-4987-b6ef-91b3dc52ed83 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:22.155284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a43a52-aaa7-4987-b6ef-91b3dc52ed83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:22.157047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b98629-8468-4297-9354-352db9aaea1d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:22.158499 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-27b98629-8468-4297-9354-352db9aaea1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:22.168906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a43a52-aaa7-4987-b6ef-91b3dc52ed83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:22.171811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a43a52-aaa7-4987-b6ef-91b3dc52ed83 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:22.196351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 953/1907] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:22 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:22.286934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b98629-8468-4297-9354-352db9aaea1d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:22.293623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:22.295062 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:22.295520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:22.295907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] PATH_INFO: `/v3/users/5ced4364f1bc464287b959bd4f1c6158` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:22.297317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=5ced4364f1bc464287b959bd4f1c6158)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:22.300894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:22.331748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a43a52-aaa7-4987-b6ef-91b3dc52ed83 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:22.343257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a43a52-aaa7-4987-b6ef-91b3dc52ed83 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:22.347472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4fee5-cdd9-42ca-877d-34a4f69f9623 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:22.348089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4fee5-cdd9-42ca-877d-34a4f69f9623 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:22.348438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4fee5-cdd9-42ca-877d-34a4f69f9623 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:22.348893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e4fee5-cdd9-42ca-877d-34a4f69f9623 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:22.368504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:22.377380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5ced4364f1bc464287b959bd4f1c6158'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:22.378216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5ced4364f1bc464287b959bd4f1c6158'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:22.395199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5ced4364f1bc464287b959bd4f1c6158'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:22.397415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5ced4364f1bc464287b959bd4f1c6158'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:22.408266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-90439a63-d730-41f6-b2fc-80eaff885e0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5ced4364f1bc464287b959bd4f1c6158'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:22.423316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4fee5-cdd9-42ca-877d-34a4f69f9623 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:22.425483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e4fee5-cdd9-42ca-877d-34a4f69f9623 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:22.433971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 955/1908] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:22 2022] DELETE /identity/v3/users/5ced4364f1bc464287b959bd4f1c6158 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:22.436298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612bedd-a959-473e-abc1-aa2f65423033 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:22.436590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612bedd-a959-473e-abc1-aa2f65423033 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:22.436870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6612bedd-a959-473e-abc1-aa2f65423033 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:22.438175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 954/1909] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:22 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:22.476665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6612bedd-a959-473e-abc1-aa2f65423033 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:22.478236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6612bedd-a959-473e-abc1-aa2f65423033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:22.535941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:22.596915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 956/1910] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:22.612070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4fee5-cdd9-42ca-877d-34a4f69f9623 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:22.614902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b5e4fee5-cdd9-42ca-877d-34a4f69f9623 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:22.728130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e4fee5-cdd9-42ca-877d-34a4f69f9623 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:22.741582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612bedd-a959-473e-abc1-aa2f65423033 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:22.743686 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6612bedd-a959-473e-abc1-aa2f65423033 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:22.756907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6612bedd-a959-473e-abc1-aa2f65423033 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:22.762368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:22.763028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:22.763304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:22.763580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] PATH_INFO: `/v3/users/10a076ffa8934de9a90ee563ad3d87cb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:22.765121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] RBAC: Authorizing `identity:delete_user(user_id=10a076ffa8934de9a90ee563ad3d87cb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:22.767143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:22.818394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-979707dc-3af4-47d4-822e-11aff64014eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:22.819322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979707dc-3af4-47d4-822e-11aff64014eb service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:22.819668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979707dc-3af4-47d4-822e-11aff64014eb service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:22.820009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-979707dc-3af4-47d4-822e-11aff64014eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:22.831878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10a076ffa8934de9a90ee563ad3d87cb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:22.832131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979707dc-3af4-47d4-822e-11aff64014eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:22.832772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10a076ffa8934de9a90ee563ad3d87cb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:22.833752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-979707dc-3af4-47d4-822e-11aff64014eb service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:22.847371 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 955/1911] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:22.849047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10a076ffa8934de9a90ee563ad3d87cb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:22.849915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10a076ffa8934de9a90ee563ad3d87cb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:22.859271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10a076ffa8934de9a90ee563ad3d87cb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:22.878732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 957/1912] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:22 2022] DELETE /identity/v3/users/10a076ffa8934de9a90ee563ad3d87cb => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:22.884292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685388-bbf3-43a1-b1af-66799d337d4d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:22.884574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685388-bbf3-43a1-b1af-66799d337d4d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:22.884848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16685388-bbf3-43a1-b1af-66799d337d4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:22.905784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-16685388-bbf3-43a1-b1af-66799d337d4d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:22.907030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-16685388-bbf3-43a1-b1af-66799d337d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:22.976939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 956/1913] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:23.001159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:23.006207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:23.174811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410dd122-e4cd-4a27-b4dd-fa81294b46de admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:23.183604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fb5f3-9b34-4f4c-a66d-1ef2701f9913 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:23.184509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fb5f3-9b34-4f4c-a66d-1ef2701f9913 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:23.184861 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fb5f3-9b34-4f4c-a66d-1ef2701f9913 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:23.185709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1fb5f3-9b34-4f4c-a66d-1ef2701f9913 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:23.197687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fb5f3-9b34-4f4c-a66d-1ef2701f9913 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:23.201408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1fb5f3-9b34-4f4c-a66d-1ef2701f9913 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:23.214340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 958/1914] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:23.654769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16685388-bbf3-43a1-b1af-66799d337d4d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:23.657122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-16685388-bbf3-43a1-b1af-66799d337d4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:23.678741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16685388-bbf3-43a1-b1af-66799d337d4d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:23.686821 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:23.687500 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:23.687784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:23.688187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] PATH_INFO: `/v3/projects/486dc3e5b0ac4e189d1be61a06f36ed4` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:23.689909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] RBAC: Authorizing `identity:delete_project(project_id=486dc3e5b0ac4e189d1be61a06f36ed4)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:23.691581 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:23.704436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:23.758927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '486dc3e5b0ac4e189d1be61a06f36ed4', 'request_id': 'req-2f2d2cda-7036-412f-9e15-768bd9d65121'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:23.768638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '486dc3e5b0ac4e189d1be61a06f36ed4', 'request_id': 'req-2f2d2cda-7036-412f-9e15-768bd9d65121'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:23.777345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '486dc3e5b0ac4e189d1be61a06f36ed4', 'request_id': 'req-2f2d2cda-7036-412f-9e15-768bd9d65121'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:23.809762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] The token cache is being invalidate because project 486dc3e5b0ac4e189d1be61a06f36ed4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:23.811397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:23.812746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:23.831771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 957/1915] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:23 2022] DELETE /identity/v3/projects/486dc3e5b0ac4e189d1be61a06f36ed4 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:23.832530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fb5f3-9b34-4f4c-a66d-1ef2701f9913 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:23.845205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1fb5f3-9b34-4f4c-a66d-1ef2701f9913 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:23.916412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:23.940213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:23.941150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:23.941739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:23.942139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] PATH_INFO: `/v3/users/648b580f7a914f09adf2685153f6bc9d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:23.944369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=648b580f7a914f09adf2685153f6bc9d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:23.947068 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:24.068088 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '648b580f7a914f09adf2685153f6bc9d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.068891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '648b580f7a914f09adf2685153f6bc9d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.086029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '648b580f7a914f09adf2685153f6bc9d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.087656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '648b580f7a914f09adf2685153f6bc9d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.096331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '648b580f7a914f09adf2685153f6bc9d'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.116247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 959/1916] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:23 2022] DELETE /identity/v3/users/648b580f7a914f09adf2685153f6bc9d => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:24.533041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:24.541005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:24.562970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f2d2cda-7036-412f-9e15-768bd9d65121 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:24.654843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:24.656280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:24.656908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:24.657339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] PATH_INFO: `/v3/projects/11f2b6190c664a8f84584afc0fe5a710` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:24.659048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f2b6190c664a8f84584afc0fe5a710)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:24.673070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:24.772723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f2b6190c664a8f84584afc0fe5a710', 'request_id': 'req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.790376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f2b6190c664a8f84584afc0fe5a710', 'request_id': 'req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.799001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f2b6190c664a8f84584afc0fe5a710', 'request_id': 'req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.817504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] The token cache is being invalidate because project 11f2b6190c664a8f84584afc0fe5a710 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:24.817807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.819309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.822094 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 958/1917] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:24 2022] DELETE /identity/v3/projects/11f2b6190c664a8f84584afc0fe5a710 => generated 0 bytes in 289 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:24.826072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:24.827598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:24.842057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f5c70e-8b68-42b8-9ee7-651fe8eab5d3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:24.919496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:24.920225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:24.920589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:24.920950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] PATH_INFO: `/v3/users/4b21e583a25d47ffb673a4a51dd08d34` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:24.922289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b21e583a25d47ffb673a4a51dd08d34)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:24.924521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:24.979582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b21e583a25d47ffb673a4a51dd08d34'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.980336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b21e583a25d47ffb673a4a51dd08d34'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.994391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b21e583a25d47ffb673a4a51dd08d34'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:24.995359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b21e583a25d47ffb673a4a51dd08d34'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:25.000765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=80,keystone:DELETE=19,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:25.003255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3444fed7-aa36-4ff1-8298-db1958fd0504 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b21e583a25d47ffb673a4a51dd08d34'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:25.019241 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 960/1918] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:24 2022] DELETE /identity/v3/users/4b21e583a25d47ffb673a4a51dd08d34 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:25.341616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:25.343050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:25.381910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcf936c-e3ad-4bb8-9909-a729d7ca27da admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:25.411672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:25.448332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:25.448987 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:25.449977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:25.449977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] PATH_INFO: `/v3/projects/86b9ae96906e4c91b71975a0e138d442` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:25.451168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=86b9ae96906e4c91b71975a0e138d442)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:25.453517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:25.506784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '86b9ae96906e4c91b71975a0e138d442', 'request_id': 'req-8a480867-5914-469b-bd87-27e1b8641194'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:25.516353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '86b9ae96906e4c91b71975a0e138d442', 'request_id': 'req-8a480867-5914-469b-bd87-27e1b8641194'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:25.522418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '86b9ae96906e4c91b71975a0e138d442', 'request_id': 'req-8a480867-5914-469b-bd87-27e1b8641194'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:25.536463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] The token cache is being invalidate because project 86b9ae96906e4c91b71975a0e138d442 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:25.536776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:25.538529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8a480867-5914-469b-bd87-27e1b8641194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:25.542124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 959/1919] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:25 2022] DELETE /identity/v3/projects/86b9ae96906e4c91b71975a0e138d442 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:25.546174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52578-5715-4bcf-97d5-a7ef6c74b26a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:25.546668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52578-5715-4bcf-97d5-a7ef6c74b26a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:25.546943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79c52578-5715-4bcf-97d5-a7ef6c74b26a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:25.581545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-79c52578-5715-4bcf-97d5-a7ef6c74b26a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:25.583283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-79c52578-5715-4bcf-97d5-a7ef6c74b26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:25.751272 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75606e63-bd2f-46cd-b796-4f5803180eff None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:25.754553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75606e63-bd2f-46cd-b796-4f5803180eff None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:25.755074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75606e63-bd2f-46cd-b796-4f5803180eff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:25.760572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 961/1920] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:25.791587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c52578-5715-4bcf-97d5-a7ef6c74b26a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:25.793088 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-79c52578-5715-4bcf-97d5-a7ef6c74b26a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:25.809850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-75606e63-bd2f-46cd-b796-4f5803180eff None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:25.812625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-75606e63-bd2f-46cd-b796-4f5803180eff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:25.823501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79c52578-5715-4bcf-97d5-a7ef6c74b26a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:25.825394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 960/1921] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:25.829513 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75606e63-bd2f-46cd-b796-4f5803180eff None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:25.832402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:25.833239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:25.833635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:25.833761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] PATH_INFO: `/v3/users/de04e2c7a71447cbab8bdcd9c214e9b4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:25.839374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] RBAC: Authorizing `identity:delete_user(user_id=de04e2c7a71447cbab8bdcd9c214e9b4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:25.841499 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:25.851261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75606e63-bd2f-46cd-b796-4f5803180eff None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:25.862230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf070705-2bf3-48ce-be69-f4522893bcf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:25.866120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf070705-2bf3-48ce-be69-f4522893bcf1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:25.866759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf070705-2bf3-48ce-be69-f4522893bcf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:25.867360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf070705-2bf3-48ce-be69-f4522893bcf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:25.869606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf070705-2bf3-48ce-be69-f4522893bcf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:25.870211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf070705-2bf3-48ce-be69-f4522893bcf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:25.872846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf070705-2bf3-48ce-be69-f4522893bcf1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:25.924774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 961/1922] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:27:25.925806 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf070705-2bf3-48ce-be69-f4522893bcf1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:25.937382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bf070705-2bf3-48ce-be69-f4522893bcf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:25.966506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf070705-2bf3-48ce-be69-f4522893bcf1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:25.980067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:25.981805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:25.982168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:25.982599 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] PATH_INFO: `/v3/projects/3a001f4bec324ef59b1d0f0cc437d53d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:25.985131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a001f4bec324ef59b1d0f0cc437d53d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:25.986630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de04e2c7a71447cbab8bdcd9c214e9b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:25.988085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:25.988531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de04e2c7a71447cbab8bdcd9c214e9b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:26.008615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de04e2c7a71447cbab8bdcd9c214e9b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:26.009526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de04e2c7a71447cbab8bdcd9c214e9b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:26.021312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de04e2c7a71447cbab8bdcd9c214e9b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:26.042984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 962/1923] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:25 2022] DELETE /identity/v3/users/de04e2c7a71447cbab8bdcd9c214e9b4 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:26.044192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:26.046147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:26.084073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a001f4bec324ef59b1d0f0cc437d53d', 'request_id': 'req-ade32858-6852-4410-965c-485c1b11e0f3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:26.096936 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a001f4bec324ef59b1d0f0cc437d53d', 'request_id': 'req-ade32858-6852-4410-965c-485c1b11e0f3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:26.108552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a001f4bec324ef59b1d0f0cc437d53d', 'request_id': 'req-ade32858-6852-4410-965c-485c1b11e0f3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:26.126308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] The token cache is being invalidate because project 3a001f4bec324ef59b1d0f0cc437d53d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:26.130115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:26.130115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ade32858-6852-4410-965c-485c1b11e0f3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:26.130115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 962/1924] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:25 2022] DELETE /identity/v3/projects/3a001f4bec324ef59b1d0f0cc437d53d => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:26.132103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a41410-7e74-4430-8b9d-c2f461edd4ca None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.134188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a41410-7e74-4430-8b9d-c2f461edd4ca None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.134637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a41410-7e74-4430-8b9d-c2f461edd4ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.144380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8451e-5809-4e5b-b49e-1b60c966a462 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:26.151397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:26.160814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d9a41410-7e74-4430-8b9d-c2f461edd4ca None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:26.161836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d9a41410-7e74-4430-8b9d-c2f461edd4ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:26.189589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:26.260030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 963/1925] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:26.265504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576734-5b2c-4d2b-b9d5-4ae896e7ff01 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.265838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576734-5b2c-4d2b-b9d5-4ae896e7ff01 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.266221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576734-5b2c-4d2b-b9d5-4ae896e7ff01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.279589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f65101-20ec-40ef-bcb9-245d09d48a0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:26.280241 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65101-20ec-40ef-bcb9-245d09d48a0d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.280522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65101-20ec-40ef-bcb9-245d09d48a0d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.280795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f65101-20ec-40ef-bcb9-245d09d48a0d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.282615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f65101-20ec-40ef-bcb9-245d09d48a0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:26.284850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f65101-20ec-40ef-bcb9-245d09d48a0d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:26.293201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-10576734-5b2c-4d2b-b9d5-4ae896e7ff01 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:26.294521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-10576734-5b2c-4d2b-b9d5-4ae896e7ff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:26.310439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 964/1926] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:26.311314 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576734-5b2c-4d2b-b9d5-4ae896e7ff01 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:26.312891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-10576734-5b2c-4d2b-b9d5-4ae896e7ff01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:26.339190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 963/1927] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:26 2022] POST /identity/v3/projects => generated 377 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:26.340548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799de0-23b9-4202-8732-11d5c16f72e6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.340831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799de0-23b9-4202-8732-11d5c16f72e6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.341595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6799de0-23b9-4202-8732-11d5c16f72e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.393827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c6799de0-23b9-4202-8732-11d5c16f72e6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:26.395726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c6799de0-23b9-4202-8732-11d5c16f72e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:26.429635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576734-5b2c-4d2b-b9d5-4ae896e7ff01 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:26.530247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 964/1928] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:26.531600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6799de0-23b9-4202-8732-11d5c16f72e6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:26.533530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c6799de0-23b9-4202-8732-11d5c16f72e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:26.547728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438649-5ae9-48fd-ba75-2c3846711739 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:26.548616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438649-5ae9-48fd-ba75-2c3846711739 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.548969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438649-5ae9-48fd-ba75-2c3846711739 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.549315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab438649-5ae9-48fd-ba75-2c3846711739 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.559202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6799de0-23b9-4202-8732-11d5c16f72e6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:26.563602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438649-5ae9-48fd-ba75-2c3846711739 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:26.568589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab438649-5ae9-48fd-ba75-2c3846711739 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:26.569637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65beb108-b739-4cc5-accb-12b56643adef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:26.570902 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beb108-b739-4cc5-accb-12b56643adef admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.571303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beb108-b739-4cc5-accb-12b56643adef admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.571762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65beb108-b739-4cc5-accb-12b56643adef admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.573031 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65beb108-b739-4cc5-accb-12b56643adef admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:26.577524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65beb108-b739-4cc5-accb-12b56643adef admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:26.595262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 965/1929] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 284 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:26.596143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438649-5ae9-48fd-ba75-2c3846711739 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:26.620852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 965/1930] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:26 2022] POST /identity/v3/users => generated 289 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:26.623701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab438649-5ae9-48fd-ba75-2c3846711739 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:26.624817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65beb108-b739-4cc5-accb-12b56643adef admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:26.630156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784fefe-d75d-4ed3-ad25-b7c70ca03232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:26.631822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784fefe-d75d-4ed3-ad25-b7c70ca03232 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.631822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784fefe-d75d-4ed3-ad25-b7c70ca03232 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.631822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7784fefe-d75d-4ed3-ad25-b7c70ca03232 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.632255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784fefe-d75d-4ed3-ad25-b7c70ca03232 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:26.632571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784fefe-d75d-4ed3-ad25-b7c70ca03232 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:26.634745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7784fefe-d75d-4ed3-ad25-b7c70ca03232 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:26.649477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 966/1931] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:27:26.650502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65beb108-b739-4cc5-accb-12b56643adef admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:26.653589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784fefe-d75d-4ed3-ad25-b7c70ca03232 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:26.664612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d4b9f-eea7-4602-ac15-a78cbc77877b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:26.665243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d4b9f-eea7-4602-ac15-a78cbc77877b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.665529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d4b9f-eea7-4602-ac15-a78cbc77877b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.665911 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2d4b9f-eea7-4602-ac15-a78cbc77877b admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.666457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d4b9f-eea7-4602-ac15-a78cbc77877b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:26.669429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7784fefe-d75d-4ed3-ad25-b7c70ca03232 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:26.670375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2d4b9f-eea7-4602-ac15-a78cbc77877b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:26.690650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daad91-de7c-45ac-a631-812b3e32084b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:26.691789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daad91-de7c-45ac-a631-812b3e32084b admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.692789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daad91-de7c-45ac-a631-812b3e32084b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.693331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63daad91-de7c-45ac-a631-812b3e32084b admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.694139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daad91-de7c-45ac-a631-812b3e32084b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:26.697069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63daad91-de7c-45ac-a631-812b3e32084b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:26.697553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 966/1932] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 73 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:26.701486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d4b9f-eea7-4602-ac15-a78cbc77877b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:26.720872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2d4b9f-eea7-4602-ac15-a78cbc77877b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:26.735923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5476bf-ed14-49ad-b41d-240efeaaa6f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:26.736540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5476bf-ed14-49ad-b41d-240efeaaa6f5 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.736775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5476bf-ed14-49ad-b41d-240efeaaa6f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.737056 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5476bf-ed14-49ad-b41d-240efeaaa6f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.737904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5476bf-ed14-49ad-b41d-240efeaaa6f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:26.739530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5476bf-ed14-49ad-b41d-240efeaaa6f5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:26.762494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 967/1933] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:26.766980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 967/1934] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:26 2022] POST /identity/v3/projects => generated 391 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:26.767485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5476bf-ed14-49ad-b41d-240efeaaa6f5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:26.771174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daad91-de7c-45ac-a631-812b3e32084b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:26.792521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5476bf-ed14-49ad-b41d-240efeaaa6f5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:26.862639 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:26.903794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63daad91-de7c-45ac-a631-812b3e32084b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:26.919290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd8292-ba09-4e3d-96c2-a4b078b7d6b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:26.919932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8292-ba09-4e3d-96c2-a4b078b7d6b0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.920248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8292-ba09-4e3d-96c2-a4b078b7d6b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.920530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd8292-ba09-4e3d-96c2-a4b078b7d6b0 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.921181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd8292-ba09-4e3d-96c2-a4b078b7d6b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:26.921666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:26.923795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd8292-ba09-4e3d-96c2-a4b078b7d6b0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:26.947165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155a4e3-6323-4adb-a94b-3b9267e4af24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:26.947944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155a4e3-6323-4adb-a94b-3b9267e4af24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.948344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155a4e3-6323-4adb-a94b-3b9267e4af24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.948673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155a4e3-6323-4adb-a94b-3b9267e4af24 admin admin] PATH_INFO: `/v3/projects/a21772f9a4d846cab69a3986f037972a/users/9c7efbe9937441ac9b60b6bcaf1ed77b/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.968759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 968/1935] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:26 2022] POST /identity/v3/users => generated 296 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:26.969356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd8292-ba09-4e3d-96c2-a4b078b7d6b0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:26.972597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155a4e3-6323-4adb-a94b-3b9267e4af24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a21772f9a4d846cab69a3986f037972a, user_id=9c7efbe9937441ac9b60b6bcaf1ed77b, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:26.981026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155a4e3-6323-4adb-a94b-3b9267e4af24 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:26.982484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd8292-ba09-4e3d-96c2-a4b078b7d6b0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:26.989656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9899e993-7422-45d0-9009-f39d035d3083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:26.997711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899e993-7422-45d0-9009-f39d035d3083 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:26.998097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899e993-7422-45d0-9009-f39d035d3083 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:26.998428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9899e993-7422-45d0-9009-f39d035d3083 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:26.999222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899e993-7422-45d0-9009-f39d035d3083 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:27.002061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9899e993-7422-45d0-9009-f39d035d3083 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:27.015367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 969/1937] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:26 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:27.016261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 968/1937] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:26 2022] PUT /identity/v3/projects/a21772f9a4d846cab69a3986f037972a/users/9c7efbe9937441ac9b60b6bcaf1ed77b/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:27.021358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26d28e-df37-46cd-b264-74ba06e1c36f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.022010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155a4e3-6323-4adb-a94b-3b9267e4af24 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:27.025294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26d28e-df37-46cd-b264-74ba06e1c36f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.025587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac26d28e-df37-46cd-b264-74ba06e1c36f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.080827 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ac26d28e-df37-46cd-b264-74ba06e1c36f None None] MFA Rules not processed for user `9c7efbe9937441ac9b60b6bcaf1ed77b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:27.090471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ac26d28e-df37-46cd-b264-74ba06e1c36f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:27.137372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155a4e3-6323-4adb-a94b-3b9267e4af24 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:27.155286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9d51f-847d-47e7-8af2-107bc672cf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:27.155933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9d51f-847d-47e7-8af2-107bc672cf73 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.156312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9d51f-847d-47e7-8af2-107bc672cf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.156900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc9d51f-847d-47e7-8af2-107bc672cf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.157234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9d51f-847d-47e7-8af2-107bc672cf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:27.158874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc9d51f-847d-47e7-8af2-107bc672cf73 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:27.196831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 969/1938] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:27.197853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9d51f-847d-47e7-8af2-107bc672cf73 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:27.202668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dbc9d51f-847d-47e7-8af2-107bc672cf73 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:27.239064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc9d51f-847d-47e7-8af2-107bc672cf73 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:27.250968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:27.251799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.252087 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.252391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] PATH_INFO: `/v3/projects/be68969c50e34ff895dbcbc09bd8ab80` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.254234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be68969c50e34ff895dbcbc09bd8ab80)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:27.256973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:27.264716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 970/1939] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:27.264716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26d28e-df37-46cd-b264-74ba06e1c36f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:27.306839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac26d28e-df37-46cd-b264-74ba06e1c36f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:27.321964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be68969c50e34ff895dbcbc09bd8ab80', 'request_id': 'req-912f6c74-367b-4112-901b-100af39ab161'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:27.330633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be68969c50e34ff895dbcbc09bd8ab80', 'request_id': 'req-912f6c74-367b-4112-901b-100af39ab161'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:27.342820 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be68969c50e34ff895dbcbc09bd8ab80', 'request_id': 'req-912f6c74-367b-4112-901b-100af39ab161'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:27.375508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] The token cache is being invalidate because project be68969c50e34ff895dbcbc09bd8ab80 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:27.375811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:27.377215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:27.378954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 970/1940] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:27 2022] DELETE /identity/v3/projects/be68969c50e34ff895dbcbc09bd8ab80 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:27.379761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:27.381251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:27.406297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0252d7f-c82d-4548-932c-28a473cc9371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:27.406985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0252d7f-c82d-4548-932c-28a473cc9371 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.407555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0252d7f-c82d-4548-932c-28a473cc9371 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.407886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0252d7f-c82d-4548-932c-28a473cc9371 admin admin] PATH_INFO: `/v3/projects/19d0ea86d689440fb26d611778a8e270/users/bd0996ca57f24717a6ca3cb96fd2d0b8/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.437144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0252d7f-c82d-4548-932c-28a473cc9371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19d0ea86d689440fb26d611778a8e270, user_id=bd0996ca57f24717a6ca3cb96fd2d0b8, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:27.441046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0252d7f-c82d-4548-932c-28a473cc9371 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:27.456475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 971/1941] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:27 2022] PUT /identity/v3/projects/19d0ea86d689440fb26d611778a8e270/users/bd0996ca57f24717a6ca3cb96fd2d0b8/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:27.468473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0252d7f-c82d-4548-932c-28a473cc9371 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:27.470183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:27.472233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b0252d7f-c82d-4548-932c-28a473cc9371 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:27.475310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-912f6c74-367b-4112-901b-100af39ab161 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:27.524468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:27.552430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-253643cf-32e9-4653-964f-a576f91d1c94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:27.553103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253643cf-32e9-4653-964f-a576f91d1c94 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.553381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253643cf-32e9-4653-964f-a576f91d1c94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.553652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-253643cf-32e9-4653-964f-a576f91d1c94 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.554287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253643cf-32e9-4653-964f-a576f91d1c94 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:27.556207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-253643cf-32e9-4653-964f-a576f91d1c94 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:27.561766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0252d7f-c82d-4548-932c-28a473cc9371 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:27.567385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:27.568056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.568369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.568645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] PATH_INFO: `/v3/users/9051d74ff7e546dc80538f22841b0b33` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.570092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9051d74ff7e546dc80538f22841b0b33)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:27.572085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:27.584808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 971/1942] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:27 2022] POST /identity/v3/projects => generated 379 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:27.589598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29756ae0-18ed-418c-89aa-154df1eae4b5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.589886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29756ae0-18ed-418c-89aa-154df1eae4b5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.590164 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29756ae0-18ed-418c-89aa-154df1eae4b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.621077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-29756ae0-18ed-418c-89aa-154df1eae4b5 None None] MFA Rules not processed for user `bd0996ca57f24717a6ca3cb96fd2d0b8`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:27.622290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-29756ae0-18ed-418c-89aa-154df1eae4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:27.628828 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9051d74ff7e546dc80538f22841b0b33'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:27.629495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9051d74ff7e546dc80538f22841b0b33'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:27.630515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9051d74ff7e546dc80538f22841b0b33'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:27.638262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9051d74ff7e546dc80538f22841b0b33'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:27.653426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9051d74ff7e546dc80538f22841b0b33'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:27.668187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 972/1943] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:27 2022] DELETE /identity/v3/users/9051d74ff7e546dc80538f22841b0b33 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:27.669392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:27.670849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:27.700291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 972/1944] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:27 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:27.712691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29756ae0-18ed-418c-89aa-154df1eae4b5 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:27.715210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-29756ae0-18ed-418c-89aa-154df1eae4b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:27.779164 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83bcc8d-f0ce-4053-8741-5989280626f4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:27.786401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb89dfe-c521-4368-bd39-7a0b5e8e1b07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:27.787425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb89dfe-c521-4368-bd39-7a0b5e8e1b07 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.790252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb89dfe-c521-4368-bd39-7a0b5e8e1b07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.790553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb89dfe-c521-4368-bd39-7a0b5e8e1b07 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.791433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb89dfe-c521-4368-bd39-7a0b5e8e1b07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:27.793446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb89dfe-c521-4368-bd39-7a0b5e8e1b07 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:27.818604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29756ae0-18ed-418c-89aa-154df1eae4b5 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:27.818955 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 973/1945] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:27 2022] POST /identity/v3/users => generated 296 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:27.824947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb89dfe-c521-4368-bd39-7a0b5e8e1b07 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:27.836640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb89dfe-c521-4368-bd39-7a0b5e8e1b07 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:27.843776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c09e1-9c40-4294-97f7-f4f555f42c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:27.844712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c09e1-9c40-4294-97f7-f4f555f42c19 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.845240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c09e1-9c40-4294-97f7-f4f555f42c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.845509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29c09e1-9c40-4294-97f7-f4f555f42c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.846245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c09e1-9c40-4294-97f7-f4f555f42c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:27.848563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29c09e1-9c40-4294-97f7-f4f555f42c19 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:27.860287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 974/1946] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:27.865152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c09e1-9c40-4294-97f7-f4f555f42c19 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:27.877853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29c09e1-9c40-4294-97f7-f4f555f42c19 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:27.882309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:27.886856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cea42-5d21-4c05-9b2e-87933c33d8bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:27.888887 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cea42-5d21-4c05-9b2e-87933c33d8bb admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.889314 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cea42-5d21-4c05-9b2e-87933c33d8bb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.889843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115cea42-5d21-4c05-9b2e-87933c33d8bb admin admin] PATH_INFO: `/v3/projects/45e3d87c322e46a99db097f145aa83dc/users/5e008f67624f46acbe88d2e7d1424cd7/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.910504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cea42-5d21-4c05-9b2e-87933c33d8bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e3d87c322e46a99db097f145aa83dc, user_id=5e008f67624f46acbe88d2e7d1424cd7, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:27.913491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115cea42-5d21-4c05-9b2e-87933c33d8bb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:27.914288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c18a5-a08e-4a8f-882b-8a9a36206dc5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:27.915603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c18a5-a08e-4a8f-882b-8a9a36206dc5 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:27.916508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c18a5-a08e-4a8f-882b-8a9a36206dc5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:27.916960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523c18a5-a08e-4a8f-882b-8a9a36206dc5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:27.951160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 975/1947] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:27 2022] PUT /identity/v3/projects/45e3d87c322e46a99db097f145aa83dc/users/5e008f67624f46acbe88d2e7d1424cd7/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:27.952575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cea42-5d21-4c05-9b2e-87933c33d8bb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:27.959539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:28.026325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c18a5-a08e-4a8f-882b-8a9a36206dc5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.026894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523c18a5-a08e-4a8f-882b-8a9a36206dc5 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.047347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 973/1948] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:27 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:28.067355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115cea42-5d21-4c05-9b2e-87933c33d8bb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.075166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641c0d8d-7f20-4c8f-8bf3-75ed134ba32a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.075622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0d8d-7f20-4c8f-8bf3-75ed134ba32a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.075913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0d8d-7f20-4c8f-8bf3-75ed134ba32a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.076235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641c0d8d-7f20-4c8f-8bf3-75ed134ba32a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.076946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c0d8d-7f20-4c8f-8bf3-75ed134ba32a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.079246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641c0d8d-7f20-4c8f-8bf3-75ed134ba32a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.094293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 976/1949] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:27 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:28.098727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c18a5-a08e-4a8f-882b-8a9a36206dc5 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:28.109996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523c18a5-a08e-4a8f-882b-8a9a36206dc5 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.114917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fcfd0-7ca0-4da5-8d0e-d5aa0fc95e40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.115565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fcfd0-7ca0-4da5-8d0e-d5aa0fc95e40 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.115942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fcfd0-7ca0-4da5-8d0e-d5aa0fc95e40 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.116117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fcfd0-7ca0-4da5-8d0e-d5aa0fc95e40 admin admin] PATH_INFO: `/v3/projects/45e3d87c322e46a99db097f145aa83dc/users/5e008f67624f46acbe88d2e7d1424cd7/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.118873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fcfd0-7ca0-4da5-8d0e-d5aa0fc95e40 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45e3d87c322e46a99db097f145aa83dc, user_id=5e008f67624f46acbe88d2e7d1424cd7, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.121595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fcfd0-7ca0-4da5-8d0e-d5aa0fc95e40 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.136604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 974/1950] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:28 2022] PUT /identity/v3/projects/45e3d87c322e46a99db097f145aa83dc/users/5e008f67624f46acbe88d2e7d1424cd7/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:28.148405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba00ca-c8c2-4bfd-96fd-798b0f6d3fc5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.148805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba00ca-c8c2-4bfd-96fd-798b0f6d3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.149090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ba00ca-c8c2-4bfd-96fd-798b0f6d3fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.183391 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fcfd0-7ca0-4da5-8d0e-d5aa0fc95e40 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:28.185204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-377fcfd0-7ca0-4da5-8d0e-d5aa0fc95e40 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:28.224126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b0ba00ca-c8c2-4bfd-96fd-798b0f6d3fc5 None None] MFA Rules not processed for user `5e008f67624f46acbe88d2e7d1424cd7`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:28.225936 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b0ba00ca-c8c2-4bfd-96fd-798b0f6d3fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:28.294207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fcfd0-7ca0-4da5-8d0e-d5aa0fc95e40 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.301822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.302766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.303282 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.303560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] PATH_INFO: `/v3/projects/aee020854e504780bc281fc81dbf79a6` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.305427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aee020854e504780bc281fc81dbf79a6)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.309980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.323837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 977/1951] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:28.359802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba00ca-c8c2-4bfd-96fd-798b0f6d3fc5 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:28.361724 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b0ba00ca-c8c2-4bfd-96fd-798b0f6d3fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:28.394758 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aee020854e504780bc281fc81dbf79a6', 'request_id': 'req-0ca72b1d-f447-4641-808a-4a1321204005'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:28.409974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aee020854e504780bc281fc81dbf79a6', 'request_id': 'req-0ca72b1d-f447-4641-808a-4a1321204005'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:28.434941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aee020854e504780bc281fc81dbf79a6', 'request_id': 'req-0ca72b1d-f447-4641-808a-4a1321204005'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:28.455538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] The token cache is being invalidate because project aee020854e504780bc281fc81dbf79a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:28.455945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:28.456869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0ca72b1d-f447-4641-808a-4a1321204005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:28.470160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 975/1952] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:28 2022] DELETE /identity/v3/projects/aee020854e504780bc281fc81dbf79a6 => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:28.470160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c208-aecd-4e76-995b-4ffbda5d9de4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.470160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c208-aecd-4e76-995b-4ffbda5d9de4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.470160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c588c208-aecd-4e76-995b-4ffbda5d9de4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.493627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ba00ca-c8c2-4bfd-96fd-798b0f6d3fc5 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.501585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:28.515265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c588c208-aecd-4e76-995b-4ffbda5d9de4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:28.516925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c588c208-aecd-4e76-995b-4ffbda5d9de4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:28.560290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:28.578055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469073f-ecc1-48d7-8ece-3c330ed80959 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.578689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469073f-ecc1-48d7-8ece-3c330ed80959 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.578970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469073f-ecc1-48d7-8ece-3c330ed80959 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.579250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469073f-ecc1-48d7-8ece-3c330ed80959 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.581233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9469073f-ecc1-48d7-8ece-3c330ed80959 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:28.625388 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 976/1953] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:28.627370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318801-343a-4fdd-afa3-87ffefc5e0ff None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.627941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318801-343a-4fdd-afa3-87ffefc5e0ff None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.628434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23318801-343a-4fdd-afa3-87ffefc5e0ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.654330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-23318801-343a-4fdd-afa3-87ffefc5e0ff None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:28.655648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-23318801-343a-4fdd-afa3-87ffefc5e0ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:28.668193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469073f-ecc1-48d7-8ece-3c330ed80959 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.668795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 977/1954] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:28.669547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469073f-ecc1-48d7-8ece-3c330ed80959 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.674278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318801-343a-4fdd-afa3-87ffefc5e0ff None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:28.680178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 978/1955] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:28 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:28.684055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23318801-343a-4fdd-afa3-87ffefc5e0ff None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.688756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b95973-21e2-4032-aeaa-d90a094a73fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.689396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b95973-21e2-4032-aeaa-d90a094a73fb admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.689675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b95973-21e2-4032-aeaa-d90a094a73fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.689946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b95973-21e2-4032-aeaa-d90a094a73fb admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.690614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b95973-21e2-4032-aeaa-d90a094a73fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:28.690908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b95973-21e2-4032-aeaa-d90a094a73fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.692701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b95973-21e2-4032-aeaa-d90a094a73fb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.705281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 978/1956] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:27:28.710494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469073f-ecc1-48d7-8ece-3c330ed80959 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:28.722472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469073f-ecc1-48d7-8ece-3c330ed80959 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.727262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd35d-e950-4500-ae7e-637ecf578b34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.727875 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd35d-e950-4500-ae7e-637ecf578b34 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.728183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd35d-e950-4500-ae7e-637ecf578b34 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.728459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0fd35d-e950-4500-ae7e-637ecf578b34 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.729112 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fd35d-e950-4500-ae7e-637ecf578b34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.731011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d0fd35d-e950-4500-ae7e-637ecf578b34 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.765459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 979/1957] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:28 2022] POST /identity/v3/projects => generated 393 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:28.765614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b95973-21e2-4032-aeaa-d90a094a73fb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:28.765953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b9b95973-21e2-4032-aeaa-d90a094a73fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:28.766633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd35d-e950-4500-ae7e-637ecf578b34 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:28.778001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b95973-21e2-4032-aeaa-d90a094a73fb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.828840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e5522-4c2b-451b-a893-05fbc84e98af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.829373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e5522-4c2b-451b-a893-05fbc84e98af service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.829675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e5522-4c2b-451b-a893-05fbc84e98af service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.829949 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e5522-4c2b-451b-a893-05fbc84e98af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.831700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-882e5522-4c2b-451b-a893-05fbc84e98af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:28.837672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d0fd35d-e950-4500-ae7e-637ecf578b34 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.843155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9a855-fa07-4ef9-bf5d-533cd34bb1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.843769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9a855-fa07-4ef9-bf5d-533cd34bb1f3 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.844059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9a855-fa07-4ef9-bf5d-533cd34bb1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.844356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca9a855-fa07-4ef9-bf5d-533cd34bb1f3 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.844992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9a855-fa07-4ef9-bf5d-533cd34bb1f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.846928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca9a855-fa07-4ef9-bf5d-533cd34bb1f3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.868625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 980/1958] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:28 2022] POST /identity/v3/users => generated 297 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:28.872888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9a855-fa07-4ef9-bf5d-533cd34bb1f3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:28.883310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca9a855-fa07-4ef9-bf5d-533cd34bb1f3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.888248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae0638-2f99-4ea1-aa99-ee581ac11ffb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.888854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae0638-2f99-4ea1-aa99-ee581ac11ffb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.889282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae0638-2f99-4ea1-aa99-ee581ac11ffb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.889580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae0638-2f99-4ea1-aa99-ee581ac11ffb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.890225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae0638-2f99-4ea1-aa99-ee581ac11ffb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.892278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ae0638-2f99-4ea1-aa99-ee581ac11ffb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.897444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e5522-4c2b-451b-a893-05fbc84e98af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.899470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e5522-4c2b-451b-a893-05fbc84e98af service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.905621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 981/1959] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:28.908999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 979/1960] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:28 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:28.909491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae0638-2f99-4ea1-aa99-ee581ac11ffb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:28.920692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae0638-2f99-4ea1-aa99-ee581ac11ffb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.926573 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2183b16-759c-4911-9bae-fb9396a29d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.927200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2183b16-759c-4911-9bae-fb9396a29d94 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.927511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2183b16-759c-4911-9bae-fb9396a29d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.927784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2183b16-759c-4911-9bae-fb9396a29d94 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.928671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2183b16-759c-4911-9bae-fb9396a29d94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.931008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2183b16-759c-4911-9bae-fb9396a29d94 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:28.943370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 982/1961] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:28 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:28.947299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e5522-4c2b-451b-a893-05fbc84e98af service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:28.961666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e5522-4c2b-451b-a893-05fbc84e98af service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:28.971129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69e032-7a71-4fcb-a5bc-e7dbb133c0e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:28.972895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69e032-7a71-4fcb-a5bc-e7dbb133c0e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:28.973137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69e032-7a71-4fcb-a5bc-e7dbb133c0e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:28.973468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b69e032-7a71-4fcb-a5bc-e7dbb133c0e4 admin admin] PATH_INFO: `/v3/projects/ff6792c8ce2b45f19233e3861c056695/users/c292e7e54feb473a8f7494d9a52644a2/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:28.992630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69e032-7a71-4fcb-a5bc-e7dbb133c0e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff6792c8ce2b45f19233e3861c056695, user_id=c292e7e54feb473a8f7494d9a52644a2, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:28.995398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b69e032-7a71-4fcb-a5bc-e7dbb133c0e4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:29.018558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 980/1962] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:28 2022] PUT /identity/v3/projects/ff6792c8ce2b45f19233e3861c056695/users/c292e7e54feb473a8f7494d9a52644a2/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:29.029763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c61304-248c-4019-bfbb-a366abb30ad0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:29.030051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c61304-248c-4019-bfbb-a366abb30ad0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:29.032949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72c61304-248c-4019-bfbb-a366abb30ad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:29.082090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-72c61304-248c-4019-bfbb-a366abb30ad0 None None] MFA Rules not processed for user `c292e7e54feb473a8f7494d9a52644a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:29.083230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-72c61304-248c-4019-bfbb-a366abb30ad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:29.113080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:29.161533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 983/1963] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:29.167045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69e032-7a71-4fcb-a5bc-e7dbb133c0e4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:29.187561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:29.232569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b69e032-7a71-4fcb-a5bc-e7dbb133c0e4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:29.237219 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bf6e5-9dae-4975-bb0b-6ed9aa7e5569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:29.237860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bf6e5-9dae-4975-bb0b-6ed9aa7e5569 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:29.238137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bf6e5-9dae-4975-bb0b-6ed9aa7e5569 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:29.238405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335bf6e5-9dae-4975-bb0b-6ed9aa7e5569 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:29.239058 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bf6e5-9dae-4975-bb0b-6ed9aa7e5569 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:29.241197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335bf6e5-9dae-4975-bb0b-6ed9aa7e5569 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:29.280256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 981/1964] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:29 2022] POST /identity/v3/projects => generated 391 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:29.282092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c61304-248c-4019-bfbb-a366abb30ad0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:29.294634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72c61304-248c-4019-bfbb-a366abb30ad0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:29.355311 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f716b87-7596-4ca0-839e-abbc9dffbf4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:29.355919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f716b87-7596-4ca0-839e-abbc9dffbf4a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:29.356226 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f716b87-7596-4ca0-839e-abbc9dffbf4a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:29.356497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f716b87-7596-4ca0-839e-abbc9dffbf4a admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:29.357235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f716b87-7596-4ca0-839e-abbc9dffbf4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:29.359247 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f716b87-7596-4ca0-839e-abbc9dffbf4a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:29.381746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 984/1965] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:29 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:29.386035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bf6e5-9dae-4975-bb0b-6ed9aa7e5569 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:29.396958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335bf6e5-9dae-4975-bb0b-6ed9aa7e5569 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:29.402345 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba068bb-99cc-4dc7-88fa-fbd136ecefbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:29.402973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba068bb-99cc-4dc7-88fa-fbd136ecefbf admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:29.403411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba068bb-99cc-4dc7-88fa-fbd136ecefbf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:29.403584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba068bb-99cc-4dc7-88fa-fbd136ecefbf admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:29.404343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba068bb-99cc-4dc7-88fa-fbd136ecefbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:29.406028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba068bb-99cc-4dc7-88fa-fbd136ecefbf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:29.417603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 982/1966] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:29.422063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f716b87-7596-4ca0-839e-abbc9dffbf4a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:29.433096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f716b87-7596-4ca0-839e-abbc9dffbf4a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:29.437789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367731db-7cac-4632-b0b3-46f528dc2da3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:29.438452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367731db-7cac-4632-b0b3-46f528dc2da3 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:29.438733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367731db-7cac-4632-b0b3-46f528dc2da3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:29.439012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367731db-7cac-4632-b0b3-46f528dc2da3 admin admin] PATH_INFO: `/v3/projects/167239b802c44d11b821bd3f5c66a0ab/users/cd1c4a6ed1c5472fb10e4efba2a75650/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:29.457861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367731db-7cac-4632-b0b3-46f528dc2da3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167239b802c44d11b821bd3f5c66a0ab, user_id=cd1c4a6ed1c5472fb10e4efba2a75650, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:29.460572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367731db-7cac-4632-b0b3-46f528dc2da3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:29.474497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 985/1967] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:29 2022] PUT /identity/v3/projects/167239b802c44d11b821bd3f5c66a0ab/users/cd1c4a6ed1c5472fb10e4efba2a75650/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:29.479221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba068bb-99cc-4dc7-88fa-fbd136ecefbf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:29.491630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba068bb-99cc-4dc7-88fa-fbd136ecefbf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:29.554921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f96e8d5-2ab1-4d1e-b90c-51ac3e59df5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:29.555531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e8d5-2ab1-4d1e-b90c-51ac3e59df5c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:29.555810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e8d5-2ab1-4d1e-b90c-51ac3e59df5c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:29.556087 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f96e8d5-2ab1-4d1e-b90c-51ac3e59df5c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:29.556760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96e8d5-2ab1-4d1e-b90c-51ac3e59df5c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:29.558343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f96e8d5-2ab1-4d1e-b90c-51ac3e59df5c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:29.569400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 983/1968] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:29 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:29.574288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367731db-7cac-4632-b0b3-46f528dc2da3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:29.586671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367731db-7cac-4632-b0b3-46f528dc2da3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:29.591923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12df8a-d98c-4e98-a9f1-f03aaef08ce0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:29.592624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12df8a-d98c-4e98-a9f1-f03aaef08ce0 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:29.592958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12df8a-d98c-4e98-a9f1-f03aaef08ce0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:29.593238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d12df8a-d98c-4e98-a9f1-f03aaef08ce0 admin admin] PATH_INFO: `/v3/projects/167239b802c44d11b821bd3f5c66a0ab/users/cd1c4a6ed1c5472fb10e4efba2a75650/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:29.595167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12df8a-d98c-4e98-a9f1-f03aaef08ce0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=167239b802c44d11b821bd3f5c66a0ab, user_id=cd1c4a6ed1c5472fb10e4efba2a75650, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:29.597835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d12df8a-d98c-4e98-a9f1-f03aaef08ce0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:29.617023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 986/1969] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:29 2022] PUT /identity/v3/projects/167239b802c44d11b821bd3f5c66a0ab/users/cd1c4a6ed1c5472fb10e4efba2a75650/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:29.627395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0810e1-9cd2-4f68-b8a9-2ebe49982744 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:29.627663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0810e1-9cd2-4f68-b8a9-2ebe49982744 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:29.627929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef0810e1-9cd2-4f68-b8a9-2ebe49982744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:29.659150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ef0810e1-9cd2-4f68-b8a9-2ebe49982744 None None] MFA Rules not processed for user `cd1c4a6ed1c5472fb10e4efba2a75650`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:29.660411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ef0810e1-9cd2-4f68-b8a9-2ebe49982744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:29.745526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 984/1970] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:29 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:29.756267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12df8a-d98c-4e98-a9f1-f03aaef08ce0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:29.843105 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d12df8a-d98c-4e98-a9f1-f03aaef08ce0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:29.846873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f57eac-efdb-4b31-afd1-6b3ab3faa44b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:29.847489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f57eac-efdb-4b31-afd1-6b3ab3faa44b service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:29.847773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f57eac-efdb-4b31-afd1-6b3ab3faa44b service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:29.848048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f57eac-efdb-4b31-afd1-6b3ab3faa44b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:29.858082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f57eac-efdb-4b31-afd1-6b3ab3faa44b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:29.859528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f57eac-efdb-4b31-afd1-6b3ab3faa44b service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:29.869651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 987/1971] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:29 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:29.928960 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0810e1-9cd2-4f68-b8a9-2ebe49982744 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:29.930411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ef0810e1-9cd2-4f68-b8a9-2ebe49982744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:29.948450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef0810e1-9cd2-4f68-b8a9-2ebe49982744 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:29.952762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8884951f-c43f-4337-8c86-204f2b3bd3b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:29.953838 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884951f-c43f-4337-8c86-204f2b3bd3b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:29.954203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884951f-c43f-4337-8c86-204f2b3bd3b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:29.954546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8884951f-c43f-4337-8c86-204f2b3bd3b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:29.969087 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:30.027051 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884951f-c43f-4337-8c86-204f2b3bd3b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:30.028601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8884951f-c43f-4337-8c86-204f2b3bd3b3 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:30.039355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 985/1972] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:29 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:33.967691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f57eac-efdb-4b31-afd1-6b3ab3faa44b service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:33.996907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:34.053327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f57eac-efdb-4b31-afd1-6b3ab3faa44b service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:34.058951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:34.059593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.059874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.060168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] PATH_INFO: `/v3/users/c292e7e54feb473a8f7494d9a52644a2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.061772 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c292e7e54feb473a8f7494d9a52644a2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:34.063738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:34.068893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb671-707c-40ee-a470-7cc7cbb09ae3 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.069932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb671-707c-40ee-a470-7cc7cbb09ae3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.070240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dfb671-707c-40ee-a470-7cc7cbb09ae3 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.072673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 986/1973] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:27:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:27:34.097251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bdef4-1ae4-420c-a2c0-f567bb0e240f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.097896 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bdef4-1ae4-420c-a2c0-f567bb0e240f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.098389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7bdef4-1ae4-420c-a2c0-f567bb0e240f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.122957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2b7bdef4-1ae4-420c-a2c0-f567bb0e240f None None] MFA Rules not processed for user `2bc00e6583d7424cbdc13732a962fc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:34.124628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2b7bdef4-1ae4-420c-a2c0-f567bb0e240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.128557 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c292e7e54feb473a8f7494d9a52644a2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.129222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c292e7e54feb473a8f7494d9a52644a2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.129854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c292e7e54feb473a8f7494d9a52644a2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.140716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c292e7e54feb473a8f7494d9a52644a2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.164843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8d01a100-c6ad-4b3b-aebd-c7925f56d890 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c292e7e54feb473a8f7494d9a52644a2'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.193544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 988/1974] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:33 2022] DELETE /identity/v3/users/c292e7e54feb473a8f7494d9a52644a2 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:34.196562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6aee-4d91-42a7-b250-ff563453cd20 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.214359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 987/1975] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:27:34 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:34.215182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6aee-4d91-42a7-b250-ff563453cd20 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.215182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317b6aee-4d91-42a7-b250-ff563453cd20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.223070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bdef4-1ae4-420c-a2c0-f567bb0e240f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:34.224423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2b7bdef4-1ae4-420c-a2c0-f567bb0e240f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.239824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7bdef4-1ae4-420c-a2c0-f567bb0e240f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:34.243553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-317b6aee-4d91-42a7-b250-ff563453cd20 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:34.248940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-317b6aee-4d91-42a7-b250-ff563453cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.306542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1fc54-ce23-4ce2-9202-40e5beb9c53e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc00e6583d7424cbdc13732a962fc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:34.307159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1fc54-ce23-4ce2-9202-40e5beb9c53e service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.307438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1fc54-ce23-4ce2-9202-40e5beb9c53e service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.307708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf1fc54-ce23-4ce2-9202-40e5beb9c53e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.316356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1fc54-ce23-4ce2-9202-40e5beb9c53e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:34.318108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf1fc54-ce23-4ce2-9202-40e5beb9c53e service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:34.327927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 989/1976] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:34.328600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 988/1977] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:34 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:34.333723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6aee-4d91-42a7-b250-ff563453cd20 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:34.336025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-317b6aee-4d91-42a7-b250-ff563453cd20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.339282 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1fc54-ce23-4ce2-9202-40e5beb9c53e service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:34.349794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7bf1fc54-ce23-4ce2-9202-40e5beb9c53e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.358899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317b6aee-4d91-42a7-b250-ff563453cd20 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:34.364637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:34.365535 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.366114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.366596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] PATH_INFO: `/v3/users/b790a83a93cb4c6cb34519267bc60795` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.368254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b790a83a93cb4c6cb34519267bc60795)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:34.370578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:34.398480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:34.414731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:34.417849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf1fc54-ce23-4ce2-9202-40e5beb9c53e service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:34.424666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730d22f-252a-4e2e-bdde-54b18e8c73cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:34.425517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d22f-252a-4e2e-bdde-54b18e8c73cd service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.425850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d22f-252a-4e2e-bdde-54b18e8c73cd service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.426183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b790a83a93cb4c6cb34519267bc60795'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.426299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5730d22f-252a-4e2e-bdde-54b18e8c73cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.427283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b790a83a93cb4c6cb34519267bc60795'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.428481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5730d22f-252a-4e2e-bdde-54b18e8c73cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.428736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b790a83a93cb4c6cb34519267bc60795'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.437533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b790a83a93cb4c6cb34519267bc60795'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.443193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730d22f-252a-4e2e-bdde-54b18e8c73cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:34.444691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5730d22f-252a-4e2e-bdde-54b18e8c73cd service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:34.453195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b790a83a93cb4c6cb34519267bc60795'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.458558 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 989/1978] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:34.467375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 990/1979] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:34 2022] DELETE /identity/v3/users/b790a83a93cb4c6cb34519267bc60795 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:34.652400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730d22f-252a-4e2e-bdde-54b18e8c73cd service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:34.654527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5730d22f-252a-4e2e-bdde-54b18e8c73cd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.669581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5730d22f-252a-4e2e-bdde-54b18e8c73cd service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:34.738880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:34.739559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.739844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.740138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] PATH_INFO: `/v3/projects/3856a0fad62e49da915a255b7b4265c9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.741643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3856a0fad62e49da915a255b7b4265c9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:34.744263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:34.754389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:34.756291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.779012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fda7e766-3a68-4b5c-99e6-414c65fc8587 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:34.786667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:34.787323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.787607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.787885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] PATH_INFO: `/v3/projects/ff6792c8ce2b45f19233e3861c056695` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.789564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff6792c8ce2b45f19233e3861c056695)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:34.792554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:34.812020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3856a0fad62e49da915a255b7b4265c9', 'request_id': 'req-70577b55-18d1-41e9-9d9f-c15478bd2631'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.819945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3856a0fad62e49da915a255b7b4265c9', 'request_id': 'req-70577b55-18d1-41e9-9d9f-c15478bd2631'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.829817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3856a0fad62e49da915a255b7b4265c9', 'request_id': 'req-70577b55-18d1-41e9-9d9f-c15478bd2631'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.843745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] The token cache is being invalidate because project 3856a0fad62e49da915a255b7b4265c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:34.844041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.844717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-70577b55-18d1-41e9-9d9f-c15478bd2631 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.846657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 990/1980] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:34 2022] DELETE /identity/v3/projects/3856a0fad62e49da915a255b7b4265c9 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:34.851939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae3fd-22c9-47a8-ae06-1d0cd5a4b225 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.852387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae3fd-22c9-47a8-ae06-1d0cd5a4b225 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.852673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcae3fd-22c9-47a8-ae06-1d0cd5a4b225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.853744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff6792c8ce2b45f19233e3861c056695', 'request_id': 'req-38a273f7-ec8f-4e74-84d9-08393e476de5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.860303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff6792c8ce2b45f19233e3861c056695', 'request_id': 'req-38a273f7-ec8f-4e74-84d9-08393e476de5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.866292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff6792c8ce2b45f19233e3861c056695', 'request_id': 'req-38a273f7-ec8f-4e74-84d9-08393e476de5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.877568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fdcae3fd-22c9-47a8-ae06-1d0cd5a4b225 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:34.878822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fdcae3fd-22c9-47a8-ae06-1d0cd5a4b225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.881005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] The token cache is being invalidate because project ff6792c8ce2b45f19233e3861c056695 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:34.881300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.882038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:34.883562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 991/1981] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:34 2022] DELETE /identity/v3/projects/ff6792c8ce2b45f19233e3861c056695 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:34.887524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:34.889499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.953806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 991/1982] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:34.962371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9614e-6158-406f-8f82-5d3490f13142 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.962722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9614e-6158-406f-8f82-5d3490f13142 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.963070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c9614e-6158-406f-8f82-5d3490f13142 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.963863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38a273f7-ec8f-4e74-84d9-08393e476de5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:34.968609 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:34.969249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:34.969525 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:34.969802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] PATH_INFO: `/v3/users/cd1c4a6ed1c5472fb10e4efba2a75650` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:34.970953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1c4a6ed1c5472fb10e4efba2a75650)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:34.973122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:34.985186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-50c9614e-6158-406f-8f82-5d3490f13142 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:34.986496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-50c9614e-6158-406f-8f82-5d3490f13142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:34.995169 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 992/1983] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:34.999128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9614e-6158-406f-8f82-5d3490f13142 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.005646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:35.009928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c9614e-6158-406f-8f82-5d3490f13142 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.018019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f63a8b-8fa9-4950-9e2f-0c0e1c0520cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.018912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f63a8b-8fa9-4950-9e2f-0c0e1c0520cd admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.019568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f63a8b-8fa9-4950-9e2f-0c0e1c0520cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.021746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f63a8b-8fa9-4950-9e2f-0c0e1c0520cd admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.022819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f63a8b-8fa9-4950-9e2f-0c0e1c0520cd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:35.024294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f63a8b-8fa9-4950-9e2f-0c0e1c0520cd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.026330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52f63a8b-8fa9-4950-9e2f-0c0e1c0520cd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.027157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:35.037169 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1c4a6ed1c5472fb10e4efba2a75650'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:35.038111 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1c4a6ed1c5472fb10e4efba2a75650'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:35.038595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1c4a6ed1c5472fb10e4efba2a75650'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:35.047473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1c4a6ed1c5472fb10e4efba2a75650'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:35.051424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 993/1984] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:27:35.055835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f63a8b-8fa9-4950-9e2f-0c0e1c0520cd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.057647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-52f63a8b-8fa9-4950-9e2f-0c0e1c0520cd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:35.066749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1c4a6ed1c5472fb10e4efba2a75650'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:35.073899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f63a8b-8fa9-4950-9e2f-0c0e1c0520cd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.080023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600ede3-0650-4ab7-b035-430dc7914cff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.080748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ede3-0650-4ab7-b035-430dc7914cff admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.081093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ede3-0650-4ab7-b035-430dc7914cff admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.081433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600ede3-0650-4ab7-b035-430dc7914cff admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.082132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600ede3-0650-4ab7-b035-430dc7914cff admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.084143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600ede3-0650-4ab7-b035-430dc7914cff admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.091127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 992/1985] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:34 2022] DELETE /identity/v3/users/cd1c4a6ed1c5472fb10e4efba2a75650 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:35.124350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 994/1986] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:35 2022] POST /identity/v3/projects => generated 377 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:35.125843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.196835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351d0a3b-a37e-46be-b5da-21add46d6bd8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.268598 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109343-a779-43b0-b63b-1f5221a586b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.269442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109343-a779-43b0-b63b-1f5221a586b7 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.269668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109343-a779-43b0-b63b-1f5221a586b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.270465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51109343-a779-43b0-b63b-1f5221a586b7 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.271294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109343-a779-43b0-b63b-1f5221a586b7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.273826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51109343-a779-43b0-b63b-1f5221a586b7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.301671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 993/1987] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:35 2022] POST /identity/v3/users => generated 289 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:35.305978 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600ede3-0650-4ab7-b035-430dc7914cff admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.320698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600ede3-0650-4ab7-b035-430dc7914cff admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.326310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687e20-624b-4a67-8888-afbfa6619672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.327312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687e20-624b-4a67-8888-afbfa6619672 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.327593 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687e20-624b-4a67-8888-afbfa6619672 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.327976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec687e20-624b-4a67-8888-afbfa6619672 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.328772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687e20-624b-4a67-8888-afbfa6619672 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.330491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec687e20-624b-4a67-8888-afbfa6619672 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.350706 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 995/1988] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:35.355372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109343-a779-43b0-b63b-1f5221a586b7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.367805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51109343-a779-43b0-b63b-1f5221a586b7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.373856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde3a69-5ee7-4061-81c0-c52c9bc36445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.374507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde3a69-5ee7-4061-81c0-c52c9bc36445 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.374941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde3a69-5ee7-4061-81c0-c52c9bc36445 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.375209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dde3a69-5ee7-4061-81c0-c52c9bc36445 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.376517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde3a69-5ee7-4061-81c0-c52c9bc36445 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.378627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dde3a69-5ee7-4061-81c0-c52c9bc36445 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.397272 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 994/1989] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:35.402034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687e20-624b-4a67-8888-afbfa6619672 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.409162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde3a69-5ee7-4061-81c0-c52c9bc36445 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.411081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0dde3a69-5ee7-4061-81c0-c52c9bc36445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:35.416313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec687e20-624b-4a67-8888-afbfa6619672 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.426866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dde3a69-5ee7-4061-81c0-c52c9bc36445 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.429151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6061084-0986-48bd-82c9-4938f19d04b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.430090 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6061084-0986-48bd-82c9-4938f19d04b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.430377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6061084-0986-48bd-82c9-4938f19d04b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.430658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6061084-0986-48bd-82c9-4938f19d04b9 admin admin] PATH_INFO: `/v3/projects/2892eb7bfcf84993855ed3acec8a061f/users/9e21d91fcb5541e0bedcf6486e621f45/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.440661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.441424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.441974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.442413 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] PATH_INFO: `/v3/projects/167239b802c44d11b821bd3f5c66a0ab` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.444328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=167239b802c44d11b821bd3f5c66a0ab)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.447155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.448283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6061084-0986-48bd-82c9-4938f19d04b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2892eb7bfcf84993855ed3acec8a061f, user_id=9e21d91fcb5541e0bedcf6486e621f45, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.463079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6061084-0986-48bd-82c9-4938f19d04b9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.487010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 996/1990] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:35 2022] PUT /identity/v3/projects/2892eb7bfcf84993855ed3acec8a061f/users/9e21d91fcb5541e0bedcf6486e621f45/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 85 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:35.497945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ea7e8-c0c8-4eb1-b70a-2a9758b38982 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.498237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ea7e8-c0c8-4eb1-b70a-2a9758b38982 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.498518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ea7e8-c0c8-4eb1-b70a-2a9758b38982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:35.517876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '167239b802c44d11b821bd3f5c66a0ab', 'request_id': 'req-6614f73b-62cb-48ac-b538-d86837f06bf7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:35.526910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '167239b802c44d11b821bd3f5c66a0ab', 'request_id': 'req-6614f73b-62cb-48ac-b538-d86837f06bf7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:35.533548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '167239b802c44d11b821bd3f5c66a0ab', 'request_id': 'req-6614f73b-62cb-48ac-b538-d86837f06bf7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:35.539723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e41ea7e8-c0c8-4eb1-b70a-2a9758b38982 None None] MFA Rules not processed for user `9e21d91fcb5541e0bedcf6486e621f45`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:35.541108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e41ea7e8-c0c8-4eb1-b70a-2a9758b38982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:35.552918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] The token cache is being invalidate because project 167239b802c44d11b821bd3f5c66a0ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:35.553209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:35.554022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6614f73b-62cb-48ac-b538-d86837f06bf7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:35.555573 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 995/1991] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:35 2022] DELETE /identity/v3/projects/167239b802c44d11b821bd3f5c66a0ab => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:35.560603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52ae23-7d08-4650-81c6-09b2c44c273d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.560953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52ae23-7d08-4650-81c6-09b2c44c273d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.561294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf52ae23-7d08-4650-81c6-09b2c44c273d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.590468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bf52ae23-7d08-4650-81c6-09b2c44c273d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:35.592068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bf52ae23-7d08-4650-81c6-09b2c44c273d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:35.613868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 997/1992] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:35 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:35.619230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ea7e8-c0c8-4eb1-b70a-2a9758b38982 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.620640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e41ea7e8-c0c8-4eb1-b70a-2a9758b38982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:35.658929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 996/1993] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:35.668426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d71e-5d88-4452-b3d7-84d7e9a2c840 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.668793 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d71e-5d88-4452-b3d7-84d7e9a2c840 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.669143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3774d71e-5d88-4452-b3d7-84d7e9a2c840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.690945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ea7e8-c0c8-4eb1-b70a-2a9758b38982 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.691195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3774d71e-5d88-4452-b3d7-84d7e9a2c840 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:35.692347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3774d71e-5d88-4452-b3d7-84d7e9a2c840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:35.696971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fe11e-4f5e-4410-bebf-bc656b562988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.697617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe11e-4f5e-4410-bebf-bc656b562988 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.697906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe11e-4f5e-4410-bebf-bc656b562988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.698186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fe11e-4f5e-4410-bebf-bc656b562988 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.698831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fe11e-4f5e-4410-bebf-bc656b562988 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.700952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270fe11e-4f5e-4410-bebf-bc656b562988 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.701534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 997/1994] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:35.705870 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774d71e-5d88-4452-b3d7-84d7e9a2c840 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.716337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3774d71e-5d88-4452-b3d7-84d7e9a2c840 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.722127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea020d2a-c2e8-4476-aa2a-2ebe944eae65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.722908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea020d2a-c2e8-4476-aa2a-2ebe944eae65 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.723183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea020d2a-c2e8-4476-aa2a-2ebe944eae65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.723455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea020d2a-c2e8-4476-aa2a-2ebe944eae65 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.724118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea020d2a-c2e8-4476-aa2a-2ebe944eae65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:35.724496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea020d2a-c2e8-4476-aa2a-2ebe944eae65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.727554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea020d2a-c2e8-4476-aa2a-2ebe944eae65 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.738297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 998/1995] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:35 2022] POST /identity/v3/projects => generated 379 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:35.742813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fe11e-4f5e-4410-bebf-bc656b562988 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.743823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 998/1996] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:27:35.748427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea020d2a-c2e8-4476-aa2a-2ebe944eae65 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.754167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:35.760202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea020d2a-c2e8-4476-aa2a-2ebe944eae65 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.814212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fe11e-4f5e-4410-bebf-bc656b562988 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.819115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e67c7-dbba-4ac4-8973-fd55a07f6095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.819794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e67c7-dbba-4ac4-8973-fd55a07f6095 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.820598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e67c7-dbba-4ac4-8973-fd55a07f6095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.820869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e67c7-dbba-4ac4-8973-fd55a07f6095 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.821507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e67c7-dbba-4ac4-8973-fd55a07f6095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.823459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa0e67c7-dbba-4ac4-8973-fd55a07f6095 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.827674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ab558-850f-47f7-87ba-8b3b9445395e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.828408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab558-850f-47f7-87ba-8b3b9445395e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.828760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab558-850f-47f7-87ba-8b3b9445395e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.829206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ab558-850f-47f7-87ba-8b3b9445395e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.830013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ab558-850f-47f7-87ba-8b3b9445395e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.832313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8ab558-850f-47f7-87ba-8b3b9445395e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.848567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 999/1997] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:35 2022] POST /identity/v3/users => generated 296 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:35.853146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e67c7-dbba-4ac4-8973-fd55a07f6095 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.866464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 999/1998] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:35 2022] POST /identity/v3/projects => generated 371 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:35.866710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0e67c7-dbba-4ac4-8973-fd55a07f6095 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.868270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ab558-850f-47f7-87ba-8b3b9445395e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.903416 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:35.922774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a68c38-9d57-47a0-962e-256ca2f5afc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.923484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a68c38-9d57-47a0-962e-256ca2f5afc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.923771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a68c38-9d57-47a0-962e-256ca2f5afc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.924050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a68c38-9d57-47a0-962e-256ca2f5afc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.924810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a68c38-9d57-47a0-962e-256ca2f5afc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.926421 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a68c38-9d57-47a0-962e-256ca2f5afc3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.935874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ab558-850f-47f7-87ba-8b3b9445395e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.937243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1000/1999] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:35.940778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73521abb-3269-4ac1-99bd-8cbff088a6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.941383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521abb-3269-4ac1-99bd-8cbff088a6d1 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.941514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a68c38-9d57-47a0-962e-256ca2f5afc3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.941662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521abb-3269-4ac1-99bd-8cbff088a6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.941932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73521abb-3269-4ac1-99bd-8cbff088a6d1 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.942558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73521abb-3269-4ac1-99bd-8cbff088a6d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.944501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73521abb-3269-4ac1-99bd-8cbff088a6d1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.951377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a68c38-9d57-47a0-962e-256ca2f5afc3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.957934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7883f-f61d-493a-a2df-238214bafa30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:35.958668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7883f-f61d-493a-a2df-238214bafa30 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:35.958979 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7883f-f61d-493a-a2df-238214bafa30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:35.959294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a7883f-f61d-493a-a2df-238214bafa30 admin admin] PATH_INFO: `/v3/projects/162ce8cc037c422fa8c55d60bd86b3c2/users/f165918d177047649198ed01d634397b/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:35.969612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1000/2000] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:35 2022] POST /identity/v3/users => generated 286 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:35.974009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73521abb-3269-4ac1-99bd-8cbff088a6d1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:35.975811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7883f-f61d-493a-a2df-238214bafa30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=162ce8cc037c422fa8c55d60bd86b3c2, user_id=f165918d177047649198ed01d634397b, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:35.979645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a7883f-f61d-493a-a2df-238214bafa30 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:35.985495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73521abb-3269-4ac1-99bd-8cbff088a6d1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:35.992938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1001/2001] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:35 2022] PUT /identity/v3/projects/162ce8cc037c422fa8c55d60bd86b3c2/users/f165918d177047649198ed01d634397b/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:35.996991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7883f-f61d-493a-a2df-238214bafa30 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:36.050595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8fa5f-b60f-4a0c-be86-f8030ad85c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:36.051209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8fa5f-b60f-4a0c-be86-f8030ad85c35 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.051495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8fa5f-b60f-4a0c-be86-f8030ad85c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.051768 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde8fa5f-b60f-4a0c-be86-f8030ad85c35 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.052524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8fa5f-b60f-4a0c-be86-f8030ad85c35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:36.054179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde8fa5f-b60f-4a0c-be86-f8030ad85c35 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:36.068052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1001/2002] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:36.068241 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a7883f-f61d-493a-a2df-238214bafa30 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:36.069015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8fa5f-b60f-4a0c-be86-f8030ad85c35 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:36.071605 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fac0c5-ca5d-424e-9e6e-df5c03384313 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:36.072264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac0c5-ca5d-424e-9e6e-df5c03384313 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.072544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac0c5-ca5d-424e-9e6e-df5c03384313 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.072819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fac0c5-ca5d-424e-9e6e-df5c03384313 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.073467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fac0c5-ca5d-424e-9e6e-df5c03384313 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:36.075097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fac0c5-ca5d-424e-9e6e-df5c03384313 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:36.079860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde8fa5f-b60f-4a0c-be86-f8030ad85c35 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:36.084973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6e6e-7fe9-4d19-b14a-45797885916c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:36.085572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1002/2003] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:35 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:36.085724 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6e6e-7fe9-4d19-b14a-45797885916c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.089419 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6e6e-7fe9-4d19-b14a-45797885916c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.089678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfc6e6e-7fe9-4d19-b14a-45797885916c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.090066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fac0c5-ca5d-424e-9e6e-df5c03384313 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:36.090347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc6e6e-7fe9-4d19-b14a-45797885916c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:36.091966 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cfc6e6e-7fe9-4d19-b14a-45797885916c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:36.100569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fac0c5-ca5d-424e-9e6e-df5c03384313 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:36.104025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1002/2004] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:36 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:36.105887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceb8615-ba60-40aa-ab3d-69558d6bb1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:36.106546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8615-ba60-40aa-ab3d-69558d6bb1bf admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.106828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8615-ba60-40aa-ab3d-69558d6bb1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.107102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceb8615-ba60-40aa-ab3d-69558d6bb1bf admin admin] PATH_INFO: `/v3/projects/162ce8cc037c422fa8c55d60bd86b3c2/users/f165918d177047649198ed01d634397b/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.108197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6e6e-7fe9-4d19-b14a-45797885916c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:36.109221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb8615-ba60-40aa-ab3d-69558d6bb1bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=162ce8cc037c422fa8c55d60bd86b3c2, user_id=f165918d177047649198ed01d634397b, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:36.111876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ceb8615-ba60-40aa-ab3d-69558d6bb1bf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:36.114263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:36.120755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfc6e6e-7fe9-4d19-b14a-45797885916c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:36.126796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1003/2005] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:36 2022] PUT /identity/v3/projects/162ce8cc037c422fa8c55d60bd86b3c2/users/f165918d177047649198ed01d634397b/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:36.140180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717ec9d-1003-44a1-ade5-7ddf8b361e6a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.140492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717ec9d-1003-44a1-ade5-7ddf8b361e6a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.140771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717ec9d-1003-44a1-ade5-7ddf8b361e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.175004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6717ec9d-1003-44a1-ade5-7ddf8b361e6a None None] MFA Rules not processed for user `f165918d177047649198ed01d634397b`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:36.176279 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6717ec9d-1003-44a1-ade5-7ddf8b361e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:36.188353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8490ad5b-d71b-40f1-a286-e609a417f75c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:36.189229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ad5b-d71b-40f1-a286-e609a417f75c admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.189496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ad5b-d71b-40f1-a286-e609a417f75c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.190536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8490ad5b-d71b-40f1-a286-e609a417f75c admin admin] PATH_INFO: `/v3/projects/02107e8e8017499db0458dc9d71b0198/users/9331882ea6fc4c6dad3c7811beae7a86/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.215352 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490ad5b-d71b-40f1-a286-e609a417f75c admin admin] RBAC: Authorizing `identity:create_grant(project_id=02107e8e8017499db0458dc9d71b0198, user_id=9331882ea6fc4c6dad3c7811beae7a86, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:36.218368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8490ad5b-d71b-40f1-a286-e609a417f75c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:36.234188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1003/2006] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:36 2022] PUT /identity/v3/projects/02107e8e8017499db0458dc9d71b0198/users/9331882ea6fc4c6dad3c7811beae7a86/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:36.239133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c41d28-e1c2-4de7-8ec5-dd3f411667c0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.239528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c41d28-e1c2-4de7-8ec5-dd3f411667c0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.239869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c41d28-e1c2-4de7-8ec5-dd3f411667c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.264206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1004/2007] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:36.264450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-27c41d28-e1c2-4de7-8ec5-dd3f411667c0 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:36.265658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-27c41d28-e1c2-4de7-8ec5-dd3f411667c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:36.275919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717ec9d-1003-44a1-ade5-7ddf8b361e6a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:36.277384 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6717ec9d-1003-44a1-ade5-7ddf8b361e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:36.297362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:36.343582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1004/2008] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:36.344731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c41d28-e1c2-4de7-8ec5-dd3f411667c0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:36.346062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-27c41d28-e1c2-4de7-8ec5-dd3f411667c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:36.351768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717ec9d-1003-44a1-ade5-7ddf8b361e6a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:36.358816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c41d28-e1c2-4de7-8ec5-dd3f411667c0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:36.364104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:36.364868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.365152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.365431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] PATH_INFO: `/v3/users/9c7efbe9937441ac9b60b6bcaf1ed77b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.366601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9c7efbe9937441ac9b60b6bcaf1ed77b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:36.368587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:36.403414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d099e59-125e-480f-a057-29a1248bd8e7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:36.404091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d099e59-125e-480f-a057-29a1248bd8e7 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.404452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d099e59-125e-480f-a057-29a1248bd8e7 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.404731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d099e59-125e-480f-a057-29a1248bd8e7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.419562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9c7efbe9937441ac9b60b6bcaf1ed77b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:36.420288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9c7efbe9937441ac9b60b6bcaf1ed77b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:36.420919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9c7efbe9937441ac9b60b6bcaf1ed77b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:36.427955 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9c7efbe9937441ac9b60b6bcaf1ed77b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:36.440396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9c7efbe9937441ac9b60b6bcaf1ed77b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:36.454810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:36.458140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1005/2009] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:36 2022] DELETE /identity/v3/users/9c7efbe9937441ac9b60b6bcaf1ed77b => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:36.462423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:36.464956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:36.468202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d099e59-125e-480f-a057-29a1248bd8e7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:36.473406 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d099e59-125e-480f-a057-29a1248bd8e7 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:36.483122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1005/2010] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:36 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:36.487344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7e7c5-e8e4-4166-aed5-8c50d01d4ef4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.487344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7e7c5-e8e4-4166-aed5-8c50d01d4ef4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.487344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b7e7c5-e8e4-4166-aed5-8c50d01d4ef4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.508262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d4b7e7c5-e8e4-4166-aed5-8c50d01d4ef4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:36.510244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d4b7e7c5-e8e4-4166-aed5-8c50d01d4ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:36.543090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2521ebdc-9ac7-4f83-b2b4-7172b0a52650 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:36.548717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329dca-4f3e-42fd-a5f8-dbb58207af1f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:36.549543 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329dca-4f3e-42fd-a5f8-dbb58207af1f service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.549822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329dca-4f3e-42fd-a5f8-dbb58207af1f service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.550232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72329dca-4f3e-42fd-a5f8-dbb58207af1f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.552319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-72329dca-4f3e-42fd-a5f8-dbb58207af1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:36.592216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1006/2011] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:36.602165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7e7c5-e8e4-4166-aed5-8c50d01d4ef4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:36.604212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d4b7e7c5-e8e4-4166-aed5-8c50d01d4ef4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:36.629790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b7e7c5-e8e4-4166-aed5-8c50d01d4ef4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:36.647288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7ac55-2f16-4a29-8e06-9d604ec55dfc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:36.648900 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7ac55-2f16-4a29-8e06-9d604ec55dfc service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:36.650365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7ac55-2f16-4a29-8e06-9d604ec55dfc service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:36.650904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe7ac55-2f16-4a29-8e06-9d604ec55dfc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:36.653584 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:36.673148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7ac55-2f16-4a29-8e06-9d604ec55dfc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:36.675100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe7ac55-2f16-4a29-8e06-9d604ec55dfc service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:36.688819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72329dca-4f3e-42fd-a5f8-dbb58207af1f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:36.691065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72329dca-4f3e-42fd-a5f8-dbb58207af1f service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:36.703941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1006/2012] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:36.713837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1007/2013] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:37.108923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329dca-4f3e-42fd-a5f8-dbb58207af1f service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:37.110971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-72329dca-4f3e-42fd-a5f8-dbb58207af1f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:37.147577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72329dca-4f3e-42fd-a5f8-dbb58207af1f service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:37.153229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:37.154560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:37.154911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:37.155254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] PATH_INFO: `/v3/projects/a21772f9a4d846cab69a3986f037972a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:37.157158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a21772f9a4d846cab69a3986f037972a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:37.159387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:37.230255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a21772f9a4d846cab69a3986f037972a', 'request_id': 'req-c2b64edb-30bc-4a19-803f-83e594715134'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.239965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a21772f9a4d846cab69a3986f037972a', 'request_id': 'req-c2b64edb-30bc-4a19-803f-83e594715134'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.249943 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a21772f9a4d846cab69a3986f037972a', 'request_id': 'req-c2b64edb-30bc-4a19-803f-83e594715134'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.270325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] The token cache is being invalidate because project a21772f9a4d846cab69a3986f037972a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:37.270661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.271395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c2b64edb-30bc-4a19-803f-83e594715134 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.276452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1007/2014] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:37 2022] DELETE /identity/v3/projects/a21772f9a4d846cab69a3986f037972a => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:37.277658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7ac55-2f16-4a29-8e06-9d604ec55dfc service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:37.289404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe7ac55-2f16-4a29-8e06-9d604ec55dfc service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:37.357555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:37.358135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:37.358410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:37.358682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] PATH_INFO: `/v3/users/5e008f67624f46acbe88d2e7d1424cd7` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:37.359942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e008f67624f46acbe88d2e7d1424cd7)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:37.361937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:37.410688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e008f67624f46acbe88d2e7d1424cd7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.411340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e008f67624f46acbe88d2e7d1424cd7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.426417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e008f67624f46acbe88d2e7d1424cd7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.427115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e008f67624f46acbe88d2e7d1424cd7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.434709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e008f67624f46acbe88d2e7d1424cd7'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.438513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:37.451506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1008/2015] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:37 2022] DELETE /identity/v3/users/5e008f67624f46acbe88d2e7d1424cd7 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:37.568338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d80932-320d-4629-8cda-f9da34db0d94 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:37.568754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d80932-320d-4629-8cda-f9da34db0d94 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:37.569129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d80932-320d-4629-8cda-f9da34db0d94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:37.609151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-78d80932-320d-4629-8cda-f9da34db0d94 None None] MFA Rules not processed for user `9331882ea6fc4c6dad3c7811beae7a86`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:37.610434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-78d80932-320d-4629-8cda-f9da34db0d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:37.700748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1008/2016] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:37.702243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:37.704902 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:37.817551 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d80932-320d-4629-8cda-f9da34db0d94 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:37.818222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c193ec7-e616-4018-b004-ecb1abde8865 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:37.819689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-78d80932-320d-4629-8cda-f9da34db0d94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:37.824601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18d4c2-4175-46f5-ac18-1a8919bfce7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:37.825407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18d4c2-4175-46f5-ac18-1a8919bfce7b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:37.825924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18d4c2-4175-46f5-ac18-1a8919bfce7b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:37.826345 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18d4c2-4175-46f5-ac18-1a8919bfce7b admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:37.827186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18d4c2-4175-46f5-ac18-1a8919bfce7b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:37.829453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf18d4c2-4175-46f5-ac18-1a8919bfce7b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:37.848622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d80932-320d-4629-8cda-f9da34db0d94 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:37.854273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:37.855460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:37.855916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:37.856394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] PATH_INFO: `/v3/projects/45e3d87c322e46a99db097f145aa83dc` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:37.857717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] RBAC: Authorizing `identity:delete_project(project_id=45e3d87c322e46a99db097f145aa83dc)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:37.860411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:37.876751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1009/2017] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:37 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:37.877705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18d4c2-4175-46f5-ac18-1a8919bfce7b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:37.960065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45e3d87c322e46a99db097f145aa83dc', 'request_id': 'req-12ad42b7-20ef-49b3-a389-c10d3e653306'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.968399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45e3d87c322e46a99db097f145aa83dc', 'request_id': 'req-12ad42b7-20ef-49b3-a389-c10d3e653306'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.969689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18d4c2-4175-46f5-ac18-1a8919bfce7b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:37.972618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:37.975459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45e3d87c322e46a99db097f145aa83dc', 'request_id': 'req-12ad42b7-20ef-49b3-a389-c10d3e653306'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.995420 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] The token cache is being invalidate because project 45e3d87c322e46a99db097f145aa83dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:37.996033 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.996830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-12ad42b7-20ef-49b3-a389-c10d3e653306 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:37.998771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1009/2018] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:37 2022] DELETE /identity/v3/projects/45e3d87c322e46a99db097f145aa83dc => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:38.003170 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02816924-8ffd-45f1-95a0-038345d3aec0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.003590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02816924-8ffd-45f1-95a0-038345d3aec0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.003985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02816924-8ffd-45f1-95a0-038345d3aec0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.027276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-02816924-8ffd-45f1-95a0-038345d3aec0 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:38.028607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-02816924-8ffd-45f1-95a0-038345d3aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:38.039773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d4179-5f7e-4f6e-89a2-1b6834ce8665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.040559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d4179-5f7e-4f6e-89a2-1b6834ce8665 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.040929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d4179-5f7e-4f6e-89a2-1b6834ce8665 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.041213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728d4179-5f7e-4f6e-89a2-1b6834ce8665 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.041853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d4179-5f7e-4f6e-89a2-1b6834ce8665 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.044002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728d4179-5f7e-4f6e-89a2-1b6834ce8665 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.066355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1010/2019] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:37 2022] POST /identity/v3/users => generated 293 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:38.067521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d4179-5f7e-4f6e-89a2-1b6834ce8665 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.069615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-728d4179-5f7e-4f6e-89a2-1b6834ce8665 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:38.094869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1010/2020] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:38.096017 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02816924-8ffd-45f1-95a0-038345d3aec0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.097124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-02816924-8ffd-45f1-95a0-038345d3aec0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:38.106172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:38.111198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02816924-8ffd-45f1-95a0-038345d3aec0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.117672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d38275f-364c-4656-9a66-31340d56a3ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.118360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38275f-364c-4656-9a66-31340d56a3ab admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.118737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38275f-364c-4656-9a66-31340d56a3ab admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.118982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d38275f-364c-4656-9a66-31340d56a3ab admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.119664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38275f-364c-4656-9a66-31340d56a3ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.121421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d38275f-364c-4656-9a66-31340d56a3ab admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.132614 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1011/2021] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:38.136987 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe64c7-78bb-4f0b-b5c7-ff856f9fe484 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.137276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe64c7-78bb-4f0b-b5c7-ff856f9fe484 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.137555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe64c7-78bb-4f0b-b5c7-ff856f9fe484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.147283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728d4179-5f7e-4f6e-89a2-1b6834ce8665 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.151501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598f52b-e2a2-414e-90e8-8bae57caf1c5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.152113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598f52b-e2a2-414e-90e8-8bae57caf1c5 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.152421 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598f52b-e2a2-414e-90e8-8bae57caf1c5 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.152696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e598f52b-e2a2-414e-90e8-8bae57caf1c5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.154591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e598f52b-e2a2-414e-90e8-8bae57caf1c5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:38.157554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8dfe64c7-78bb-4f0b-b5c7-ff856f9fe484 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:38.158804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8dfe64c7-78bb-4f0b-b5c7-ff856f9fe484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:38.167007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1012/2022] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:38.167759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe64c7-78bb-4f0b-b5c7-ff856f9fe484 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.176972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe64c7-78bb-4f0b-b5c7-ff856f9fe484 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.181653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486590b6-3eb4-41ff-bc52-792087dcbe5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.182288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486590b6-3eb4-41ff-bc52-792087dcbe5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.182564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486590b6-3eb4-41ff-bc52-792087dcbe5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.182837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486590b6-3eb4-41ff-bc52-792087dcbe5f admin admin] PATH_INFO: `/v3/projects/096034c1e227474e85a5ad03bc807df0/users/1a9dd749ca78473a8f5fc375015adced/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.199664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486590b6-3eb4-41ff-bc52-792087dcbe5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=096034c1e227474e85a5ad03bc807df0, user_id=1a9dd749ca78473a8f5fc375015adced, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.202512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486590b6-3eb4-41ff-bc52-792087dcbe5f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.215570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1013/2023] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:38 2022] PUT /identity/v3/projects/096034c1e227474e85a5ad03bc807df0/users/1a9dd749ca78473a8f5fc375015adced/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:38.216400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486590b6-3eb4-41ff-bc52-792087dcbe5f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.223265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598f52b-e2a2-414e-90e8-8bae57caf1c5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.224768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e598f52b-e2a2-414e-90e8-8bae57caf1c5 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.235118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1011/2024] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:38.235912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598f52b-e2a2-414e-90e8-8bae57caf1c5 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.246012 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e598f52b-e2a2-414e-90e8-8bae57caf1c5 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.286980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486590b6-3eb4-41ff-bc52-792087dcbe5f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.292678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197714a2-aad6-4c64-98ce-ea6395f8d336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.293373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197714a2-aad6-4c64-98ce-ea6395f8d336 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.293767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197714a2-aad6-4c64-98ce-ea6395f8d336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.294118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197714a2-aad6-4c64-98ce-ea6395f8d336 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.294849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197714a2-aad6-4c64-98ce-ea6395f8d336 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:38.295557 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197714a2-aad6-4c64-98ce-ea6395f8d336 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.297155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197714a2-aad6-4c64-98ce-ea6395f8d336 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.311348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1014/2025] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:27:38.315835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197714a2-aad6-4c64-98ce-ea6395f8d336 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.322579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962e263-51ec-48f3-85cf-9a3ade9a0951 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.323848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e263-51ec-48f3-85cf-9a3ade9a0951 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.323848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e263-51ec-48f3-85cf-9a3ade9a0951 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.323848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a962e263-51ec-48f3-85cf-9a3ade9a0951 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.324540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962e263-51ec-48f3-85cf-9a3ade9a0951 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.326265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a962e263-51ec-48f3-85cf-9a3ade9a0951 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.328427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197714a2-aad6-4c64-98ce-ea6395f8d336 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.333926 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243670c-5b2f-4740-8836-d939b850c966 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.334757 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243670c-5b2f-4740-8836-d939b850c966 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.335116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243670c-5b2f-4740-8836-d939b850c966 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.335568 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1243670c-5b2f-4740-8836-d939b850c966 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.336269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243670c-5b2f-4740-8836-d939b850c966 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.338521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1243670c-5b2f-4740-8836-d939b850c966 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.339119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1012/2026] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:38.343308 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962e263-51ec-48f3-85cf-9a3ade9a0951 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.354211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a962e263-51ec-48f3-85cf-9a3ade9a0951 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.359519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bb399-1962-4fe8-9ba8-74a0f86e21bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.360317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb399-1962-4fe8-9ba8-74a0f86e21bc admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.360602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb399-1962-4fe8-9ba8-74a0f86e21bc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.360881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-282bb399-1962-4fe8-9ba8-74a0f86e21bc admin admin] PATH_INFO: `/v3/projects/096034c1e227474e85a5ad03bc807df0/users/1a9dd749ca78473a8f5fc375015adced/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.362986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bb399-1962-4fe8-9ba8-74a0f86e21bc admin admin] RBAC: Authorizing `identity:create_grant(project_id=096034c1e227474e85a5ad03bc807df0, user_id=1a9dd749ca78473a8f5fc375015adced, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.365599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-282bb399-1962-4fe8-9ba8-74a0f86e21bc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.380863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1013/2027] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:38 2022] PUT /identity/v3/projects/096034c1e227474e85a5ad03bc807df0/users/1a9dd749ca78473a8f5fc375015adced/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:38.387232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1015/2028] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:38 2022] POST /identity/v3/projects => generated 371 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:38.391254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bb399-1962-4fe8-9ba8-74a0f86e21bc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.448848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:38.463736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-282bb399-1962-4fe8-9ba8-74a0f86e21bc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.532055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5cf03-2569-4437-81f5-90693bfda022 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.532874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5cf03-2569-4437-81f5-90693bfda022 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.533248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5cf03-2569-4437-81f5-90693bfda022 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.533572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5cf03-2569-4437-81f5-90693bfda022 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.534214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5cf03-2569-4437-81f5-90693bfda022 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.536236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5cf03-2569-4437-81f5-90693bfda022 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.560941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1014/2029] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:38 2022] POST /identity/v3/users => generated 286 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:38.565338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243670c-5b2f-4740-8836-d939b850c966 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.579085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1243670c-5b2f-4740-8836-d939b850c966 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.584631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577bcc-e247-4789-a9e7-d455187979c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.585294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577bcc-e247-4789-a9e7-d455187979c9 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.585579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577bcc-e247-4789-a9e7-d455187979c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.585854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55577bcc-e247-4789-a9e7-d455187979c9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.586508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55577bcc-e247-4789-a9e7-d455187979c9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.588619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55577bcc-e247-4789-a9e7-d455187979c9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.599206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1016/2030] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:38.603564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5cf03-2569-4437-81f5-90693bfda022 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.615411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5cf03-2569-4437-81f5-90693bfda022 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.621077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9389c614-a871-4ba4-9186-5d478b4f0b33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.621736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389c614-a871-4ba4-9186-5d478b4f0b33 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.622007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389c614-a871-4ba4-9186-5d478b4f0b33 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.622280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9389c614-a871-4ba4-9186-5d478b4f0b33 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.622929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389c614-a871-4ba4-9186-5d478b4f0b33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.624587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9389c614-a871-4ba4-9186-5d478b4f0b33 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.636555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1015/2031] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:38 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:38.641081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577bcc-e247-4789-a9e7-d455187979c9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.650998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55577bcc-e247-4789-a9e7-d455187979c9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.656047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72614c-b871-4c2d-8d64-afd0432294fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.656761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72614c-b871-4c2d-8d64-afd0432294fa admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.657040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72614c-b871-4c2d-8d64-afd0432294fa admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.657319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b72614c-b871-4c2d-8d64-afd0432294fa admin admin] PATH_INFO: `/v3/projects/a16ba9a24c0440b8868ecd85e43897d5/users/fc93156d153943f6b41148f7e4b8dcfa/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.659766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:38.675053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72614c-b871-4c2d-8d64-afd0432294fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=a16ba9a24c0440b8868ecd85e43897d5, user_id=fc93156d153943f6b41148f7e4b8dcfa, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.677977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b72614c-b871-4c2d-8d64-afd0432294fa admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.693918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1017/2032] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:38 2022] PUT /identity/v3/projects/a16ba9a24c0440b8868ecd85e43897d5/users/fc93156d153943f6b41148f7e4b8dcfa/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:38.706689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51c90-e439-4c1a-bee5-d19544e36b9f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.706982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51c90-e439-4c1a-bee5-d19544e36b9f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.707264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb51c90-e439-4c1a-bee5-d19544e36b9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.741506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6cb51c90-e439-4c1a-bee5-d19544e36b9f None None] MFA Rules not processed for user `fc93156d153943f6b41148f7e4b8dcfa`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:38.742739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6cb51c90-e439-4c1a-bee5-d19544e36b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:38.818889 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1016/2033] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:38 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:38.824045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72614c-b871-4c2d-8d64-afd0432294fa admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.890494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b72614c-b871-4c2d-8d64-afd0432294fa admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:38.895481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87a8a4-afce-4f40-9f49-cf9bede6fa89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:38.896115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87a8a4-afce-4f40-9f49-cf9bede6fa89 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:38.896431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87a8a4-afce-4f40-9f49-cf9bede6fa89 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:38.896707 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c87a8a4-afce-4f40-9f49-cf9bede6fa89 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:38.897351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87a8a4-afce-4f40-9f49-cf9bede6fa89 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:38.899849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c87a8a4-afce-4f40-9f49-cf9bede6fa89 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:38.933463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb51c90-e439-4c1a-bee5-d19544e36b9f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.934898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6cb51c90-e439-4c1a-bee5-d19544e36b9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:38.935725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1018/2034] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:38 2022] POST /identity/v3/projects => generated 373 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:38.936676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87a8a4-afce-4f40-9f49-cf9bede6fa89 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:38.949743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb51c90-e439-4c1a-bee5-d19544e36b9f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:39.013875 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c87a8a4-afce-4f40-9f49-cf9bede6fa89 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:39.019319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde41da-3050-480f-920f-67ee84f1fdfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:39.019969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde41da-3050-480f-920f-67ee84f1fdfd admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.020341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde41da-3050-480f-920f-67ee84f1fdfd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.020684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dde41da-3050-480f-920f-67ee84f1fdfd admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.021448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde41da-3050-480f-920f-67ee84f1fdfd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:39.024330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dde41da-3050-480f-920f-67ee84f1fdfd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:39.036806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:39.038555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.038830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.039106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] PATH_INFO: `/v3/users/bd0996ca57f24717a6ca3cb96fd2d0b8` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.040483 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd0996ca57f24717a6ca3cb96fd2d0b8)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:39.042617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:39.048721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1019/2035] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:38 2022] POST /identity/v3/users => generated 293 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:39.049329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:39.055304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde41da-3050-480f-920f-67ee84f1fdfd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:39.065624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dde41da-3050-480f-920f-67ee84f1fdfd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:39.078577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e1e53-79cb-4331-ada6-519e4af43e85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:39.080096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1e53-79cb-4331-ada6-519e4af43e85 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.080096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1e53-79cb-4331-ada6-519e4af43e85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.080096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8e1e53-79cb-4331-ada6-519e4af43e85 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.081231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e1e53-79cb-4331-ada6-519e4af43e85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:39.082954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8e1e53-79cb-4331-ada6-519e4af43e85 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:39.096351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1020/2036] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:39.101724 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e1e53-79cb-4331-ada6-519e4af43e85 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:39.112812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8e1e53-79cb-4331-ada6-519e4af43e85 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:39.120864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11ad12ee-98c3-415c-ba41-1bc3085b2864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:39.121438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad12ee-98c3-415c-ba41-1bc3085b2864 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.121839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad12ee-98c3-415c-ba41-1bc3085b2864 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.122217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11ad12ee-98c3-415c-ba41-1bc3085b2864 admin admin] PATH_INFO: `/v3/projects/e4acecf6e90745e2b585489c87613f17/users/945a3dd67d1a44c49d06224de97e5f08/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.128140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd0996ca57f24717a6ca3cb96fd2d0b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:39.129008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd0996ca57f24717a6ca3cb96fd2d0b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:39.144813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd0996ca57f24717a6ca3cb96fd2d0b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:39.145593 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd0996ca57f24717a6ca3cb96fd2d0b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:39.157416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-baf91443-e5c4-4c40-87ae-b642cab949a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd0996ca57f24717a6ca3cb96fd2d0b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:39.161018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad12ee-98c3-415c-ba41-1bc3085b2864 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4acecf6e90745e2b585489c87613f17, user_id=945a3dd67d1a44c49d06224de97e5f08, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:39.164261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11ad12ee-98c3-415c-ba41-1bc3085b2864 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:39.194862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1021/2037] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:39 2022] PUT /identity/v3/projects/e4acecf6e90745e2b585489c87613f17/users/945a3dd67d1a44c49d06224de97e5f08/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:39.194862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822cd16-66bf-4b25-aa2a-dee04d95c445 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.194862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822cd16-66bf-4b25-aa2a-dee04d95c445 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.194862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e822cd16-66bf-4b25-aa2a-dee04d95c445 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.195418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1017/2038] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:38 2022] DELETE /identity/v3/users/bd0996ca57f24717a6ca3cb96fd2d0b8 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:39.195418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333a9b-fb9a-45e2-9fe6-50c61a6c4473 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.195418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333a9b-fb9a-45e2-9fe6-50c61a6c4473 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.195418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c333a9b-fb9a-45e2-9fe6-50c61a6c4473 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.212467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3c333a9b-fb9a-45e2-9fe6-50c61a6c4473 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:39.213694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c333a9b-fb9a-45e2-9fe6-50c61a6c4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:39.223846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e822cd16-66bf-4b25-aa2a-dee04d95c445 None None] MFA Rules not processed for user `1a9dd749ca78473a8f5fc375015adced`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:39.225291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e822cd16-66bf-4b25-aa2a-dee04d95c445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:39.235353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:39.292785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1018/2039] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:39.293679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c333a9b-fb9a-45e2-9fe6-50c61a6c4473 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:39.295097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c333a9b-fb9a-45e2-9fe6-50c61a6c4473 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:39.311514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c333a9b-fb9a-45e2-9fe6-50c61a6c4473 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:39.316528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec18eec5-9df0-4187-aec2-ff4385922d96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:39.317338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18eec5-9df0-4187-aec2-ff4385922d96 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.317767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18eec5-9df0-4187-aec2-ff4385922d96 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.318317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec18eec5-9df0-4187-aec2-ff4385922d96 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.319109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18eec5-9df0-4187-aec2-ff4385922d96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:39.321075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec18eec5-9df0-4187-aec2-ff4385922d96 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:39.322921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1022/2040] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:39.323587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822cd16-66bf-4b25-aa2a-dee04d95c445 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:39.328831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e822cd16-66bf-4b25-aa2a-dee04d95c445 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:39.343833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1019/2041] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:39 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:39.346293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a95b-4f1c-4dda-9424-a405611f07ff None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.346982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a95b-4f1c-4dda-9424-a405611f07ff None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.347269 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed36a95b-4f1c-4dda-9424-a405611f07ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.367485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ed36a95b-4f1c-4dda-9424-a405611f07ff None None] MFA Rules not processed for user `9331882ea6fc4c6dad3c7811beae7a86`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:39.368727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed36a95b-4f1c-4dda-9424-a405611f07ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:39.390227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e822cd16-66bf-4b25-aa2a-dee04d95c445 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:39.394146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bb914-2d8b-48d6-88fd-85930428d185 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:39.394748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb914-2d8b-48d6-88fd-85930428d185 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.395082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb914-2d8b-48d6-88fd-85930428d185 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.395281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-974bb914-2d8b-48d6-88fd-85930428d185 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.405480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bb914-2d8b-48d6-88fd-85930428d185 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:39.406929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-974bb914-2d8b-48d6-88fd-85930428d185 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:39.417972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1023/2042] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:39.419370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bb914-2d8b-48d6-88fd-85930428d185 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:39.426808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1020/2043] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:39.434539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-974bb914-2d8b-48d6-88fd-85930428d185 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:39.437653 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36a95b-4f1c-4dda-9424-a405611f07ff None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:39.439435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d588dc-4561-499c-b757-59292850b9db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:39.439566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed36a95b-4f1c-4dda-9424-a405611f07ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:39.440243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d588dc-4561-499c-b757-59292850b9db admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.440518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d588dc-4561-499c-b757-59292850b9db admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.440814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d588dc-4561-499c-b757-59292850b9db admin admin] PATH_INFO: `/v3/projects/e4acecf6e90745e2b585489c87613f17/users/945a3dd67d1a44c49d06224de97e5f08/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.442676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d588dc-4561-499c-b757-59292850b9db admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4acecf6e90745e2b585489c87613f17, user_id=945a3dd67d1a44c49d06224de97e5f08, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:39.445365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d588dc-4561-499c-b757-59292850b9db admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:39.466936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:39.489951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1024/2044] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:39 2022] PUT /identity/v3/projects/e4acecf6e90745e2b585489c87613f17/users/945a3dd67d1a44c49d06224de97e5f08/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:39.500231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e12fb-2d06-4c86-aa8c-1bd30fe3b216 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.500519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e12fb-2d06-4c86-aa8c-1bd30fe3b216 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.501069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273e12fb-2d06-4c86-aa8c-1bd30fe3b216 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.544067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-273e12fb-2d06-4c86-aa8c-1bd30fe3b216 None None] MFA Rules not processed for user `945a3dd67d1a44c49d06224de97e5f08`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:39.545316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-273e12fb-2d06-4c86-aa8c-1bd30fe3b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:39.555831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed36a95b-4f1c-4dda-9424-a405611f07ff None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:39.652898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1025/2045] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:39.657134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88a2b1-c67b-44ee-8370-a60314676c9f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:39.657134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88a2b1-c67b-44ee-8370-a60314676c9f service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.660256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88a2b1-c67b-44ee-8370-a60314676c9f service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.660666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb88a2b1-c67b-44ee-8370-a60314676c9f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.663992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb88a2b1-c67b-44ee-8370-a60314676c9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:39.665166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e12fb-2d06-4c86-aa8c-1bd30fe3b216 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:39.667923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-273e12fb-2d06-4c86-aa8c-1bd30fe3b216 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:39.712963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:39.749052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88a2b1-c67b-44ee-8370-a60314676c9f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:39.752431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb88a2b1-c67b-44ee-8370-a60314676c9f service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:39.756909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273e12fb-2d06-4c86-aa8c-1bd30fe3b216 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:39.763957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee735d37-315f-4b02-8e1a-ef2c3cffd50b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:39.764977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee735d37-315f-4b02-8e1a-ef2c3cffd50b service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.766167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee735d37-315f-4b02-8e1a-ef2c3cffd50b service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.766292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1021/2046] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:39 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:39.766738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee735d37-315f-4b02-8e1a-ef2c3cffd50b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.780307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee735d37-315f-4b02-8e1a-ef2c3cffd50b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:39.781882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee735d37-315f-4b02-8e1a-ef2c3cffd50b service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:39.797358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1026/2047] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:39.822387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88a2b1-c67b-44ee-8370-a60314676c9f service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:39.824121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cb88a2b1-c67b-44ee-8370-a60314676c9f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:39.945873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:39.955839 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb88a2b1-c67b-44ee-8370-a60314676c9f service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:39.962237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:39.962885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:39.963299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:39.963668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] PATH_INFO: `/v3/projects/19d0ea86d689440fb26d611778a8e270` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:39.964994 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19d0ea86d689440fb26d611778a8e270)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:39.967047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:40.022145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19d0ea86d689440fb26d611778a8e270', 'request_id': 'req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:40.030743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19d0ea86d689440fb26d611778a8e270', 'request_id': 'req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:40.040159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19d0ea86d689440fb26d611778a8e270', 'request_id': 'req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:40.053660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] The token cache is being invalidate because project 19d0ea86d689440fb26d611778a8e270 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:40.054319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:40.057009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b1dae0c4-9fab-4d74-9fc2-6e5edfeb1300 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:40.058829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1022/2048] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:39 2022] DELETE /identity/v3/projects/19d0ea86d689440fb26d611778a8e270 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:40.319260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee735d37-315f-4b02-8e1a-ef2c3cffd50b service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:40.330404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee735d37-315f-4b02-8e1a-ef2c3cffd50b service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:40.397227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:40.398122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:40.398482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:40.398818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] PATH_INFO: `/v3/users/fc93156d153943f6b41148f7e4b8dcfa` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:40.399995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fc93156d153943f6b41148f7e4b8dcfa)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:40.401957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:40.469272 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fc93156d153943f6b41148f7e4b8dcfa'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:40.469923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fc93156d153943f6b41148f7e4b8dcfa'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:40.470597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fc93156d153943f6b41148f7e4b8dcfa'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:40.479049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fc93156d153943f6b41148f7e4b8dcfa'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:40.495952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fc93156d153943f6b41148f7e4b8dcfa'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:40.512236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1027/2049] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:40 2022] DELETE /identity/v3/users/fc93156d153943f6b41148f7e4b8dcfa => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:40.517046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa38de-0e95-4d8a-a207-0adc1df78f07 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:40.517512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa38de-0e95-4d8a-a207-0adc1df78f07 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:40.517590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa38de-0e95-4d8a-a207-0adc1df78f07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:40.541485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-25aa38de-0e95-4d8a-a207-0adc1df78f07 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:40.542989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-25aa38de-0e95-4d8a-a207-0adc1df78f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:40.606297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1023/2050] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:40.615989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:40.617564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:40.668638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:40.682298 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19213b5-1125-47ef-ae35-72d57a6aeb71 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:40.686704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f34832-6c5c-4dbe-b472-18d942670211 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:40.687321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f34832-6c5c-4dbe-b472-18d942670211 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:40.687601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f34832-6c5c-4dbe-b472-18d942670211 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:40.687901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f34832-6c5c-4dbe-b472-18d942670211 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:40.698709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f34832-6c5c-4dbe-b472-18d942670211 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:40.700175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f34832-6c5c-4dbe-b472-18d942670211 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:40.709997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1028/2051] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:41.012120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa38de-0e95-4d8a-a207-0adc1df78f07 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:41.013948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-25aa38de-0e95-4d8a-a207-0adc1df78f07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:41.032360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa38de-0e95-4d8a-a207-0adc1df78f07 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:41.037697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:41.038935 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:41.039451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:41.039642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] PATH_INFO: `/v3/projects/a16ba9a24c0440b8868ecd85e43897d5` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:41.040821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a16ba9a24c0440b8868ecd85e43897d5)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:41.042735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:41.095996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a16ba9a24c0440b8868ecd85e43897d5', 'request_id': 'req-3247506f-7df3-4c68-9487-cabf52bd8a97'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.104102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a16ba9a24c0440b8868ecd85e43897d5', 'request_id': 'req-3247506f-7df3-4c68-9487-cabf52bd8a97'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.112885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a16ba9a24c0440b8868ecd85e43897d5', 'request_id': 'req-3247506f-7df3-4c68-9487-cabf52bd8a97'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.125788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] The token cache is being invalidate because project a16ba9a24c0440b8868ecd85e43897d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:41.126089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.126740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.128510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1024/2052] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:41 2022] DELETE /identity/v3/projects/a16ba9a24c0440b8868ecd85e43897d5 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:41.132844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f34832-6c5c-4dbe-b472-18d942670211 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:41.142984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f34832-6c5c-4dbe-b472-18d942670211 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:41.213312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:41.213958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:41.214240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:41.214513 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] PATH_INFO: `/v3/users/945a3dd67d1a44c49d06224de97e5f08` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:41.215655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] RBAC: Authorizing `identity:delete_user(user_id=945a3dd67d1a44c49d06224de97e5f08)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:41.217781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:41.273746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '945a3dd67d1a44c49d06224de97e5f08'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.274455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '945a3dd67d1a44c49d06224de97e5f08'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.275070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '945a3dd67d1a44c49d06224de97e5f08'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.282856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '945a3dd67d1a44c49d06224de97e5f08'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.299864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d3e228d7-12dd-4f4d-9885-44fe1d8f873a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '945a3dd67d1a44c49d06224de97e5f08'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.314398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1029/2053] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:41 2022] DELETE /identity/v3/users/945a3dd67d1a44c49d06224de97e5f08 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:41.657868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:41.659323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:41.671883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3247506f-7df3-4c68-9487-cabf52bd8a97 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:41.677144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:41.730505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:41.731052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:41.731325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:41.731594 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] PATH_INFO: `/v3/projects/e4acecf6e90745e2b585489c87613f17` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:41.732715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4acecf6e90745e2b585489c87613f17)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:41.734604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:41.780796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4acecf6e90745e2b585489c87613f17', 'request_id': 'req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.786285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4acecf6e90745e2b585489c87613f17', 'request_id': 'req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.793826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4acecf6e90745e2b585489c87613f17', 'request_id': 'req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.806657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] The token cache is being invalidate because project e4acecf6e90745e2b585489c87613f17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:41.806975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.807604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-28e4ebcb-cb73-47db-8571-d5fbaa0f6ec3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:41.809113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1025/2054] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:41 2022] DELETE /identity/v3/projects/e4acecf6e90745e2b585489c87613f17 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:41.813894 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a56e20-7f74-4a59-993b-4402427d5caf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:41.814353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a56e20-7f74-4a59-993b-4402427d5caf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:41.814564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a56e20-7f74-4a59-993b-4402427d5caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:41.835937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-42a56e20-7f74-4a59-993b-4402427d5caf None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:41.837441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-42a56e20-7f74-4a59-993b-4402427d5caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:41.899103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1030/2055] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:41.907515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a270ec-c679-4904-be02-b365f6547d20 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:41.907882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a270ec-c679-4904-be02-b365f6547d20 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:41.908190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a270ec-c679-4904-be02-b365f6547d20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:41.928387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-69a270ec-c679-4904-be02-b365f6547d20 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:41.930175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-69a270ec-c679-4904-be02-b365f6547d20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:41.938817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1026/2056] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:41.943397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a56e20-7f74-4a59-993b-4402427d5caf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:41.953582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a56e20-7f74-4a59-993b-4402427d5caf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:41.958578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11177b9e-8ac3-4a6f-a1d8-b60b027568a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:41.959262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11177b9e-8ac3-4a6f-a1d8-b60b027568a8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:41.959617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11177b9e-8ac3-4a6f-a1d8-b60b027568a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:41.960016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11177b9e-8ac3-4a6f-a1d8-b60b027568a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:41.960913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11177b9e-8ac3-4a6f-a1d8-b60b027568a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:41.961138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11177b9e-8ac3-4a6f-a1d8-b60b027568a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:41.963169 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11177b9e-8ac3-4a6f-a1d8-b60b027568a8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:41.965008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:41.977891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1031/2057] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:27:41.982592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a270ec-c679-4904-be02-b365f6547d20 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:41.993175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a270ec-c679-4904-be02-b365f6547d20 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:41.998902 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672c601-f645-4794-9c64-7abc978345e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:41.999516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672c601-f645-4794-9c64-7abc978345e3 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:41.999914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672c601-f645-4794-9c64-7abc978345e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.000293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6672c601-f645-4794-9c64-7abc978345e3 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.001015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672c601-f645-4794-9c64-7abc978345e3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.003009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6672c601-f645-4794-9c64-7abc978345e3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.040893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1027/2058] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:41 2022] POST /identity/v3/projects => generated 369 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:42.045550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11177b9e-8ac3-4a6f-a1d8-b60b027568a8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.056897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11177b9e-8ac3-4a6f-a1d8-b60b027568a8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.114405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca5ff-b02c-4414-b851-fe1ebad4ba14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.115009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca5ff-b02c-4414-b851-fe1ebad4ba14 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.115288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca5ff-b02c-4414-b851-fe1ebad4ba14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.115558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4ca5ff-b02c-4414-b851-fe1ebad4ba14 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.116203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ca5ff-b02c-4414-b851-fe1ebad4ba14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.118725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4ca5ff-b02c-4414-b851-fe1ebad4ba14 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.143822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1032/2059] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:42 2022] POST /identity/v3/users => generated 285 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:42.145139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672c601-f645-4794-9c64-7abc978345e3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.155599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6672c601-f645-4794-9c64-7abc978345e3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.160455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210c933-f9d3-44c9-99a9-a547a929f949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.161059 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210c933-f9d3-44c9-99a9-a547a929f949 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.161346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210c933-f9d3-44c9-99a9-a547a929f949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.161624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6210c933-f9d3-44c9-99a9-a547a929f949 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.162270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210c933-f9d3-44c9-99a9-a547a929f949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.164459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6210c933-f9d3-44c9-99a9-a547a929f949 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.175787 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1028/2060] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:42.180907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca5ff-b02c-4414-b851-fe1ebad4ba14 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.196208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4ca5ff-b02c-4414-b851-fe1ebad4ba14 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.201559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43c9d8-7059-4185-b10f-da279ee0e833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.202206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43c9d8-7059-4185-b10f-da279ee0e833 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.202489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43c9d8-7059-4185-b10f-da279ee0e833 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.202764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b43c9d8-7059-4185-b10f-da279ee0e833 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.203416 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43c9d8-7059-4185-b10f-da279ee0e833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.205052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b43c9d8-7059-4185-b10f-da279ee0e833 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.220956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1033/2061] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:42.221066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210c933-f9d3-44c9-99a9-a547a929f949 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.221799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43c9d8-7059-4185-b10f-da279ee0e833 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.223472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7b43c9d8-7059-4185-b10f-da279ee0e833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:42.232959 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6210c933-f9d3-44c9-99a9-a547a929f949 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.237053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b43c9d8-7059-4185-b10f-da279ee0e833 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.239723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb88d7b-6e27-46d2-9f2c-b552acf338f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.240736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88d7b-6e27-46d2-9f2c-b552acf338f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.241191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88d7b-6e27-46d2-9f2c-b552acf338f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.242199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb88d7b-6e27-46d2-9f2c-b552acf338f1 admin admin] PATH_INFO: `/v3/projects/c6faf1bbb894410fbc4a8ac06f92f676/users/5498dfb2386b41048b3bf532c61f1369/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.242838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.243475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.243748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.244027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] PATH_INFO: `/v3/users/9e21d91fcb5541e0bedcf6486e621f45` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.245199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e21d91fcb5541e0bedcf6486e621f45)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.247130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.264138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb88d7b-6e27-46d2-9f2c-b552acf338f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6faf1bbb894410fbc4a8ac06f92f676, user_id=5498dfb2386b41048b3bf532c61f1369, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.267254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb88d7b-6e27-46d2-9f2c-b552acf338f1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.296478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1029/2062] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:42 2022] PUT /identity/v3/projects/c6faf1bbb894410fbc4a8ac06f92f676/users/5498dfb2386b41048b3bf532c61f1369/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:42.298082 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a738e9-8251-4fe1-ac62-b4c55a63bc3b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.298374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a738e9-8251-4fe1-ac62-b4c55a63bc3b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.298651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a738e9-8251-4fe1-ac62-b4c55a63bc3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.307774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e21d91fcb5541e0bedcf6486e621f45'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:42.308534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e21d91fcb5541e0bedcf6486e621f45'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:42.309177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e21d91fcb5541e0bedcf6486e621f45'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:42.317320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e21d91fcb5541e0bedcf6486e621f45'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:42.327893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-87a738e9-8251-4fe1-ac62-b4c55a63bc3b None None] MFA Rules not processed for user `5498dfb2386b41048b3bf532c61f1369`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:42.329148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-87a738e9-8251-4fe1-ac62-b4c55a63bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:42.333659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a1e495d-eafa-45ec-8ec9-74ffd227da55 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e21d91fcb5541e0bedcf6486e621f45'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:42.351940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1034/2063] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:42 2022] DELETE /identity/v3/users/9e21d91fcb5541e0bedcf6486e621f45 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:42.356578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017a3f-cbc1-408d-bf0a-784f9fd20aa3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.356860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017a3f-cbc1-408d-bf0a-784f9fd20aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.357137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e017a3f-cbc1-408d-bf0a-784f9fd20aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.361729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:42.383771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8e017a3f-cbc1-408d-bf0a-784f9fd20aa3 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:42.385375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8e017a3f-cbc1-408d-bf0a-784f9fd20aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:42.411162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1030/2064] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:42 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:42.416413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a738e9-8251-4fe1-ac62-b4c55a63bc3b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.418034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-87a738e9-8251-4fe1-ac62-b4c55a63bc3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:42.432963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:42.462025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1035/2065] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:42.471786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e017a3f-cbc1-408d-bf0a-784f9fd20aa3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.473323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8e017a3f-cbc1-408d-bf0a-784f9fd20aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:42.511453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a738e9-8251-4fe1-ac62-b4c55a63bc3b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.517315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0639dd-c23a-4b7a-8ec7-6f623768afc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.518436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0639dd-c23a-4b7a-8ec7-6f623768afc4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.518436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0639dd-c23a-4b7a-8ec7-6f623768afc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.518646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b0639dd-c23a-4b7a-8ec7-6f623768afc4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.519154 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0639dd-c23a-4b7a-8ec7-6f623768afc4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.521126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b0639dd-c23a-4b7a-8ec7-6f623768afc4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.542890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e017a3f-cbc1-408d-bf0a-784f9fd20aa3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.547532 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8927d-2121-4e8e-929c-3d8a69660259 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.548343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8927d-2121-4e8e-929c-3d8a69660259 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.548703 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8927d-2121-4e8e-929c-3d8a69660259 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.549049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f8927d-2121-4e8e-929c-3d8a69660259 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.557656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1031/2066] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:42 2022] POST /identity/v3/projects => generated 367 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:42.560203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0639dd-c23a-4b7a-8ec7-6f623768afc4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.562832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8927d-2121-4e8e-929c-3d8a69660259 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.564328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f8927d-2121-4e8e-929c-3d8a69660259 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.576485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1036/2067] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:27:42.642393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b0639dd-c23a-4b7a-8ec7-6f623768afc4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.650856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc4b88-a2eb-4d9c-92b6-c73aa535725e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.651857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc4b88-a2eb-4d9c-92b6-c73aa535725e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.652172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc4b88-a2eb-4d9c-92b6-c73aa535725e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.652506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24cc4b88-a2eb-4d9c-92b6-c73aa535725e admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.653785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc4b88-a2eb-4d9c-92b6-c73aa535725e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.656012 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24cc4b88-a2eb-4d9c-92b6-c73aa535725e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.690406 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1032/2068] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:42 2022] POST /identity/v3/users => generated 290 bytes in 132 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:42.695536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8927d-2121-4e8e-929c-3d8a69660259 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.711457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f8927d-2121-4e8e-929c-3d8a69660259 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.726699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77960ff-467a-46e6-800e-487d201b536b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.727459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77960ff-467a-46e6-800e-487d201b536b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.727740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77960ff-467a-46e6-800e-487d201b536b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.728012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e77960ff-467a-46e6-800e-487d201b536b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.729122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77960ff-467a-46e6-800e-487d201b536b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.730729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e77960ff-467a-46e6-800e-487d201b536b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.754753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1037/2069] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:42.755943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc4b88-a2eb-4d9c-92b6-c73aa535725e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.771847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24cc4b88-a2eb-4d9c-92b6-c73aa535725e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.779216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da01a3-7990-4908-8e0d-17bd8b29c0e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.780315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da01a3-7990-4908-8e0d-17bd8b29c0e6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.780315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da01a3-7990-4908-8e0d-17bd8b29c0e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.780513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54da01a3-7990-4908-8e0d-17bd8b29c0e6 admin admin] PATH_INFO: `/v3/projects/03cff3536f1948cc826ca271b15e14ea/users/1dbff09426e94eb3b2c040fd5aa09ad2/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.798547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da01a3-7990-4908-8e0d-17bd8b29c0e6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cff3536f1948cc826ca271b15e14ea, user_id=1dbff09426e94eb3b2c040fd5aa09ad2, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.801397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54da01a3-7990-4908-8e0d-17bd8b29c0e6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.820214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1033/2070] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:42 2022] PUT /identity/v3/projects/03cff3536f1948cc826ca271b15e14ea/users/1dbff09426e94eb3b2c040fd5aa09ad2/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:42.824933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77960ff-467a-46e6-800e-487d201b536b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.834889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e77960ff-467a-46e6-800e-487d201b536b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.919757 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58fc8f-9a2e-47c7-8154-60d5f10f0dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.920575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58fc8f-9a2e-47c7-8154-60d5f10f0dbb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.920882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58fc8f-9a2e-47c7-8154-60d5f10f0dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.921181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce58fc8f-9a2e-47c7-8154-60d5f10f0dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.921851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58fc8f-9a2e-47c7-8154-60d5f10f0dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.923509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce58fc8f-9a2e-47c7-8154-60d5f10f0dbb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.934870 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1038/2071] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:42 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:42.939517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da01a3-7990-4908-8e0d-17bd8b29c0e6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.956016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54da01a3-7990-4908-8e0d-17bd8b29c0e6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:42.963667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab4c3679-89b4-4eac-85de-e0ffe0c43a15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:42.964819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c3679-89b4-4eac-85de-e0ffe0c43a15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.964819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c3679-89b4-4eac-85de-e0ffe0c43a15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:42.965305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab4c3679-89b4-4eac-85de-e0ffe0c43a15 admin admin] PATH_INFO: `/v3/projects/03cff3536f1948cc826ca271b15e14ea/users/1dbff09426e94eb3b2c040fd5aa09ad2/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:42.967780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c3679-89b4-4eac-85de-e0ffe0c43a15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03cff3536f1948cc826ca271b15e14ea, user_id=1dbff09426e94eb3b2c040fd5aa09ad2, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:42.970716 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab4c3679-89b4-4eac-85de-e0ffe0c43a15 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:42.983240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58fc8f-9a2e-47c7-8154-60d5f10f0dbb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:42.985195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ce58fc8f-9a2e-47c7-8154-60d5f10f0dbb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:42.997281 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1034/2072] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:42 2022] PUT /identity/v3/projects/03cff3536f1948cc826ca271b15e14ea/users/1dbff09426e94eb3b2c040fd5aa09ad2/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:42.999417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9780d6b-1141-483b-aa0e-5f1d58f80aa1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:42.999713 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9780d6b-1141-483b-aa0e-5f1d58f80aa1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:43.000227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9780d6b-1141-483b-aa0e-5f1d58f80aa1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:43.019142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce58fc8f-9a2e-47c7-8154-60d5f10f0dbb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:43.020989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:43.058679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b9780d6b-1141-483b-aa0e-5f1d58f80aa1 None None] MFA Rules not processed for user `1dbff09426e94eb3b2c040fd5aa09ad2`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:43.059979 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b9780d6b-1141-483b-aa0e-5f1d58f80aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:43.107748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:43.108725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:43.109036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:43.109323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] PATH_INFO: `/v3/projects/2892eb7bfcf84993855ed3acec8a061f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:43.110486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] RBAC: Authorizing `identity:delete_project(project_id=2892eb7bfcf84993855ed3acec8a061f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:43.112597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:43.133132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:43.159500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1035/2073] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:42 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:43.173407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9780d6b-1141-483b-aa0e-5f1d58f80aa1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:43.174822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b9780d6b-1141-483b-aa0e-5f1d58f80aa1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:43.177682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2892eb7bfcf84993855ed3acec8a061f', 'request_id': 'req-67c15c8f-b564-4512-82c4-06279f66446a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:43.188465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2892eb7bfcf84993855ed3acec8a061f', 'request_id': 'req-67c15c8f-b564-4512-82c4-06279f66446a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:43.196183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2892eb7bfcf84993855ed3acec8a061f', 'request_id': 'req-67c15c8f-b564-4512-82c4-06279f66446a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:43.210216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] The token cache is being invalidate because project 2892eb7bfcf84993855ed3acec8a061f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:43.210984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:43.212528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:43.214355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1039/2074] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:42 2022] DELETE /identity/v3/projects/2892eb7bfcf84993855ed3acec8a061f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:43.218095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:43.219529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:43.244148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9780d6b-1141-483b-aa0e-5f1d58f80aa1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:43.294517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c15c8f-b564-4512-82c4-06279f66446a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:43.301202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:43.302762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:43.302762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:43.302762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] PATH_INFO: `/v3/users/f165918d177047649198ed01d634397b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:43.304774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f165918d177047649198ed01d634397b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:43.306444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af37f0-1aa9-4140-bf28-734235b6d846 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:43.306795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:43.307200 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af37f0-1aa9-4140-bf28-734235b6d846 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:43.307555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af37f0-1aa9-4140-bf28-734235b6d846 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:43.307902 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08af37f0-1aa9-4140-bf28-734235b6d846 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:43.311155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-08af37f0-1aa9-4140-bf28-734235b6d846 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:43.360422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f165918d177047649198ed01d634397b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:43.361236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f165918d177047649198ed01d634397b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:43.361882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f165918d177047649198ed01d634397b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:43.373859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f165918d177047649198ed01d634397b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:43.390548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:43.394670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af37f0-1aa9-4140-bf28-734235b6d846 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:43.395341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f165918d177047649198ed01d634397b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:43.396179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08af37f0-1aa9-4140-bf28-734235b6d846 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:43.409352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1036/2075] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:43 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:43.420970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1040/2076] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:43 2022] DELETE /identity/v3/users/f165918d177047649198ed01d634397b => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:43.457197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af37f0-1aa9-4140-bf28-734235b6d846 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:43.458696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-08af37f0-1aa9-4140-bf28-734235b6d846 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:43.470380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08af37f0-1aa9-4140-bf28-734235b6d846 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:43.534588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf509851-31a2-4701-9b38-a56c98ea9f8b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:43.535232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf509851-31a2-4701-9b38-a56c98ea9f8b service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:43.535563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf509851-31a2-4701-9b38-a56c98ea9f8b service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:43.535816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf509851-31a2-4701-9b38-a56c98ea9f8b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:43.537923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bf509851-31a2-4701-9b38-a56c98ea9f8b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:43.611452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf509851-31a2-4701-9b38-a56c98ea9f8b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:43.613001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf509851-31a2-4701-9b38-a56c98ea9f8b service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:43.623216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1037/2077] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:44.459787 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:44.462127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:44.497917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:44.542177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6996abca-b6b3-42c6-ac3a-e7e7643e1853 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:44.546979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:44.547606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:44.547882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:44.548165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] PATH_INFO: `/v3/projects/162ce8cc037c422fa8c55d60bd86b3c2` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:44.549310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=162ce8cc037c422fa8c55d60bd86b3c2)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:44.551222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:44.598008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '162ce8cc037c422fa8c55d60bd86b3c2', 'request_id': 'req-2eaf8976-44a3-4aef-a7dd-247d8155e345'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:44.604194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '162ce8cc037c422fa8c55d60bd86b3c2', 'request_id': 'req-2eaf8976-44a3-4aef-a7dd-247d8155e345'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:44.609938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '162ce8cc037c422fa8c55d60bd86b3c2', 'request_id': 'req-2eaf8976-44a3-4aef-a7dd-247d8155e345'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:44.622926 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] The token cache is being invalidate because project 162ce8cc037c422fa8c55d60bd86b3c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:44.623247 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:44.623901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2eaf8976-44a3-4aef-a7dd-247d8155e345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:44.625394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1041/2078] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:44 2022] DELETE /identity/v3/projects/162ce8cc037c422fa8c55d60bd86b3c2 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:44.630269 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db055b-9266-471f-b6ef-0b81bbd26d0b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:44.630753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db055b-9266-471f-b6ef-0b81bbd26d0b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:44.630846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db055b-9266-471f-b6ef-0b81bbd26d0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:44.650933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-37db055b-9266-471f-b6ef-0b81bbd26d0b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:44.652140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-37db055b-9266-471f-b6ef-0b81bbd26d0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:44.711193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1038/2079] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:44.719018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59563df-d780-4f4f-b9c0-94ed568c4e27 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:44.719297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59563df-d780-4f4f-b9c0-94ed568c4e27 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:44.719570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f59563df-d780-4f4f-b9c0-94ed568c4e27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:44.739601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-f59563df-d780-4f4f-b9c0-94ed568c4e27 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:44.740983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f59563df-d780-4f4f-b9c0-94ed568c4e27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:44.750252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1042/2080] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:44.754576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db055b-9266-471f-b6ef-0b81bbd26d0b None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:44.765212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db055b-9266-471f-b6ef-0b81bbd26d0b None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:44.770568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa0f7d-8964-4273-8983-fb0fd120bfa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:44.771207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa0f7d-8964-4273-8983-fb0fd120bfa4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:44.771512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa0f7d-8964-4273-8983-fb0fd120bfa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:44.771788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fa0f7d-8964-4273-8983-fb0fd120bfa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:44.772475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa0f7d-8964-4273-8983-fb0fd120bfa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:44.772784 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa0f7d-8964-4273-8983-fb0fd120bfa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:44.774469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fa0f7d-8964-4273-8983-fb0fd120bfa4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:44.786268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1039/2081] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:27:44.791588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59563df-d780-4f4f-b9c0-94ed568c4e27 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:44.800963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f59563df-d780-4f4f-b9c0-94ed568c4e27 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:44.806322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461a54a-8b59-4084-93ef-e70358a5f64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:44.806926 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461a54a-8b59-4084-93ef-e70358a5f64a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:44.807207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461a54a-8b59-4084-93ef-e70358a5f64a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:44.807485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f461a54a-8b59-4084-93ef-e70358a5f64a admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:44.808128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461a54a-8b59-4084-93ef-e70358a5f64a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:44.810094 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f461a54a-8b59-4084-93ef-e70358a5f64a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:44.841981 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1043/2082] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:44 2022] POST /identity/v3/projects => generated 401 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:44.847148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa0f7d-8964-4273-8983-fb0fd120bfa4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:44.858236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fa0f7d-8964-4273-8983-fb0fd120bfa4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:44.892524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:44.919026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cbc42-218d-4884-af23-a96414f4fe65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:44.919640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cbc42-218d-4884-af23-a96414f4fe65 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:44.919920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cbc42-218d-4884-af23-a96414f4fe65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:44.920226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041cbc42-218d-4884-af23-a96414f4fe65 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:44.920865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cbc42-218d-4884-af23-a96414f4fe65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:44.922930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041cbc42-218d-4884-af23-a96414f4fe65 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:44.944014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1040/2083] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:44 2022] POST /identity/v3/users => generated 301 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:44.948899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461a54a-8b59-4084-93ef-e70358a5f64a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:44.961850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f461a54a-8b59-4084-93ef-e70358a5f64a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:44.967332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad24d0-11d2-45b6-a535-6a1be4548bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:44.967939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad24d0-11d2-45b6-a535-6a1be4548bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:44.968242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad24d0-11d2-45b6-a535-6a1be4548bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:44.968592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaad24d0-11d2-45b6-a535-6a1be4548bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:44.969151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad24d0-11d2-45b6-a535-6a1be4548bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:44.970797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaad24d0-11d2-45b6-a535-6a1be4548bb0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:44.981254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1044/2084] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:44.985521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cbc42-218d-4884-af23-a96414f4fe65 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:44.995696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041cbc42-218d-4884-af23-a96414f4fe65 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:45.002669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f4ee98-80f6-4810-97e8-1ed0752ad121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:45.003285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4ee98-80f6-4810-97e8-1ed0752ad121 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.003560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4ee98-80f6-4810-97e8-1ed0752ad121 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.003831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f4ee98-80f6-4810-97e8-1ed0752ad121 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.004515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4ee98-80f6-4810-97e8-1ed0752ad121 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:45.006143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f4ee98-80f6-4810-97e8-1ed0752ad121 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:45.022270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1041/2085] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:44 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:45.027043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad24d0-11d2-45b6-a535-6a1be4548bb0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:45.037642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaad24d0-11d2-45b6-a535-6a1be4548bb0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:45.042832 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db9c8f-96bb-4fd1-b1a4-36171e5bd2e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:45.043539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db9c8f-96bb-4fd1-b1a4-36171e5bd2e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.043831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db9c8f-96bb-4fd1-b1a4-36171e5bd2e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.044173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db9c8f-96bb-4fd1-b1a4-36171e5bd2e2 admin admin] PATH_INFO: `/v3/projects/c6b3b1b752e94d81a98bf3a1dd5b4f90/users/00a2b32514004813a1acc5afe005a714/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.061488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db9c8f-96bb-4fd1-b1a4-36171e5bd2e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6b3b1b752e94d81a98bf3a1dd5b4f90, user_id=00a2b32514004813a1acc5afe005a714, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:45.064589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23db9c8f-96bb-4fd1-b1a4-36171e5bd2e2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:45.080356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1045/2086] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:45 2022] PUT /identity/v3/projects/c6b3b1b752e94d81a98bf3a1dd5b4f90/users/00a2b32514004813a1acc5afe005a714/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:45.092611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de0486-cd74-46a9-b094-ae24fd6a2419 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.092901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de0486-cd74-46a9-b094-ae24fd6a2419 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.093175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de0486-cd74-46a9-b094-ae24fd6a2419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.129143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-86de0486-cd74-46a9-b094-ae24fd6a2419 None None] MFA Rules not processed for user `00a2b32514004813a1acc5afe005a714`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:45.130602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-86de0486-cd74-46a9-b094-ae24fd6a2419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:45.205749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1042/2087] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3278 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:45.210965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db9c8f-96bb-4fd1-b1a4-36171e5bd2e2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:45.267504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:45.287107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db9c8f-96bb-4fd1-b1a4-36171e5bd2e2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:45.295688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c74b58-15df-4d31-a5da-8e987e3853e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:45.296355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c74b58-15df-4d31-a5da-8e987e3853e4 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.296744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c74b58-15df-4d31-a5da-8e987e3853e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.297103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c74b58-15df-4d31-a5da-8e987e3853e4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.297843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c74b58-15df-4d31-a5da-8e987e3853e4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:45.299898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c74b58-15df-4d31-a5da-8e987e3853e4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:45.335756 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1046/2088] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:45 2022] POST /identity/v3/projects => generated 401 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:45.336849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de0486-cd74-46a9-b094-ae24fd6a2419 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:45.351091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de0486-cd74-46a9-b094-ae24fd6a2419 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:45.433739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19b772-680c-44da-b29a-d096c3cde96d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:45.434641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19b772-680c-44da-b29a-d096c3cde96d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.435025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19b772-680c-44da-b29a-d096c3cde96d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.435404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac19b772-680c-44da-b29a-d096c3cde96d admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.437715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19b772-680c-44da-b29a-d096c3cde96d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:45.452254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac19b772-680c-44da-b29a-d096c3cde96d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:45.495958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1043/2089] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:45 2022] POST /identity/v3/users => generated 307 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:45.500865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c74b58-15df-4d31-a5da-8e987e3853e4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:45.519137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c74b58-15df-4d31-a5da-8e987e3853e4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:45.526314 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cbeed-7318-4357-ac0b-9da4faa04318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:45.527046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cbeed-7318-4357-ac0b-9da4faa04318 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.527556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cbeed-7318-4357-ac0b-9da4faa04318 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.528008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70cbeed-7318-4357-ac0b-9da4faa04318 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.528931 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cbeed-7318-4357-ac0b-9da4faa04318 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:45.530817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70cbeed-7318-4357-ac0b-9da4faa04318 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:45.545438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1047/2090] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:45.550244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19b772-680c-44da-b29a-d096c3cde96d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:45.563126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac19b772-680c-44da-b29a-d096c3cde96d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:45.567833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a6d5e-a2a7-4a92-b35e-0957b82f1400 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:45.568536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6d5e-a2a7-4a92-b35e-0957b82f1400 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.568821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6d5e-a2a7-4a92-b35e-0957b82f1400 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.569094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623a6d5e-a2a7-4a92-b35e-0957b82f1400 admin admin] PATH_INFO: `/v3/projects/8dbfe23c8aec4e038c789c6427d0740e/users/be47e99b8be7466ab43df57dc69488e3/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.589369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a6d5e-a2a7-4a92-b35e-0957b82f1400 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbfe23c8aec4e038c789c6427d0740e, user_id=be47e99b8be7466ab43df57dc69488e3, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:45.594082 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623a6d5e-a2a7-4a92-b35e-0957b82f1400 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:45.618291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1044/2091] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:45 2022] PUT /identity/v3/projects/8dbfe23c8aec4e038c789c6427d0740e/users/be47e99b8be7466ab43df57dc69488e3/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:45.622224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cbeed-7318-4357-ac0b-9da4faa04318 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:45.633932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70cbeed-7318-4357-ac0b-9da4faa04318 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:45.708505 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a808fa7-6fd5-432d-8fa8-603464ae8630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:45.708505 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808fa7-6fd5-432d-8fa8-603464ae8630 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.708505 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808fa7-6fd5-432d-8fa8-603464ae8630 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.708505 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a808fa7-6fd5-432d-8fa8-603464ae8630 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.709283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a808fa7-6fd5-432d-8fa8-603464ae8630 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:45.716363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a808fa7-6fd5-432d-8fa8-603464ae8630 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:45.723862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1048/2092] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:45.728387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a6d5e-a2a7-4a92-b35e-0957b82f1400 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:45.739511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623a6d5e-a2a7-4a92-b35e-0957b82f1400 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:45.745772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2fb4-de27-4f74-a60c-c1922de4fd15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:45.746583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2fb4-de27-4f74-a60c-c1922de4fd15 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.747029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2fb4-de27-4f74-a60c-c1922de4fd15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.747430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fa2fb4-de27-4f74-a60c-c1922de4fd15 admin admin] PATH_INFO: `/v3/projects/8dbfe23c8aec4e038c789c6427d0740e/users/be47e99b8be7466ab43df57dc69488e3/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.749499 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa2fb4-de27-4f74-a60c-c1922de4fd15 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8dbfe23c8aec4e038c789c6427d0740e, user_id=be47e99b8be7466ab43df57dc69488e3, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:45.752610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2fa2fb4-de27-4f74-a60c-c1922de4fd15 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:45.755955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:45.765941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1045/2093] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:45 2022] PUT /identity/v3/projects/8dbfe23c8aec4e038c789c6427d0740e/users/be47e99b8be7466ab43df57dc69488e3/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:45.777423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efece1eb-567a-4cdc-8979-72f68e8f85d3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.777711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efece1eb-567a-4cdc-8979-72f68e8f85d3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.778052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efece1eb-567a-4cdc-8979-72f68e8f85d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.814626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-efece1eb-567a-4cdc-8979-72f68e8f85d3 None None] MFA Rules not processed for user `be47e99b8be7466ab43df57dc69488e3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:45.816034 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-efece1eb-567a-4cdc-8979-72f68e8f85d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:45.901747 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1049/2094] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:45 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:45.913575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2fb4-de27-4f74-a60c-c1922de4fd15 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:45.915448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d2fa2fb4-de27-4f74-a60c-c1922de4fd15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:45.977810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fa2fb4-de27-4f74-a60c-c1922de4fd15 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:45.981500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213b51e-56dd-4ed1-807b-05ecb553c94d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:45.982111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213b51e-56dd-4ed1-807b-05ecb553c94d service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:45.982386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213b51e-56dd-4ed1-807b-05ecb553c94d service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:45.982657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3213b51e-56dd-4ed1-807b-05ecb553c94d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:45.992387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213b51e-56dd-4ed1-807b-05ecb553c94d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:45.993777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3213b51e-56dd-4ed1-807b-05ecb553c94d service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:46.003396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1046/2095] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:45 2022] GET /identity/v3/auth/tokens => generated 3345 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:46.084180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efece1eb-567a-4cdc-8979-72f68e8f85d3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:46.095068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efece1eb-567a-4cdc-8979-72f68e8f85d3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:46.098727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e29f1dd-598d-4342-8ee0-062302af522a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:46.099296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29f1dd-598d-4342-8ee0-062302af522a service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:46.099571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29f1dd-598d-4342-8ee0-062302af522a service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:46.099841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e29f1dd-598d-4342-8ee0-062302af522a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:46.145729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:46.162475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29f1dd-598d-4342-8ee0-062302af522a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:46.164587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e29f1dd-598d-4342-8ee0-062302af522a service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:46.173445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1050/2096] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:46 2022] GET /identity/v3/auth/tokens => generated 3278 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:47.087945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213b51e-56dd-4ed1-807b-05ecb553c94d service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:47.089581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3213b51e-56dd-4ed1-807b-05ecb553c94d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:47.153627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3213b51e-56dd-4ed1-807b-05ecb553c94d service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:47.158175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:47.158804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:47.159085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:47.159360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] PATH_INFO: `/v3/users/5498dfb2386b41048b3bf532c61f1369` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:47.160517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5498dfb2386b41048b3bf532c61f1369)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:47.162438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:47.209137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5498dfb2386b41048b3bf532c61f1369'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:47.209810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5498dfb2386b41048b3bf532c61f1369'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:47.221919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5498dfb2386b41048b3bf532c61f1369'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:47.222569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5498dfb2386b41048b3bf532c61f1369'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:47.229907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5498dfb2386b41048b3bf532c61f1369'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:47.242827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1047/2097] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:47 2022] DELETE /identity/v3/users/5498dfb2386b41048b3bf532c61f1369 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:47.247225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39693-9ee3-4f97-94e7-c04679cff0f9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:47.247705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39693-9ee3-4f97-94e7-c04679cff0f9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:47.247797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d39693-9ee3-4f97-94e7-c04679cff0f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:47.269389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d8d39693-9ee3-4f97-94e7-c04679cff0f9 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:47.270586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d8d39693-9ee3-4f97-94e7-c04679cff0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:47.330083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1051/2098] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:47.340661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:47.342115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:47.361850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:47.402583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328515ad-a7a3-43a7-aa57-93964f280317 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:47.406351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161128-9122-45b0-98a8-b0861f994572 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:47.406961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161128-9122-45b0-98a8-b0861f994572 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:47.407235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161128-9122-45b0-98a8-b0861f994572 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:47.407507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78161128-9122-45b0-98a8-b0861f994572 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:47.416915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161128-9122-45b0-98a8-b0861f994572 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:47.418348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78161128-9122-45b0-98a8-b0861f994572 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:47.427692 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1048/2099] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:47.750083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39693-9ee3-4f97-94e7-c04679cff0f9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:47.751555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d8d39693-9ee3-4f97-94e7-c04679cff0f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:47.765948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d39693-9ee3-4f97-94e7-c04679cff0f9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:47.774027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:47.775778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:47.776274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:47.776557 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] PATH_INFO: `/v3/projects/c6faf1bbb894410fbc4a8ac06f92f676` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:47.793511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6faf1bbb894410fbc4a8ac06f92f676)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:47.799682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:47.896574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6faf1bbb894410fbc4a8ac06f92f676', 'request_id': 'req-fd1ba310-ee60-4490-9acc-14523e545443'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:47.903960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6faf1bbb894410fbc4a8ac06f92f676', 'request_id': 'req-fd1ba310-ee60-4490-9acc-14523e545443'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:47.932504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6faf1bbb894410fbc4a8ac06f92f676', 'request_id': 'req-fd1ba310-ee60-4490-9acc-14523e545443'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:47.953701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] The token cache is being invalidate because project c6faf1bbb894410fbc4a8ac06f92f676 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:47.953916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:47.954532 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:47.956508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1052/2100] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:47 2022] DELETE /identity/v3/projects/c6faf1bbb894410fbc4a8ac06f92f676 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:47.960931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161128-9122-45b0-98a8-b0861f994572 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:47.973263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78161128-9122-45b0-98a8-b0861f994572 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:48.057907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:48.058706 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:48.058979 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:48.059411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] PATH_INFO: `/v3/users/1dbff09426e94eb3b2c040fd5aa09ad2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:48.060727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dbff09426e94eb3b2c040fd5aa09ad2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:48.062829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:48.119576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dbff09426e94eb3b2c040fd5aa09ad2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:48.120263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dbff09426e94eb3b2c040fd5aa09ad2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:48.133436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dbff09426e94eb3b2c040fd5aa09ad2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:48.134422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dbff09426e94eb3b2c040fd5aa09ad2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:48.144774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15b6175f-441e-4933-8853-c13455c3636d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dbff09426e94eb3b2c040fd5aa09ad2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:48.160753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1049/2101] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:47 2022] DELETE /identity/v3/users/1dbff09426e94eb3b2c040fd5aa09ad2 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:48.448956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:48.450420 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:48.464346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1ba310-ee60-4490-9acc-14523e545443 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:48.525547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:48.526191 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:48.526476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:48.526750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] PATH_INFO: `/v3/projects/03cff3536f1948cc826ca271b15e14ea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:48.527879 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03cff3536f1948cc826ca271b15e14ea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:48.529927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:48.539287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:48.577672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03cff3536f1948cc826ca271b15e14ea', 'request_id': 'req-2a79afdb-d2de-465f-b1d2-62b574ac3320'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:48.583755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03cff3536f1948cc826ca271b15e14ea', 'request_id': 'req-2a79afdb-d2de-465f-b1d2-62b574ac3320'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:48.590291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03cff3536f1948cc826ca271b15e14ea', 'request_id': 'req-2a79afdb-d2de-465f-b1d2-62b574ac3320'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:48.604736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] The token cache is being invalidate because project 03cff3536f1948cc826ca271b15e14ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:48.605027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:48.605651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2a79afdb-d2de-465f-b1d2-62b574ac3320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:48.607174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1053/2102] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:48 2022] DELETE /identity/v3/projects/03cff3536f1948cc826ca271b15e14ea => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:48.613131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d22b9-1ed9-4fe1-bcca-63836b58db42 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:48.613420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d22b9-1ed9-4fe1-bcca-63836b58db42 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:48.613719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-244d22b9-1ed9-4fe1-bcca-63836b58db42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:48.633840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-244d22b9-1ed9-4fe1-bcca-63836b58db42 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:48.635059 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-244d22b9-1ed9-4fe1-bcca-63836b58db42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:48.669070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:48.696887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1050/2103] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:48.705060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c2e20-6a99-4af5-8125-1313a379783f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:48.705346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c2e20-6a99-4af5-8125-1313a379783f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:48.705625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-356c2e20-6a99-4af5-8125-1313a379783f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:48.725991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-356c2e20-6a99-4af5-8125-1313a379783f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:48.727216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-356c2e20-6a99-4af5-8125-1313a379783f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:48.735214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1054/2104] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:48.739627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d22b9-1ed9-4fe1-bcca-63836b58db42 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:48.749487 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-244d22b9-1ed9-4fe1-bcca-63836b58db42 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:48.754340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277666-d23f-4d34-a388-bb4f20ee9db6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:48.754942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277666-d23f-4d34-a388-bb4f20ee9db6 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:48.755218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277666-d23f-4d34-a388-bb4f20ee9db6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:48.755485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23277666-d23f-4d34-a388-bb4f20ee9db6 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:48.756128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23277666-d23f-4d34-a388-bb4f20ee9db6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:48.757023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23277666-d23f-4d34-a388-bb4f20ee9db6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:48.758626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23277666-d23f-4d34-a388-bb4f20ee9db6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:48.770909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1051/2105] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:27:48.775852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c2e20-6a99-4af5-8125-1313a379783f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:48.785234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-356c2e20-6a99-4af5-8125-1313a379783f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:48.789850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684cc39-a509-4590-9408-f32d44112666 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:48.790442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684cc39-a509-4590-9408-f32d44112666 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:48.790727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684cc39-a509-4590-9408-f32d44112666 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:48.790999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2684cc39-a509-4590-9408-f32d44112666 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:48.791624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684cc39-a509-4590-9408-f32d44112666 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:48.793530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2684cc39-a509-4590-9408-f32d44112666 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:48.821029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1055/2106] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:48 2022] POST /identity/v3/projects => generated 369 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:48.825285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277666-d23f-4d34-a388-bb4f20ee9db6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:48.836051 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23277666-d23f-4d34-a388-bb4f20ee9db6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:48.889763 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78656c33-343d-4390-9092-37074d116fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:48.890378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78656c33-343d-4390-9092-37074d116fa5 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:48.890652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78656c33-343d-4390-9092-37074d116fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:48.890919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78656c33-343d-4390-9092-37074d116fa5 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:48.891537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78656c33-343d-4390-9092-37074d116fa5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:48.893459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78656c33-343d-4390-9092-37074d116fa5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:48.918864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1052/2107] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:48 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:48.921904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684cc39-a509-4590-9408-f32d44112666 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:48.932653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2684cc39-a509-4590-9408-f32d44112666 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:48.937372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594b0b2-eb22-4675-bf45-cc2c2f66afae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:48.937979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594b0b2-eb22-4675-bf45-cc2c2f66afae admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:48.938262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594b0b2-eb22-4675-bf45-cc2c2f66afae admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:48.938537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b594b0b2-eb22-4675-bf45-cc2c2f66afae admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:48.939187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594b0b2-eb22-4675-bf45-cc2c2f66afae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:48.940804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b594b0b2-eb22-4675-bf45-cc2c2f66afae admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:48.951626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1056/2108] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:48.955791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78656c33-343d-4390-9092-37074d116fa5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:48.966700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78656c33-343d-4390-9092-37074d116fa5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:48.971303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fba73e7f-14d3-4cfa-862f-671feaf4b931 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:48.971895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73e7f-14d3-4cfa-862f-671feaf4b931 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:48.972191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73e7f-14d3-4cfa-862f-671feaf4b931 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:48.972469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fba73e7f-14d3-4cfa-862f-671feaf4b931 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:48.973101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba73e7f-14d3-4cfa-862f-671feaf4b931 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:48.974758 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fba73e7f-14d3-4cfa-862f-671feaf4b931 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:48.985457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1053/2109] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:48.989708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594b0b2-eb22-4675-bf45-cc2c2f66afae admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:49.002524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b594b0b2-eb22-4675-bf45-cc2c2f66afae admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:49.009091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be78b74-d9a2-425e-a571-e897decfa19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:49.009766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be78b74-d9a2-425e-a571-e897decfa19a admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:49.010208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be78b74-d9a2-425e-a571-e897decfa19a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:49.010493 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be78b74-d9a2-425e-a571-e897decfa19a admin admin] PATH_INFO: `/v3/projects/19b2dd53803e400583d8a877a3f58806/users/fa9969513e1542a0a6830dc2b3f81a62/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:49.026375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be78b74-d9a2-425e-a571-e897decfa19a admin admin] RBAC: Authorizing `identity:create_grant(project_id=19b2dd53803e400583d8a877a3f58806, user_id=fa9969513e1542a0a6830dc2b3f81a62, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:49.029080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be78b74-d9a2-425e-a571-e897decfa19a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:49.043167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1057/2110] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:48 2022] PUT /identity/v3/projects/19b2dd53803e400583d8a877a3f58806/users/fa9969513e1542a0a6830dc2b3f81a62/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:49.055363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba1f1d-48ea-4620-90ee-d0aab88f6388 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:49.055657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba1f1d-48ea-4620-90ee-d0aab88f6388 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:49.055927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba1f1d-48ea-4620-90ee-d0aab88f6388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:49.087932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f5ba1f1d-48ea-4620-90ee-d0aab88f6388 None None] MFA Rules not processed for user `fa9969513e1542a0a6830dc2b3f81a62`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:49.089312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5ba1f1d-48ea-4620-90ee-d0aab88f6388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:49.163415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1054/2111] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:49 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:49.181937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be78b74-d9a2-425e-a571-e897decfa19a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:49.183869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1be78b74-d9a2-425e-a571-e897decfa19a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:49.282112 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be78b74-d9a2-425e-a571-e897decfa19a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:49.285848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96366b49-b676-4b21-98e9-82b2dd2fdc9e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ece8645e0954e1d81837cdcaa2ef1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:49.286459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96366b49-b676-4b21-98e9-82b2dd2fdc9e service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:49.286736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96366b49-b676-4b21-98e9-82b2dd2fdc9e service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:49.287129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96366b49-b676-4b21-98e9-82b2dd2fdc9e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:49.303869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96366b49-b676-4b21-98e9-82b2dd2fdc9e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:49.305962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96366b49-b676-4b21-98e9-82b2dd2fdc9e service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:49.316217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1058/2112] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:49 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:50.520804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba1f1d-48ea-4620-90ee-d0aab88f6388 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:50.522335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f5ba1f1d-48ea-4620-90ee-d0aab88f6388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:50.570539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:50.597926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba1f1d-48ea-4620-90ee-d0aab88f6388 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:50.602516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:50.603145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:50.603422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:50.603696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] PATH_INFO: `/v3/users/00a2b32514004813a1acc5afe005a714` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:50.604846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] RBAC: Authorizing `identity:delete_user(user_id=00a2b32514004813a1acc5afe005a714)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:50.606764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:50.654285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '00a2b32514004813a1acc5afe005a714'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:50.654935 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '00a2b32514004813a1acc5afe005a714'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:50.666985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '00a2b32514004813a1acc5afe005a714'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:50.667625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '00a2b32514004813a1acc5afe005a714'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:50.675401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '00a2b32514004813a1acc5afe005a714'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:50.690737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1055/2113] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:50 2022] DELETE /identity/v3/users/00a2b32514004813a1acc5afe005a714 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:50.695971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c87f-44e7-49e7-96bc-39b80014d491 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:50.696498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c87f-44e7-49e7-96bc-39b80014d491 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:50.696592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99c87f-44e7-49e7-96bc-39b80014d491 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:50.715709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bf99c87f-44e7-49e7-96bc-39b80014d491 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:50.716939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bf99c87f-44e7-49e7-96bc-39b80014d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:50.726297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:50.783339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1059/2114] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:50.793049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:50.794448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:50.868675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e16e5c7-db02-43c4-a5ae-910d0f1c080f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:50.872627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2e0f0-37a6-43f1-ab3c-c2584d7a5dc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:50.873226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e0f0-37a6-43f1-ab3c-c2584d7a5dc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:50.873505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e0f0-37a6-43f1-ab3c-c2584d7a5dc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:50.873775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e2e0f0-37a6-43f1-ab3c-c2584d7a5dc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:50.883458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2e0f0-37a6-43f1-ab3c-c2584d7a5dc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:50.885346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e2e0f0-37a6-43f1-ab3c-c2584d7a5dc6 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:50.897103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1056/2115] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:51.170934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c87f-44e7-49e7-96bc-39b80014d491 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:51.172424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bf99c87f-44e7-49e7-96bc-39b80014d491 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:51.192110 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99c87f-44e7-49e7-96bc-39b80014d491 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:51.198909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:51.199562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:51.200181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:51.200584 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] PATH_INFO: `/v3/projects/c6b3b1b752e94d81a98bf3a1dd5b4f90` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:51.202208 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6b3b1b752e94d81a98bf3a1dd5b4f90)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:51.204934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:51.257022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6b3b1b752e94d81a98bf3a1dd5b4f90', 'request_id': 'req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:51.265472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6b3b1b752e94d81a98bf3a1dd5b4f90', 'request_id': 'req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:51.271044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6b3b1b752e94d81a98bf3a1dd5b4f90', 'request_id': 'req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:51.292232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] The token cache is being invalidate because project c6b3b1b752e94d81a98bf3a1dd5b4f90 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:51.292528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:51.293206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:51.294718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1060/2116] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:51 2022] DELETE /identity/v3/projects/c6b3b1b752e94d81a98bf3a1dd5b4f90 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:51.298998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2e0f0-37a6-43f1-ab3c-c2584d7a5dc6 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:51.310749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e2e0f0-37a6-43f1-ab3c-c2584d7a5dc6 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:51.368356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:51.375011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:51.376001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:51.376496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:51.376814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] PATH_INFO: `/v3/users/be47e99b8be7466ab43df57dc69488e3` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:51.378073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] RBAC: Authorizing `identity:delete_user(user_id=be47e99b8be7466ab43df57dc69488e3)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:51.380347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:51.441903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'be47e99b8be7466ab43df57dc69488e3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:51.442686 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'be47e99b8be7466ab43df57dc69488e3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:51.464351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'be47e99b8be7466ab43df57dc69488e3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:51.464351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'be47e99b8be7466ab43df57dc69488e3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:51.465602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-032c9f0b-a24e-484a-bdd3-6d6f2c293a82 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'be47e99b8be7466ab43df57dc69488e3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:51.488110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1057/2117] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:51 2022] DELETE /identity/v3/users/be47e99b8be7466ab43df57dc69488e3 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:51.823242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:51.825405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:51.858274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7fb39a-30f6-4e9a-b6ef-45d3e834485a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:51.940985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:51.941644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:51.941923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:51.942198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] PATH_INFO: `/v3/projects/8dbfe23c8aec4e038c789c6427d0740e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:51.943337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=8dbfe23c8aec4e038c789c6427d0740e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:51.945861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:51.987350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:51.996005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8dbfe23c8aec4e038c789c6427d0740e', 'request_id': 'req-c0626348-e846-4570-905f-276a0423d3bd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:52.002285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8dbfe23c8aec4e038c789c6427d0740e', 'request_id': 'req-c0626348-e846-4570-905f-276a0423d3bd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:52.008754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8dbfe23c8aec4e038c789c6427d0740e', 'request_id': 'req-c0626348-e846-4570-905f-276a0423d3bd'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:52.021219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] The token cache is being invalidate because project 8dbfe23c8aec4e038c789c6427d0740e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:52.021507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:52.022148 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c0626348-e846-4570-905f-276a0423d3bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:52.023656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1061/2118] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:51 2022] DELETE /identity/v3/projects/8dbfe23c8aec4e038c789c6427d0740e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:52.028870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557210-5630-477b-a537-845b911ab548 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.029321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557210-5630-477b-a537-845b911ab548 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.029412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53557210-5630-477b-a537-845b911ab548 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.050275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-53557210-5630-477b-a537-845b911ab548 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:52.051499 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-53557210-5630-477b-a537-845b911ab548 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:52.111760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1058/2119] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:52.120023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d672c-4f19-4028-95b4-63b8cbd00d3e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.120344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d672c-4f19-4028-95b4-63b8cbd00d3e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.120632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976d672c-4f19-4028-95b4-63b8cbd00d3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.140982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-976d672c-4f19-4028-95b4-63b8cbd00d3e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:52.142258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-976d672c-4f19-4028-95b4-63b8cbd00d3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:52.150588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1062/2120] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:52.154872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53557210-5630-477b-a537-845b911ab548 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.165133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53557210-5630-477b-a537-845b911ab548 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.169944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147552-0843-4c50-8f26-dc9682f95add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.170559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147552-0843-4c50-8f26-dc9682f95add admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.170834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147552-0843-4c50-8f26-dc9682f95add admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.171134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2147552-0843-4c50-8f26-dc9682f95add admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.171803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147552-0843-4c50-8f26-dc9682f95add admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:52.172107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147552-0843-4c50-8f26-dc9682f95add admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.173770 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2147552-0843-4c50-8f26-dc9682f95add admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:52.186297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1059/2121] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:27:52.190531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d672c-4f19-4028-95b4-63b8cbd00d3e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.201332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976d672c-4f19-4028-95b4-63b8cbd00d3e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.206143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e7679-5bdf-4bc3-80d7-39bae1afc6dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.206729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e7679-5bdf-4bc3-80d7-39bae1afc6dd admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.207003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e7679-5bdf-4bc3-80d7-39bae1afc6dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.207270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5e7679-5bdf-4bc3-80d7-39bae1afc6dd admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.207896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e7679-5bdf-4bc3-80d7-39bae1afc6dd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.209893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5e7679-5bdf-4bc3-80d7-39bae1afc6dd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:52.242621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1063/2122] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:52 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:52.243690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147552-0843-4c50-8f26-dc9682f95add admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.253951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2147552-0843-4c50-8f26-dc9682f95add admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.317355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9e38-8c94-4327-8852-f45be0bb0c64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.317975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9e38-8c94-4327-8852-f45be0bb0c64 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.318265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9e38-8c94-4327-8852-f45be0bb0c64 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.318543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ce9e38-8c94-4327-8852-f45be0bb0c64 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.319983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce9e38-8c94-4327-8852-f45be0bb0c64 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.322221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ce9e38-8c94-4327-8852-f45be0bb0c64 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:52.333031 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:52.345445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1060/2123] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:52 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:52.349537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e7679-5bdf-4bc3-80d7-39bae1afc6dd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.360449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5e7679-5bdf-4bc3-80d7-39bae1afc6dd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.365281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba698-aa44-436e-9d14-0994eb375a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.366447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba698-aa44-436e-9d14-0994eb375a68 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.366732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba698-aa44-436e-9d14-0994eb375a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.367009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b7ba698-aa44-436e-9d14-0994eb375a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.367656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ba698-aa44-436e-9d14-0994eb375a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.369281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b7ba698-aa44-436e-9d14-0994eb375a68 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:52.379995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1064/2124] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:52.384869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9e38-8c94-4327-8852-f45be0bb0c64 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.394806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ce9e38-8c94-4327-8852-f45be0bb0c64 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.399601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376941c4-8572-4ebd-8632-2ad8df7f2aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.400228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376941c4-8572-4ebd-8632-2ad8df7f2aca admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.400548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376941c4-8572-4ebd-8632-2ad8df7f2aca admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.400784 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376941c4-8572-4ebd-8632-2ad8df7f2aca admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.401493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376941c4-8572-4ebd-8632-2ad8df7f2aca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.403092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376941c4-8572-4ebd-8632-2ad8df7f2aca admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:52.414812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1061/2125] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:27:52.419277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba698-aa44-436e-9d14-0994eb375a68 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.430168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b7ba698-aa44-436e-9d14-0994eb375a68 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.435342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192db96-c1e5-44b5-8b16-d9a1afba6982 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.436111 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192db96-c1e5-44b5-8b16-d9a1afba6982 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.436509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192db96-c1e5-44b5-8b16-d9a1afba6982 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.436752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5192db96-c1e5-44b5-8b16-d9a1afba6982 admin admin] PATH_INFO: `/v3/projects/59ace9e43c924c22a45539a15ba6e11e/users/bd3d88058646410fa4f4fa950eb6d9a0/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.451414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192db96-c1e5-44b5-8b16-d9a1afba6982 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59ace9e43c924c22a45539a15ba6e11e, user_id=bd3d88058646410fa4f4fa950eb6d9a0, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.454063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5192db96-c1e5-44b5-8b16-d9a1afba6982 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:52.468222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1065/2126] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:52 2022] PUT /identity/v3/projects/59ace9e43c924c22a45539a15ba6e11e/users/bd3d88058646410fa4f4fa950eb6d9a0/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:27:52.480444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe0c29-3b33-4226-a5a0-906a6469fcfe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.480729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe0c29-3b33-4226-a5a0-906a6469fcfe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.481010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffe0c29-3b33-4226-a5a0-906a6469fcfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.515693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7ffe0c29-3b33-4226-a5a0-906a6469fcfe None None] MFA Rules not processed for user `bd3d88058646410fa4f4fa950eb6d9a0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:52.517204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7ffe0c29-3b33-4226-a5a0-906a6469fcfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:52.592134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1062/2127] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:52.597190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192db96-c1e5-44b5-8b16-d9a1afba6982 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.659154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5192db96-c1e5-44b5-8b16-d9a1afba6982 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.663800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e284e-1d3a-41ee-b1b6-22bb7a299960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.664451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e284e-1d3a-41ee-b1b6-22bb7a299960 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.664762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e284e-1d3a-41ee-b1b6-22bb7a299960 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.665031 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6e284e-1d3a-41ee-b1b6-22bb7a299960 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.665697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e284e-1d3a-41ee-b1b6-22bb7a299960 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.667666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6e284e-1d3a-41ee-b1b6-22bb7a299960 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:52.695527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1066/2128] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:52 2022] POST /identity/v3/projects => generated 381 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:52.699643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe0c29-3b33-4226-a5a0-906a6469fcfe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.711245 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffe0c29-3b33-4226-a5a0-906a6469fcfe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.774009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6785f-33bd-4720-9317-21a869a72953 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.774571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6785f-33bd-4720-9317-21a869a72953 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.774846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6785f-33bd-4720-9317-21a869a72953 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.775115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e6785f-33bd-4720-9317-21a869a72953 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.775762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6785f-33bd-4720-9317-21a869a72953 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.777818 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e6785f-33bd-4720-9317-21a869a72953 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:52.799908 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1063/2129] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:52 2022] POST /identity/v3/users => generated 297 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:52.805161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e284e-1d3a-41ee-b1b6-22bb7a299960 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.818219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6e284e-1d3a-41ee-b1b6-22bb7a299960 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.825402 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b14776-3a1e-4a91-8352-3ebdad566980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.826340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b14776-3a1e-4a91-8352-3ebdad566980 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.826698 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b14776-3a1e-4a91-8352-3ebdad566980 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.827051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b14776-3a1e-4a91-8352-3ebdad566980 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.827778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b14776-3a1e-4a91-8352-3ebdad566980 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.829754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b14776-3a1e-4a91-8352-3ebdad566980 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:52.842207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1067/2130] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:52.846972 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6785f-33bd-4720-9317-21a869a72953 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.858021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e6785f-33bd-4720-9317-21a869a72953 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.864286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e1976-123a-4e79-a409-b9037764e302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.865046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e1976-123a-4e79-a409-b9037764e302 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.866624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e1976-123a-4e79-a409-b9037764e302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.867008 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921e1976-123a-4e79-a409-b9037764e302 admin admin] PATH_INFO: `/v3/projects/a46efd4ead8c4d4fb366b38e790d7a91/users/934091d904634d098f7dcedab86c345e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.889044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e1976-123a-4e79-a409-b9037764e302 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46efd4ead8c4d4fb366b38e790d7a91, user_id=934091d904634d098f7dcedab86c345e, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.892138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921e1976-123a-4e79-a409-b9037764e302 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:52.908511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1064/2131] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:52 2022] PUT /identity/v3/projects/a46efd4ead8c4d4fb366b38e790d7a91/users/934091d904634d098f7dcedab86c345e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:52.916627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b14776-3a1e-4a91-8352-3ebdad566980 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:52.926937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b14776-3a1e-4a91-8352-3ebdad566980 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:52.973790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:52.995932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5209cbe0-bfc5-4fe8-a325-98548d101b0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:52.996592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209cbe0-bfc5-4fe8-a325-98548d101b0f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:52.996861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209cbe0-bfc5-4fe8-a325-98548d101b0f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:52.997133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5209cbe0-bfc5-4fe8-a325-98548d101b0f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:52.997782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209cbe0-bfc5-4fe8-a325-98548d101b0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:52.999377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5209cbe0-bfc5-4fe8-a325-98548d101b0f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:53.009214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1068/2132] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:52 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:53.013505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e1976-123a-4e79-a409-b9037764e302 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:53.024470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921e1976-123a-4e79-a409-b9037764e302 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:53.029407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8190dd-98a2-4d09-8cc9-5e1eefe65d3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:53.030111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8190dd-98a2-4d09-8cc9-5e1eefe65d3a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:53.030425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8190dd-98a2-4d09-8cc9-5e1eefe65d3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:53.030730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f8190dd-98a2-4d09-8cc9-5e1eefe65d3a admin admin] PATH_INFO: `/v3/projects/a46efd4ead8c4d4fb366b38e790d7a91/users/934091d904634d098f7dcedab86c345e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:53.032718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8190dd-98a2-4d09-8cc9-5e1eefe65d3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=a46efd4ead8c4d4fb366b38e790d7a91, user_id=934091d904634d098f7dcedab86c345e, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:53.035449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f8190dd-98a2-4d09-8cc9-5e1eefe65d3a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:53.049194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1065/2133] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:53 2022] PUT /identity/v3/projects/a46efd4ead8c4d4fb366b38e790d7a91/users/934091d904634d098f7dcedab86c345e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:53.059689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf9358-b24b-4462-9263-c820b5907621 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:53.059982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf9358-b24b-4462-9263-c820b5907621 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:53.060301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bf9358-b24b-4462-9263-c820b5907621 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:53.088703 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-42bf9358-b24b-4462-9263-c820b5907621 None None] MFA Rules not processed for user `934091d904634d098f7dcedab86c345e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:53.089919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-42bf9358-b24b-4462-9263-c820b5907621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:53.177402 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1069/2134] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:53 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:53.188095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8190dd-98a2-4d09-8cc9-5e1eefe65d3a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:53.189978 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0f8190dd-98a2-4d09-8cc9-5e1eefe65d3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:53.230387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:53.267580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f8190dd-98a2-4d09-8cc9-5e1eefe65d3a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:53.271587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0587b-8f24-44c3-9313-c6c7b0025669 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:53.272902 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0587b-8f24-44c3-9313-c6c7b0025669 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:53.273175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0587b-8f24-44c3-9313-c6c7b0025669 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:53.273443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d0587b-8f24-44c3-9313-c6c7b0025669 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:53.283419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0587b-8f24-44c3-9313-c6c7b0025669 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:53.285028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d0587b-8f24-44c3-9313-c6c7b0025669 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:53.295066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1066/2135] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:53.346280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf9358-b24b-4462-9263-c820b5907621 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:53.347864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-42bf9358-b24b-4462-9263-c820b5907621 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:53.360273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bf9358-b24b-4462-9263-c820b5907621 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:53.363954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52830667-e24c-45b9-b546-d8202776a4f8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:53.364723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52830667-e24c-45b9-b546-d8202776a4f8 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:53.365004 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52830667-e24c-45b9-b546-d8202776a4f8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:53.365279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52830667-e24c-45b9-b546-d8202776a4f8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:53.367067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-52830667-e24c-45b9-b546-d8202776a4f8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:53.414310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0587b-8f24-44c3-9313-c6c7b0025669 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:53.422823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d0587b-8f24-44c3-9313-c6c7b0025669 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:53.426723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590b428-74f2-4924-bd1d-ba6610c0169d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:53.427318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590b428-74f2-4924-bd1d-ba6610c0169d service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:53.427588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590b428-74f2-4924-bd1d-ba6610c0169d service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:53.427856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590b428-74f2-4924-bd1d-ba6610c0169d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:53.443720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52830667-e24c-45b9-b546-d8202776a4f8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:53.445295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52830667-e24c-45b9-b546-d8202776a4f8 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:53.456595 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1070/2136] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:53 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:53.503031 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590b428-74f2-4924-bd1d-ba6610c0169d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:53.504511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590b428-74f2-4924-bd1d-ba6610c0169d service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:53.514314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1067/2137] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:53 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:56.157442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52830667-e24c-45b9-b546-d8202776a4f8 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:56.217228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:56.223662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52830667-e24c-45b9-b546-d8202776a4f8 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:56.231363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:56.232015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:56.232334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:56.232614 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] PATH_INFO: `/v3/users/bd3d88058646410fa4f4fa950eb6d9a0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:56.233748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bd3d88058646410fa4f4fa950eb6d9a0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:56.235673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:56.283051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bd3d88058646410fa4f4fa950eb6d9a0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:56.283719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bd3d88058646410fa4f4fa950eb6d9a0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:56.284368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bd3d88058646410fa4f4fa950eb6d9a0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:56.292863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bd3d88058646410fa4f4fa950eb6d9a0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:56.305856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bd3d88058646410fa4f4fa950eb6d9a0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:56.320335 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1071/2138] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:56 2022] DELETE /identity/v3/users/bd3d88058646410fa4f4fa950eb6d9a0 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:56.325211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaa174-ad6a-40e4-9a32-9afde1ce83d8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:56.325674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaa174-ad6a-40e4-9a32-9afde1ce83d8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:56.325781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aeaa174-ad6a-40e4-9a32-9afde1ce83d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:56.344867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4aeaa174-ad6a-40e4-9a32-9afde1ce83d8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:56.346136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4aeaa174-ad6a-40e4-9a32-9afde1ce83d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:56.413019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1068/2139] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:56.422940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:56.424214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:56.491119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7b052f-2819-49cd-839f-d6c4f1b11477 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:56.495332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d26a7-2989-4cbe-8934-def0a5273f06 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:56.495952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d26a7-2989-4cbe-8934-def0a5273f06 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:56.496375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d26a7-2989-4cbe-8934-def0a5273f06 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:56.496890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032d26a7-2989-4cbe-8934-def0a5273f06 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:56.506922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d26a7-2989-4cbe-8934-def0a5273f06 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:56.508415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032d26a7-2989-4cbe-8934-def0a5273f06 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:56.518074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1072/2140] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:27:56.958676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaa174-ad6a-40e4-9a32-9afde1ce83d8 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:56.960782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4aeaa174-ad6a-40e4-9a32-9afde1ce83d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:56.978692 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aeaa174-ad6a-40e4-9a32-9afde1ce83d8 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:56.988304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:56.988943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:56.989226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:56.989502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] PATH_INFO: `/v3/projects/59ace9e43c924c22a45539a15ba6e11e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:56.991365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59ace9e43c924c22a45539a15ba6e11e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:56.993557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:57.056976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59ace9e43c924c22a45539a15ba6e11e', 'request_id': 'req-6b46c820-665b-4aff-943f-674abf26fce9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.063579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59ace9e43c924c22a45539a15ba6e11e', 'request_id': 'req-6b46c820-665b-4aff-943f-674abf26fce9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.066204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:57.072433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59ace9e43c924c22a45539a15ba6e11e', 'request_id': 'req-6b46c820-665b-4aff-943f-674abf26fce9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.085608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] The token cache is being invalidate because project 59ace9e43c924c22a45539a15ba6e11e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:57.085901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.086803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.088321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1069/2141] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:56 2022] DELETE /identity/v3/projects/59ace9e43c924c22a45539a15ba6e11e => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:57.092401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d26a7-2989-4cbe-8934-def0a5273f06 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:57.102805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032d26a7-2989-4cbe-8934-def0a5273f06 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:57.160036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:57.160703 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:57.160855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:57.161128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] PATH_INFO: `/v3/users/934091d904634d098f7dcedab86c345e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:57.162252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=934091d904634d098f7dcedab86c345e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:57.164788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:57.196182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:57.237667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '934091d904634d098f7dcedab86c345e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.238746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '934091d904634d098f7dcedab86c345e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.239775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '934091d904634d098f7dcedab86c345e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.247199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '934091d904634d098f7dcedab86c345e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.261027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1bf83d60-9f47-480a-a665-bc8523bd5d1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '934091d904634d098f7dcedab86c345e'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.275136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1073/2142] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:27:57 2022] DELETE /identity/v3/users/934091d904634d098f7dcedab86c345e => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:57.557005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:57.558593 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:57.586004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b46c820-665b-4aff-943f-674abf26fce9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:57.661359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:57.662006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:57.662316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:57.662601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] PATH_INFO: `/v3/projects/a46efd4ead8c4d4fb366b38e790d7a91` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:57.663862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a46efd4ead8c4d4fb366b38e790d7a91)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:57.665967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:57.728382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a46efd4ead8c4d4fb366b38e790d7a91', 'request_id': 'req-5c1d45f4-b633-4074-8839-e07379f2fec5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.734316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a46efd4ead8c4d4fb366b38e790d7a91', 'request_id': 'req-5c1d45f4-b633-4074-8839-e07379f2fec5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.742951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a46efd4ead8c4d4fb366b38e790d7a91', 'request_id': 'req-5c1d45f4-b633-4074-8839-e07379f2fec5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.755760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] The token cache is being invalidate because project a46efd4ead8c4d4fb366b38e790d7a91 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:27:57.756095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.757275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5c1d45f4-b633-4074-8839-e07379f2fec5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:27:57.758860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1070/2143] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:27:57 2022] DELETE /identity/v3/projects/a46efd4ead8c4d4fb366b38e790d7a91 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:57.763652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5f121-fb41-4b4e-99d6-c08164bbe2be None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:57.763939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5f121-fb41-4b4e-99d6-c08164bbe2be None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:57.764243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c5f121-fb41-4b4e-99d6-c08164bbe2be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:57.785725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-86c5f121-fb41-4b4e-99d6-c08164bbe2be None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:57.787441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-86c5f121-fb41-4b4e-99d6-c08164bbe2be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:57.864807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1074/2144] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:27:57.876112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d94b64-be42-413f-853e-3b52bd0c74ae None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:57.876112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d94b64-be42-413f-853e-3b52bd0c74ae None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:57.876112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d94b64-be42-413f-853e-3b52bd0c74ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:57.898170 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e9d94b64-be42-413f-853e-3b52bd0c74ae None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:57.899575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e9d94b64-be42-413f-853e-3b52bd0c74ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:57.908318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1071/2145] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:57.913114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5f121-fb41-4b4e-99d6-c08164bbe2be None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:57.924937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c5f121-fb41-4b4e-99d6-c08164bbe2be None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:57.940519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab58f0-d15c-4a82-86c3-280b9d61a797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:57.941167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab58f0-d15c-4a82-86c3-280b9d61a797 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:57.941505 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab58f0-d15c-4a82-86c3-280b9d61a797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:57.941853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ab58f0-d15c-4a82-86c3-280b9d61a797 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:57.942529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab58f0-d15c-4a82-86c3-280b9d61a797 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:27:57.942839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab58f0-d15c-4a82-86c3-280b9d61a797 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:57.945203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ab58f0-d15c-4a82-86c3-280b9d61a797 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:57.958039 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1075/2146] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:27:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:27:57.962564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d94b64-be42-413f-853e-3b52bd0c74ae None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:57.972700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d94b64-be42-413f-853e-3b52bd0c74ae None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:57.977889 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea70d6-7766-4f77-8954-4bb276a265b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:57.978741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea70d6-7766-4f77-8954-4bb276a265b9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:57.978741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea70d6-7766-4f77-8954-4bb276a265b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:57.979021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ea70d6-7766-4f77-8954-4bb276a265b9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:57.979659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea70d6-7766-4f77-8954-4bb276a265b9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:57.981595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ea70d6-7766-4f77-8954-4bb276a265b9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:58.018263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1072/2147] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:27:57 2022] POST /identity/v3/projects => generated 375 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:27:58.022976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab58f0-d15c-4a82-86c3-280b9d61a797 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:58.035402 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ab58f0-d15c-4a82-86c3-280b9d61a797 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:58.099010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff302af-14cf-4999-a23a-73e9a1bf30cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:58.099010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff302af-14cf-4999-a23a-73e9a1bf30cb admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:58.099010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff302af-14cf-4999-a23a-73e9a1bf30cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:58.100712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff302af-14cf-4999-a23a-73e9a1bf30cb admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:58.101404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff302af-14cf-4999-a23a-73e9a1bf30cb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:58.103319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff302af-14cf-4999-a23a-73e9a1bf30cb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:58.130920 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1076/2148] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:27:58 2022] POST /identity/v3/users => generated 288 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:27:58.132661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea70d6-7766-4f77-8954-4bb276a265b9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:58.143953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ea70d6-7766-4f77-8954-4bb276a265b9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:58.148985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f9ba8-0e51-4d52-bc70-414915b40c2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:58.149712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9ba8-0e51-4d52-bc70-414915b40c2a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:58.149992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9ba8-0e51-4d52-bc70-414915b40c2a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:58.150265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f9ba8-0e51-4d52-bc70-414915b40c2a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:58.150940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f9ba8-0e51-4d52-bc70-414915b40c2a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:58.152614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f9ba8-0e51-4d52-bc70-414915b40c2a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:58.163159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1073/2149] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:58.167141 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff302af-14cf-4999-a23a-73e9a1bf30cb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:58.177149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff302af-14cf-4999-a23a-73e9a1bf30cb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:58.182399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a422121-cfce-4fc3-a93b-025185304f92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:58.182993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422121-cfce-4fc3-a93b-025185304f92 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:58.183275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422121-cfce-4fc3-a93b-025185304f92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:58.183555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a422121-cfce-4fc3-a93b-025185304f92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:58.184229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422121-cfce-4fc3-a93b-025185304f92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:58.185829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a422121-cfce-4fc3-a93b-025185304f92 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:58.196351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1077/2150] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:27:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:27:58.200357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f9ba8-0e51-4d52-bc70-414915b40c2a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:58.210845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f9ba8-0e51-4d52-bc70-414915b40c2a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:58.215867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3ae0-b7fb-41bb-ac2f-9221450746e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:58.216565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3ae0-b7fb-41bb-ac2f-9221450746e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:58.216844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3ae0-b7fb-41bb-ac2f-9221450746e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:58.217118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfd3ae0-b7fb-41bb-ac2f-9221450746e7 admin admin] PATH_INFO: `/v3/projects/9b4966aca4af48ba9bac263f69779abb/users/43aa2b1795eb475794c5c8e470b68a53/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:58.237548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd3ae0-b7fb-41bb-ac2f-9221450746e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b4966aca4af48ba9bac263f69779abb, user_id=43aa2b1795eb475794c5c8e470b68a53, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:58.240251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfd3ae0-b7fb-41bb-ac2f-9221450746e7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:58.254740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1074/2151] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:27:58 2022] PUT /identity/v3/projects/9b4966aca4af48ba9bac263f69779abb/users/43aa2b1795eb475794c5c8e470b68a53/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:27:58.266069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd86b6-4cc5-4ccb-8fb2-3a1791927d98 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:58.266412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd86b6-4cc5-4ccb-8fb2-3a1791927d98 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:58.266730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93bd86b6-4cc5-4ccb-8fb2-3a1791927d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:58.274262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:58.303646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-93bd86b6-4cc5-4ccb-8fb2-3a1791927d98 None None] MFA Rules not processed for user `43aa2b1795eb475794c5c8e470b68a53`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:27:58.303646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-93bd86b6-4cc5-4ccb-8fb2-3a1791927d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:58.368171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1078/2152] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:27:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:27:58.379670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3ae0-b7fb-41bb-ac2f-9221450746e7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:27:58.381404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cbfd3ae0-b7fb-41bb-ac2f-9221450746e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:27:58.400479 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=8,keystone:SELECT=89,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:27:58.450708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfd3ae0-b7fb-41bb-ac2f-9221450746e7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:27:58.454392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de82ad36-6866-4f21-8602-02ac980a5a84 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ece8645e0954e1d81837cdcaa2ef1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:27:58.455016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82ad36-6866-4f21-8602-02ac980a5a84 service glance] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:27:58.455294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82ad36-6866-4f21-8602-02ac980a5a84 service glance] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:27:58.455567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de82ad36-6866-4f21-8602-02ac980a5a84 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:27:58.466306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82ad36-6866-4f21-8602-02ac980a5a84 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:27:58.467813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de82ad36-6866-4f21-8602-02ac980a5a84 service glance] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:27:58.477838 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1075/2153] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:27:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:28:08.364603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=31 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:08.473067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=19 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:15.568793 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6d265-65e0-4c2f-b3b3-919ea9ee0acf None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:15.569703 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6d265-65e0-4c2f-b3b3-919ea9ee0acf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:15.570500 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6d265-65e0-4c2f-b3b3-919ea9ee0acf None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:15.572101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1079/2154] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:28:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:28:15.581422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d7ac3-d281-4d38-9c63-1e4069def6e6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:15.582198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d7ac3-d281-4d38-9c63-1e4069def6e6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:15.582198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-513d7ac3-d281-4d38-9c63-1e4069def6e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:15.605826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-513d7ac3-d281-4d38-9c63-1e4069def6e6 None None] MFA Rules not processed for user `2bc00e6583d7424cbdc13732a962fc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:15.607132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-513d7ac3-d281-4d38-9c63-1e4069def6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:15.687394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1076/2155] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:28:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:28:15.720136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6d265-65e0-4c2f-b3b3-919ea9ee0acf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:15.722415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-74f6d265-65e0-4c2f-b3b3-919ea9ee0acf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:15.749681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6d265-65e0-4c2f-b3b3-919ea9ee0acf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:15.756935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec02f-185e-45ce-a2ce-2f6cd20bf538 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc00e6583d7424cbdc13732a962fc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:15.757559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec02f-185e-45ce-a2ce-2f6cd20bf538 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:15.757846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec02f-185e-45ce-a2ce-2f6cd20bf538 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:15.758137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4ec02f-185e-45ce-a2ce-2f6cd20bf538 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:15.767582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ec02f-185e-45ce-a2ce-2f6cd20bf538 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:15.769376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4ec02f-185e-45ce-a2ce-2f6cd20bf538 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:15.781476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1080/2156] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:28:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:28:16.359791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d7ac3-d281-4d38-9c63-1e4069def6e6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:16.361349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-513d7ac3-d281-4d38-9c63-1e4069def6e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:16.427519 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-513d7ac3-d281-4d38-9c63-1e4069def6e6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:16.431993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:16.432655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:16.432933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:16.433203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] PATH_INFO: `/v3/users/9331882ea6fc4c6dad3c7811beae7a86` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:16.434318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9331882ea6fc4c6dad3c7811beae7a86)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:16.436267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:16.484794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9331882ea6fc4c6dad3c7811beae7a86'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:16.485536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9331882ea6fc4c6dad3c7811beae7a86'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:16.497846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9331882ea6fc4c6dad3c7811beae7a86'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:16.498474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9331882ea6fc4c6dad3c7811beae7a86'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:16.505814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9331882ea6fc4c6dad3c7811beae7a86'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:16.518675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1077/2157] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:28:16 2022] DELETE /identity/v3/users/9331882ea6fc4c6dad3c7811beae7a86 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:16.805980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec02f-185e-45ce-a2ce-2f6cd20bf538 service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:16.818629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4ec02f-185e-45ce-a2ce-2f6cd20bf538 service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:16.887284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:16.887876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:16.888180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:16.888463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] PATH_INFO: `/v3/projects/02107e8e8017499db0458dc9d71b0198` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:16.889608 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02107e8e8017499db0458dc9d71b0198)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:16.891583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:16.943466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02107e8e8017499db0458dc9d71b0198', 'request_id': 'req-97c872e6-45bb-44a3-a425-d4252a3c4b84'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:16.952309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02107e8e8017499db0458dc9d71b0198', 'request_id': 'req-97c872e6-45bb-44a3-a425-d4252a3c4b84'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:16.959401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02107e8e8017499db0458dc9d71b0198', 'request_id': 'req-97c872e6-45bb-44a3-a425-d4252a3c4b84'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:16.979764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] The token cache is being invalidate because project 02107e8e8017499db0458dc9d71b0198 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:28:16.980064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:16.982262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:16.983838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1081/2158] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:28:16 2022] DELETE /identity/v3/projects/02107e8e8017499db0458dc9d71b0198 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:16.996371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:16.996371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:17.010801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577456e4-e5e6-41fe-a1c6-d3fc2e7dda37 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:17.030024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:17.090963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:17.091722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:17.092051 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:17.092410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] PATH_INFO: `/v3/users/1a9dd749ca78473a8f5fc375015adced` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:17.093621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a9dd749ca78473a8f5fc375015adced)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:17.095676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:17.141320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a9dd749ca78473a8f5fc375015adced'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:17.141920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a9dd749ca78473a8f5fc375015adced'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:17.154066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a9dd749ca78473a8f5fc375015adced'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:17.154689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a9dd749ca78473a8f5fc375015adced'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:17.161517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c0672134-5a29-438b-a121-37715359dcc8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a9dd749ca78473a8f5fc375015adced'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:17.174086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1078/2159] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:28:16 2022] DELETE /identity/v3/users/1a9dd749ca78473a8f5fc375015adced => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:28:17.355429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:17.356925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:17.370389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c872e6-45bb-44a3-a425-d4252a3c4b84 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:17.434496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:17.435383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:17.435745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:17.436048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] PATH_INFO: `/v3/projects/096034c1e227474e85a5ad03bc807df0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:17.437453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=096034c1e227474e85a5ad03bc807df0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:17.439662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:17.468587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:17.499755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '096034c1e227474e85a5ad03bc807df0', 'request_id': 'req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:17.506860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '096034c1e227474e85a5ad03bc807df0', 'request_id': 'req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:17.512634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '096034c1e227474e85a5ad03bc807df0', 'request_id': 'req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:17.526564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] The token cache is being invalidate because project 096034c1e227474e85a5ad03bc807df0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:28:17.526871 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:17.528327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1ab4ebb7-2883-4381-a14f-9cc62bf99f98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:17.530089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1082/2160] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:28:17 2022] DELETE /identity/v3/projects/096034c1e227474e85a5ad03bc807df0 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:17.535218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c5f3-560d-4da7-88fd-88cce8802a62 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:17.535509 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c5f3-560d-4da7-88fd-88cce8802a62 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:17.535786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd1c5f3-560d-4da7-88fd-88cce8802a62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:17.561560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0cd1c5f3-560d-4da7-88fd-88cce8802a62 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:17.561560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0cd1c5f3-560d-4da7-88fd-88cce8802a62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:17.626305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1079/2161] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:17.635270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bce43-eaee-4bda-9f05-92d7a9d9138b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:17.635605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bce43-eaee-4bda-9f05-92d7a9d9138b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:17.635845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575bce43-eaee-4bda-9f05-92d7a9d9138b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:17.657748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-575bce43-eaee-4bda-9f05-92d7a9d9138b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:17.658956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-575bce43-eaee-4bda-9f05-92d7a9d9138b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:17.668592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1083/2162] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:17.673531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c5f3-560d-4da7-88fd-88cce8802a62 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:17.685809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd1c5f3-560d-4da7-88fd-88cce8802a62 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:17.690337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa8634-0e4d-42e7-b537-6e44bc055436 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:17.690944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa8634-0e4d-42e7-b537-6e44bc055436 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:17.691220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa8634-0e4d-42e7-b537-6e44bc055436 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:17.691491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aa8634-0e4d-42e7-b537-6e44bc055436 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:17.692184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa8634-0e4d-42e7-b537-6e44bc055436 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:28:17.693023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa8634-0e4d-42e7-b537-6e44bc055436 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:17.694634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aa8634-0e4d-42e7-b537-6e44bc055436 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:17.706311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1080/2163] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:28:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:28:17.711671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bce43-eaee-4bda-9f05-92d7a9d9138b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:17.720936 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575bce43-eaee-4bda-9f05-92d7a9d9138b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:17.726225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0793-da40-4a25-be3a-d8c4adae5e99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:17.726907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0793-da40-4a25-be3a-d8c4adae5e99 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:17.727182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0793-da40-4a25-be3a-d8c4adae5e99 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:17.727453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840e0793-da40-4a25-be3a-d8c4adae5e99 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:17.728090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e0793-da40-4a25-be3a-d8c4adae5e99 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:17.730103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-840e0793-da40-4a25-be3a-d8c4adae5e99 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:17.758850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1084/2164] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:28:17 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:28:17.762840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa8634-0e4d-42e7-b537-6e44bc055436 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:17.773458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aa8634-0e4d-42e7-b537-6e44bc055436 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:17.801877 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:17.843481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12ef54-f28f-47b6-b444-25d33d80ae39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:17.844085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12ef54-f28f-47b6-b444-25d33d80ae39 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:17.844390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12ef54-f28f-47b6-b444-25d33d80ae39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:17.844659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b12ef54-f28f-47b6-b444-25d33d80ae39 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:17.845291 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12ef54-f28f-47b6-b444-25d33d80ae39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:17.847321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b12ef54-f28f-47b6-b444-25d33d80ae39 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:17.869979 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1081/2165] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:28:17 2022] POST /identity/v3/users => generated 292 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:28:17.874188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0793-da40-4a25-be3a-d8c4adae5e99 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:17.885502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-840e0793-da40-4a25-be3a-d8c4adae5e99 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:17.890343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82878ea7-645e-49a5-b206-09a4758bc53a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:17.890825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82878ea7-645e-49a5-b206-09a4758bc53a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:17.891107 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82878ea7-645e-49a5-b206-09a4758bc53a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:17.891383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82878ea7-645e-49a5-b206-09a4758bc53a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:17.892058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82878ea7-645e-49a5-b206-09a4758bc53a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:17.893729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82878ea7-645e-49a5-b206-09a4758bc53a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:17.904096 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1085/2166] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:28:17.908333 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12ef54-f28f-47b6-b444-25d33d80ae39 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:17.919024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b12ef54-f28f-47b6-b444-25d33d80ae39 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:17.924997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa0dff1-bdc0-4edb-8246-1cf3e3cdecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:17.925976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0dff1-bdc0-4edb-8246-1cf3e3cdecc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:17.926266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0dff1-bdc0-4edb-8246-1cf3e3cdecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:17.926607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa0dff1-bdc0-4edb-8246-1cf3e3cdecc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:17.927835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0dff1-bdc0-4edb-8246-1cf3e3cdecc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:17.929516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa0dff1-bdc0-4edb-8246-1cf3e3cdecc1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:17.941309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1082/2167] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:28:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:28:17.945445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82878ea7-645e-49a5-b206-09a4758bc53a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:17.955831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82878ea7-645e-49a5-b206-09a4758bc53a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:17.961295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340ff86-23fd-4211-8eac-fb2cd2317e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:17.961974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340ff86-23fd-4211-8eac-fb2cd2317e5d admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:17.962255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340ff86-23fd-4211-8eac-fb2cd2317e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:17.962534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7340ff86-23fd-4211-8eac-fb2cd2317e5d admin admin] PATH_INFO: `/v3/projects/1e006a6b87f441ffa05c9e476ddae2dc/users/e09a0c13103045d0af13276688c78b7b/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:17.978237 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340ff86-23fd-4211-8eac-fb2cd2317e5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e006a6b87f441ffa05c9e476ddae2dc, user_id=e09a0c13103045d0af13276688c78b7b, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:17.981019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7340ff86-23fd-4211-8eac-fb2cd2317e5d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:17.994243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1086/2168] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:28:17 2022] PUT /identity/v3/projects/1e006a6b87f441ffa05c9e476ddae2dc/users/e09a0c13103045d0af13276688c78b7b/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:28:18.004456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bcb70-899a-4afc-81de-172058e834ac None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:18.004845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bcb70-899a-4afc-81de-172058e834ac None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:18.005173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28bcb70-899a-4afc-81de-172058e834ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:18.038077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f28bcb70-899a-4afc-81de-172058e834ac None None] MFA Rules not processed for user `e09a0c13103045d0af13276688c78b7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:18.039375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f28bcb70-899a-4afc-81de-172058e834ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:18.109130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1083/2169] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:18.123794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340ff86-23fd-4211-8eac-fb2cd2317e5d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:18.125577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7340ff86-23fd-4211-8eac-fb2cd2317e5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:18.184429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7340ff86-23fd-4211-8eac-fb2cd2317e5d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:18.188130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30192453-159d-4440-bbd2-f4632701a8cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:18.188782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192453-159d-4440-bbd2-f4632701a8cb service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:18.189344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192453-159d-4440-bbd2-f4632701a8cb service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:18.189628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30192453-159d-4440-bbd2-f4632701a8cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:18.199091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30192453-159d-4440-bbd2-f4632701a8cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:18.201017 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30192453-159d-4440-bbd2-f4632701a8cb service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:18.211598 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1087/2170] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:28:18 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:28:20.862727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bcb70-899a-4afc-81de-172058e834ac None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:20.970679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28bcb70-899a-4afc-81de-172058e834ac None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:20.976145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:20.976946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:20.977226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:20.977804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] PATH_INFO: `/v3/users/e09a0c13103045d0af13276688c78b7b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:20.978967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e09a0c13103045d0af13276688c78b7b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:20.981124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:21.019984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:INSERT=3,keystone:DELETE=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:21.037323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e09a0c13103045d0af13276688c78b7b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:21.037989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e09a0c13103045d0af13276688c78b7b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:21.051142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e09a0c13103045d0af13276688c78b7b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:21.051879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e09a0c13103045d0af13276688c78b7b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:21.059467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e09a0c13103045d0af13276688c78b7b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:21.073592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1084/2171] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:28:20 2022] DELETE /identity/v3/users/e09a0c13103045d0af13276688c78b7b => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:21.078198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee14bbb-25ca-42c8-9b61-918b848c098c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:21.078669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee14bbb-25ca-42c8-9b61-918b848c098c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:21.078767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee14bbb-25ca-42c8-9b61-918b848c098c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:21.099647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7ee14bbb-25ca-42c8-9b61-918b848c098c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:21.100898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7ee14bbb-25ca-42c8-9b61-918b848c098c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:21.143811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:21.164228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1088/2172] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:21.174753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:21.176484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:21.211160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49e829-d8af-4ba0-8b93-76718defd8f6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:21.211449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49e829-d8af-4ba0-8b93-76718defd8f6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:21.211728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc49e829-d8af-4ba0-8b93-76718defd8f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:21.251452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bc49e829-d8af-4ba0-8b93-76718defd8f6 None None] MFA Rules not processed for user `5a3a7f87ef4349eb9b21745be3a6b8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:21.252884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bc49e829-d8af-4ba0-8b93-76718defd8f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:21.256569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8f7ed7-410e-4fb1-9ce2-0e65dfaf4125 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:21.260992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9686024-96aa-4a34-a7d0-fff5f08d99ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:21.261657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9686024-96aa-4a34-a7d0-fff5f08d99ff service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:21.261942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9686024-96aa-4a34-a7d0-fff5f08d99ff service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:21.262213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9686024-96aa-4a34-a7d0-fff5f08d99ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:21.271860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9686024-96aa-4a34-a7d0-fff5f08d99ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:21.273330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9686024-96aa-4a34-a7d0-fff5f08d99ff service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:21.282794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1085/2173] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:28:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:28:21.314244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1089/2174] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:28:21.745050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9686024-96aa-4a34-a7d0-fff5f08d99ff service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:21.746529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b9686024-96aa-4a34-a7d0-fff5f08d99ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:21.759601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9686024-96aa-4a34-a7d0-fff5f08d99ff service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:21.764547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:21.765192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:21.765475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:21.765751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] PATH_INFO: `/v3/projects/1e006a6b87f441ffa05c9e476ddae2dc` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:21.766956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e006a6b87f441ffa05c9e476ddae2dc)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:21.768936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:21.833946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e006a6b87f441ffa05c9e476ddae2dc', 'request_id': 'req-01a957b1-0653-471c-9691-1e65843eee9f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:21.840841 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e006a6b87f441ffa05c9e476ddae2dc', 'request_id': 'req-01a957b1-0653-471c-9691-1e65843eee9f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:21.851352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e006a6b87f441ffa05c9e476ddae2dc', 'request_id': 'req-01a957b1-0653-471c-9691-1e65843eee9f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:21.864615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] The token cache is being invalidate because project 1e006a6b87f441ffa05c9e476ddae2dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:28:21.865618 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:21.865618 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-01a957b1-0653-471c-9691-1e65843eee9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:21.867066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1086/2175] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:28:21 2022] DELETE /identity/v3/projects/1e006a6b87f441ffa05c9e476ddae2dc => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:21.873685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16c93a-8142-41f0-bf37-515a15c9a80d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:21.873954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16c93a-8142-41f0-bf37-515a15c9a80d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:21.874231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16c93a-8142-41f0-bf37-515a15c9a80d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:21.896979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6a16c93a-8142-41f0-bf37-515a15c9a80d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:21.898242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6a16c93a-8142-41f0-bf37-515a15c9a80d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:21.980359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1090/2176] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:28:21.987925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfba8a-7425-4510-9829-57ac32fa5077 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:21.989026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfba8a-7425-4510-9829-57ac32fa5077 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:21.989546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23bfba8a-7425-4510-9829-57ac32fa5077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:22.030259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-23bfba8a-7425-4510-9829-57ac32fa5077 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:22.032085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-23bfba8a-7425-4510-9829-57ac32fa5077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:22.054059 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1087/2177] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:22.057918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16c93a-8142-41f0-bf37-515a15c9a80d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:22.069048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16c93a-8142-41f0-bf37-515a15c9a80d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:22.074578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb2cce-664a-4d7b-a30c-45aa43e3375b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:22.075296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb2cce-664a-4d7b-a30c-45aa43e3375b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:22.075647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb2cce-664a-4d7b-a30c-45aa43e3375b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:22.075999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1deb2cce-664a-4d7b-a30c-45aa43e3375b admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:22.076918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb2cce-664a-4d7b-a30c-45aa43e3375b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:28:22.077289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb2cce-664a-4d7b-a30c-45aa43e3375b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:22.079227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1deb2cce-664a-4d7b-a30c-45aa43e3375b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:22.101369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1091/2178] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:28:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:28:22.102720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfba8a-7425-4510-9829-57ac32fa5077 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:22.113859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23bfba8a-7425-4510-9829-57ac32fa5077 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:22.120320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387260d-34f9-45bb-8439-f17f91e0a502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:22.120805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387260d-34f9-45bb-8439-f17f91e0a502 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:22.121262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387260d-34f9-45bb-8439-f17f91e0a502 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:22.121481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387260d-34f9-45bb-8439-f17f91e0a502 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:22.122159 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387260d-34f9-45bb-8439-f17f91e0a502 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:22.124383 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387260d-34f9-45bb-8439-f17f91e0a502 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:22.164759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1088/2179] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:28:22 2022] POST /identity/v3/projects => generated 373 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:28:22.169056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb2cce-664a-4d7b-a30c-45aa43e3375b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:22.181310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1deb2cce-664a-4d7b-a30c-45aa43e3375b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:22.281627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317bc17-909b-4d8c-814a-88ce3d8f15ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:22.282355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317bc17-909b-4d8c-814a-88ce3d8f15ba admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:22.282737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317bc17-909b-4d8c-814a-88ce3d8f15ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:22.284417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f317bc17-909b-4d8c-814a-88ce3d8f15ba admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:22.285443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317bc17-909b-4d8c-814a-88ce3d8f15ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:22.288778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f317bc17-909b-4d8c-814a-88ce3d8f15ba admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:22.323553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1092/2180] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:28:22 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:28:22.327491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387260d-34f9-45bb-8439-f17f91e0a502 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:22.341596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387260d-34f9-45bb-8439-f17f91e0a502 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:22.347537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f60693-95a8-441a-8f2a-c2b7a39ccb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:22.348226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f60693-95a8-441a-8f2a-c2b7a39ccb45 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:22.348541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f60693-95a8-441a-8f2a-c2b7a39ccb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:22.348821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f60693-95a8-441a-8f2a-c2b7a39ccb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:22.349485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f60693-95a8-441a-8f2a-c2b7a39ccb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:22.351342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f60693-95a8-441a-8f2a-c2b7a39ccb45 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:22.352998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:22.365246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1089/2181] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:28:22.376181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317bc17-909b-4d8c-814a-88ce3d8f15ba admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:22.382855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f317bc17-909b-4d8c-814a-88ce3d8f15ba admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:22.390347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e0a700-31d6-4771-99a7-7faa473e1bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:22.391131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0a700-31d6-4771-99a7-7faa473e1bb5 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:22.391575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0a700-31d6-4771-99a7-7faa473e1bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:22.392260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e0a700-31d6-4771-99a7-7faa473e1bb5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:22.394008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0a700-31d6-4771-99a7-7faa473e1bb5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:22.396704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e0a700-31d6-4771-99a7-7faa473e1bb5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:22.401830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:22.418283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f60693-95a8-441a-8f2a-c2b7a39ccb45 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:22.424300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1093/2182] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:28:22 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:28:22.436934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f60693-95a8-441a-8f2a-c2b7a39ccb45 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:22.445969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd261b9-ad7d-441f-bd4e-1cbb6c4a0a5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:22.446633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd261b9-ad7d-441f-bd4e-1cbb6c4a0a5f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:22.449101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd261b9-ad7d-441f-bd4e-1cbb6c4a0a5f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:22.449450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd261b9-ad7d-441f-bd4e-1cbb6c4a0a5f admin admin] PATH_INFO: `/v3/projects/eb9d3851c2d1450b92eeb19cb7827586/users/938dfdd31f514a4e895075c83c25e78f/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:22.489005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd261b9-ad7d-441f-bd4e-1cbb6c4a0a5f admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb9d3851c2d1450b92eeb19cb7827586, user_id=938dfdd31f514a4e895075c83c25e78f, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:22.497691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd261b9-ad7d-441f-bd4e-1cbb6c4a0a5f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:22.554850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1090/2183] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:28:22 2022] PUT /identity/v3/projects/eb9d3851c2d1450b92eeb19cb7827586/users/938dfdd31f514a4e895075c83c25e78f/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:22.617333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae67cc-faa4-41e3-a91e-a3bd0fd1f05f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:22.617605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae67cc-faa4-41e3-a91e-a3bd0fd1f05f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:22.617886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ae67cc-faa4-41e3-a91e-a3bd0fd1f05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:22.660144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-68ae67cc-faa4-41e3-a91e-a3bd0fd1f05f None None] MFA Rules not processed for user `938dfdd31f514a4e895075c83c25e78f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:22.661665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-68ae67cc-faa4-41e3-a91e-a3bd0fd1f05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:22.760011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1094/2184] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:22 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:22.845114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd261b9-ad7d-441f-bd4e-1cbb6c4a0a5f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:22.847117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3bd261b9-ad7d-441f-bd4e-1cbb6c4a0a5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:22.913460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd261b9-ad7d-441f-bd4e-1cbb6c4a0a5f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:22.917701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-475b2caa-4a38-42d9-a234-339e702f4ebe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:22.918403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b2caa-4a38-42d9-a234-339e702f4ebe service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:22.918683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b2caa-4a38-42d9-a234-339e702f4ebe service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:22.919214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475b2caa-4a38-42d9-a234-339e702f4ebe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:22.929277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b2caa-4a38-42d9-a234-339e702f4ebe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:22.931076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-475b2caa-4a38-42d9-a234-339e702f4ebe service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:22.940700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1091/2185] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:28:22 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:28:22.967081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae67cc-faa4-41e3-a91e-a3bd0fd1f05f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:23.033591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ae67cc-faa4-41e3-a91e-a3bd0fd1f05f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:23.039283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:23.039868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:23.040145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:23.040653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] PATH_INFO: `/v3/users/938dfdd31f514a4e895075c83c25e78f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:23.042362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] RBAC: Authorizing `identity:delete_user(user_id=938dfdd31f514a4e895075c83c25e78f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:23.044798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:23.095531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '938dfdd31f514a4e895075c83c25e78f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:23.096189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '938dfdd31f514a4e895075c83c25e78f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:23.096808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '938dfdd31f514a4e895075c83c25e78f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:23.103801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '938dfdd31f514a4e895075c83c25e78f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:23.116731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '938dfdd31f514a4e895075c83c25e78f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:23.145169 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1095/2186] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:28:22 2022] DELETE /identity/v3/users/938dfdd31f514a4e895075c83c25e78f => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:23.150054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43463a-5830-4450-897c-fb0960a96505 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:23.150372 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43463a-5830-4450-897c-fb0960a96505 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:23.150751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43463a-5830-4450-897c-fb0960a96505 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:23.172061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9e43463a-5830-4450-897c-fb0960a96505 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:23.173678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9e43463a-5830-4450-897c-fb0960a96505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:23.243337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1092/2187] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:23.254120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:23.255737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:23.269224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:23.329214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65429da5-6e1f-4347-abe1-91c0235c917d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:23.343485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceaef8-47b5-4ae1-9b3c-d87b9b0ba551 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:23.343990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceaef8-47b5-4ae1-9b3c-d87b9b0ba551 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:23.344624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceaef8-47b5-4ae1-9b3c-d87b9b0ba551 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:23.344976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcceaef8-47b5-4ae1-9b3c-d87b9b0ba551 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:23.358095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcceaef8-47b5-4ae1-9b3c-d87b9b0ba551 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:23.359611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcceaef8-47b5-4ae1-9b3c-d87b9b0ba551 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:23.371676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1096/2188] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:28:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:28:23.652260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43463a-5830-4450-897c-fb0960a96505 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:23.653724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9e43463a-5830-4450-897c-fb0960a96505 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:23.666219 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43463a-5830-4450-897c-fb0960a96505 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:23.671149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:23.671784 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:23.672066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:23.672380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] PATH_INFO: `/v3/projects/eb9d3851c2d1450b92eeb19cb7827586` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:23.673537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb9d3851c2d1450b92eeb19cb7827586)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:23.675641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:23.728741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb9d3851c2d1450b92eeb19cb7827586', 'request_id': 'req-613bd487-7058-4409-b347-e5beceb46e30'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:23.734359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb9d3851c2d1450b92eeb19cb7827586', 'request_id': 'req-613bd487-7058-4409-b347-e5beceb46e30'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:23.742102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb9d3851c2d1450b92eeb19cb7827586', 'request_id': 'req-613bd487-7058-4409-b347-e5beceb46e30'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:23.749897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:23.756246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] The token cache is being invalidate because project eb9d3851c2d1450b92eeb19cb7827586 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:28:23.756717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:23.757538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-613bd487-7058-4409-b347-e5beceb46e30 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:23.759961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1093/2189] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:28:23 2022] DELETE /identity/v3/projects/eb9d3851c2d1450b92eeb19cb7827586 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:24.278292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceaef8-47b5-4ae1-9b3c-d87b9b0ba551 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:24.279817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dcceaef8-47b5-4ae1-9b3c-d87b9b0ba551 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:24.293594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcceaef8-47b5-4ae1-9b3c-d87b9b0ba551 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:24.351304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:24.351937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:24.352244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:24.352523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] PATH_INFO: `/v3/users/fa9969513e1542a0a6830dc2b3f81a62` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:24.353631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fa9969513e1542a0a6830dc2b3f81a62)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:24.355579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:24.421207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fa9969513e1542a0a6830dc2b3f81a62'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:24.421872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fa9969513e1542a0a6830dc2b3f81a62'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:24.422539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fa9969513e1542a0a6830dc2b3f81a62'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:24.430767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fa9969513e1542a0a6830dc2b3f81a62'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:24.444579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fa9969513e1542a0a6830dc2b3f81a62'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:24.464182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1097/2190] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:28:24 2022] DELETE /identity/v3/users/fa9969513e1542a0a6830dc2b3f81a62 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:24.469153 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dc105-def9-4640-9d5e-a4e1decd0222 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:24.469655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dc105-def9-4640-9d5e-a4e1decd0222 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:24.469738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447dc105-def9-4640-9d5e-a4e1decd0222 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:24.503218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-447dc105-def9-4640-9d5e-a4e1decd0222 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:24.505433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-447dc105-def9-4640-9d5e-a4e1decd0222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:24.569533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1094/2191] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:24.579295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:24.580706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:24.612590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:24.640877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e886a95a-f19a-4e61-b439-11e0e0ebada1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:24.644497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de8951-286c-4f74-8ddd-9557f17b3fd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:24.645137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de8951-286c-4f74-8ddd-9557f17b3fd6 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:24.645393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de8951-286c-4f74-8ddd-9557f17b3fd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:24.645665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4de8951-286c-4f74-8ddd-9557f17b3fd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:24.655795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de8951-286c-4f74-8ddd-9557f17b3fd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:24.657548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4de8951-286c-4f74-8ddd-9557f17b3fd6 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:24.681227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1098/2192] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:28:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:28:25.138662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dc105-def9-4640-9d5e-a4e1decd0222 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:25.140269 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-447dc105-def9-4640-9d5e-a4e1decd0222 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:25.184489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447dc105-def9-4640-9d5e-a4e1decd0222 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:25.196696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:25.198559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:25.198921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:25.199313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] PATH_INFO: `/v3/projects/19b2dd53803e400583d8a877a3f58806` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:25.201009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19b2dd53803e400583d8a877a3f58806)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:25.203287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:25.254468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19b2dd53803e400583d8a877a3f58806', 'request_id': 'req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:25.261656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19b2dd53803e400583d8a877a3f58806', 'request_id': 'req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:25.269534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19b2dd53803e400583d8a877a3f58806', 'request_id': 'req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:25.280871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] The token cache is being invalidate because project 19b2dd53803e400583d8a877a3f58806 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:28:25.281167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:25.281809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a0437e95-8e37-4c5c-8ba6-eb69639c27d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:25.283312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1095/2193] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:28:25 2022] DELETE /identity/v3/projects/19b2dd53803e400583d8a877a3f58806 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:29.061852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de8951-286c-4f74-8ddd-9557f17b3fd6 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:29.063518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f4de8951-286c-4f74-8ddd-9557f17b3fd6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:29.078157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4de8951-286c-4f74-8ddd-9557f17b3fd6 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:29.149925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:29.150849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:29.151431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:29.152205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] PATH_INFO: `/v3/users/43aa2b1795eb475794c5c8e470b68a53` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:29.153785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] RBAC: Authorizing `identity:delete_user(user_id=43aa2b1795eb475794c5c8e470b68a53)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:29.156858 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:29.221448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '43aa2b1795eb475794c5c8e470b68a53'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:29.222062 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '43aa2b1795eb475794c5c8e470b68a53'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:29.222679 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '43aa2b1795eb475794c5c8e470b68a53'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:29.231349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '43aa2b1795eb475794c5c8e470b68a53'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:29.245855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '43aa2b1795eb475794c5c8e470b68a53'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:29.264250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1099/2194] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:28:29 2022] DELETE /identity/v3/users/43aa2b1795eb475794c5c8e470b68a53 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:29.268725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1ee5a-d110-4d17-996f-a7acd14eafbe None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:29.269687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1ee5a-d110-4d17-996f-a7acd14eafbe None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:29.270247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c1ee5a-d110-4d17-996f-a7acd14eafbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:29.298727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-02c1ee5a-d110-4d17-996f-a7acd14eafbe None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:29.299958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02c1ee5a-d110-4d17-996f-a7acd14eafbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:29.386628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1096/2195] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:28:29.397273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:29.398731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:29.462417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a77914c-3c74-4514-bb0b-da472960238a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:29.466193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8490549-4401-40f4-bd3e-6f83470cbaa0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:29.466818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490549-4401-40f4-bd3e-6f83470cbaa0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:29.467095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490549-4401-40f4-bd3e-6f83470cbaa0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:29.467370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8490549-4401-40f4-bd3e-6f83470cbaa0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:29.474881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:29.480635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8490549-4401-40f4-bd3e-6f83470cbaa0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:29.482325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8490549-4401-40f4-bd3e-6f83470cbaa0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:29.493429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1100/2196] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:28:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:28:29.807566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1ee5a-d110-4d17-996f-a7acd14eafbe None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:29.809045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02c1ee5a-d110-4d17-996f-a7acd14eafbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:29.821646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c1ee5a-d110-4d17-996f-a7acd14eafbe None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:29.827021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:29.827790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:29.828226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:29.828634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] PATH_INFO: `/v3/projects/9b4966aca4af48ba9bac263f69779abb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:29.829833 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b4966aca4af48ba9bac263f69779abb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:29.831801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:29.852611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:29.897759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b4966aca4af48ba9bac263f69779abb', 'request_id': 'req-63d55464-6270-487b-9567-3e34c971bf2c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:29.904624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b4966aca4af48ba9bac263f69779abb', 'request_id': 'req-63d55464-6270-487b-9567-3e34c971bf2c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:29.915141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b4966aca4af48ba9bac263f69779abb', 'request_id': 'req-63d55464-6270-487b-9567-3e34c971bf2c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:29.932187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] The token cache is being invalidate because project 9b4966aca4af48ba9bac263f69779abb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:28:29.932713 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:29.933752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-63d55464-6270-487b-9567-3e34c971bf2c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:28:29.935846 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1097/2197] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:28:29 2022] DELETE /identity/v3/projects/9b4966aca4af48ba9bac263f69779abb => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:29.943328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2393f-18b3-41f9-9189-184cb037bd7c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:29.943876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2393f-18b3-41f9-9189-184cb037bd7c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:29.944266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc2393f-18b3-41f9-9189-184cb037bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:29.975324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7cc2393f-18b3-41f9-9189-184cb037bd7c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:29.977075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7cc2393f-18b3-41f9-9189-184cb037bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:30.037874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1101/2198] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:30.046091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b4b05-3ab0-4b80-bad7-ddef4a9b2a8f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:30.046448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b4b05-3ab0-4b80-bad7-ddef4a9b2a8f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:30.046799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010b4b05-3ab0-4b80-bad7-ddef4a9b2a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:30.071534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-010b4b05-3ab0-4b80-bad7-ddef4a9b2a8f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:30.073082 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-010b4b05-3ab0-4b80-bad7-ddef4a9b2a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:30.082919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1098/2199] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:30.087647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2393f-18b3-41f9-9189-184cb037bd7c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:30.097532 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc2393f-18b3-41f9-9189-184cb037bd7c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:30.102185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f10429-fc2e-4cd8-be4c-249fae2a6813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:30.102783 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f10429-fc2e-4cd8-be4c-249fae2a6813 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:30.103060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f10429-fc2e-4cd8-be4c-249fae2a6813 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:30.103332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f10429-fc2e-4cd8-be4c-249fae2a6813 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:30.103977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f10429-fc2e-4cd8-be4c-249fae2a6813 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:28:30.104332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f10429-fc2e-4cd8-be4c-249fae2a6813 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:30.105935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f10429-fc2e-4cd8-be4c-249fae2a6813 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:30.117990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1102/2200] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:28:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:28:30.123610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b4b05-3ab0-4b80-bad7-ddef4a9b2a8f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:30.134405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010b4b05-3ab0-4b80-bad7-ddef4a9b2a8f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:30.139449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2332bd-7849-4a5f-bc37-9ca0309ffaab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:30.140069 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2332bd-7849-4a5f-bc37-9ca0309ffaab admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:30.140442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2332bd-7849-4a5f-bc37-9ca0309ffaab admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:30.140732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2332bd-7849-4a5f-bc37-9ca0309ffaab admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:30.141404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2332bd-7849-4a5f-bc37-9ca0309ffaab admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:30.143495 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2332bd-7849-4a5f-bc37-9ca0309ffaab admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:30.172748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1099/2201] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:28:30 2022] POST /identity/v3/projects => generated 363 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:28:30.178051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f10429-fc2e-4cd8-be4c-249fae2a6813 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:30.188009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f10429-fc2e-4cd8-be4c-249fae2a6813 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:30.243116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b32601-a540-4887-8841-5de30aabaded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:30.243624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32601-a540-4887-8841-5de30aabaded admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:30.243905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32601-a540-4887-8841-5de30aabaded admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:30.244579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b32601-a540-4887-8841-5de30aabaded admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:30.244820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b32601-a540-4887-8841-5de30aabaded admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:30.246734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b32601-a540-4887-8841-5de30aabaded admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:30.272413 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1103/2202] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:28:30 2022] POST /identity/v3/users => generated 282 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:28:30.277188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2332bd-7849-4a5f-bc37-9ca0309ffaab admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:30.291506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2332bd-7849-4a5f-bc37-9ca0309ffaab admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:30.297347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f38e6-059f-4009-9eb2-4eac03e431aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:30.298104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f38e6-059f-4009-9eb2-4eac03e431aa admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:30.298460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f38e6-059f-4009-9eb2-4eac03e431aa admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:30.298777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-065f38e6-059f-4009-9eb2-4eac03e431aa admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:30.299606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f38e6-059f-4009-9eb2-4eac03e431aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:30.302252 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-065f38e6-059f-4009-9eb2-4eac03e431aa admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:30.314981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1100/2203] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:28:30.320058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b32601-a540-4887-8841-5de30aabaded admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:30.332490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b32601-a540-4887-8841-5de30aabaded admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:30.338491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76c043d-21cb-4479-bbaa-9a56fc8172b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:30.339270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c043d-21cb-4479-bbaa-9a56fc8172b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:30.339629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c043d-21cb-4479-bbaa-9a56fc8172b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:30.339976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76c043d-21cb-4479-bbaa-9a56fc8172b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:30.340830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c043d-21cb-4479-bbaa-9a56fc8172b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:30.342910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a76c043d-21cb-4479-bbaa-9a56fc8172b3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:30.355868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1104/2204] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:28:30 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:28:30.359955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f38e6-059f-4009-9eb2-4eac03e431aa admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:30.371579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-065f38e6-059f-4009-9eb2-4eac03e431aa admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:30.376985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec9d0-4888-418e-8655-b04ebfabbb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:30.377884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec9d0-4888-418e-8655-b04ebfabbb5e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:30.378242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec9d0-4888-418e-8655-b04ebfabbb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:30.378586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7ec9d0-4888-418e-8655-b04ebfabbb5e admin admin] PATH_INFO: `/v3/projects/484ee87e0d9a433ab48252313271b6ec/users/2a9893c3d6cc421886f78ee50d5cd34b/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:30.396655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec9d0-4888-418e-8655-b04ebfabbb5e admin admin] RBAC: Authorizing `identity:create_grant(project_id=484ee87e0d9a433ab48252313271b6ec, user_id=2a9893c3d6cc421886f78ee50d5cd34b, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:30.399299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7ec9d0-4888-418e-8655-b04ebfabbb5e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:30.420845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1101/2205] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:28:30 2022] PUT /identity/v3/projects/484ee87e0d9a433ab48252313271b6ec/users/2a9893c3d6cc421886f78ee50d5cd34b/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:28:30.432947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec41d1-45d6-4259-847c-ffd47526838d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:30.433358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec41d1-45d6-4259-847c-ffd47526838d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:30.433774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adec41d1-45d6-4259-847c-ffd47526838d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:30.467773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-adec41d1-45d6-4259-847c-ffd47526838d None None] MFA Rules not processed for user `2a9893c3d6cc421886f78ee50d5cd34b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:30.469296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-adec41d1-45d6-4259-847c-ffd47526838d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:30.527603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:30.551684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1105/2206] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:30.570738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec9d0-4888-418e-8655-b04ebfabbb5e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:30.572603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7e7ec9d0-4888-418e-8655-b04ebfabbb5e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:30.631766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7ec9d0-4888-418e-8655-b04ebfabbb5e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:30.635645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256805ce-8ee0-4be0-bb3c-f69bdd06b46b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:30.636288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256805ce-8ee0-4be0-bb3c-f69bdd06b46b service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:30.636576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256805ce-8ee0-4be0-bb3c-f69bdd06b46b service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:30.636849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256805ce-8ee0-4be0-bb3c-f69bdd06b46b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:30.646642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256805ce-8ee0-4be0-bb3c-f69bdd06b46b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:30.648110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256805ce-8ee0-4be0-bb3c-f69bdd06b46b service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:30.658194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1102/2207] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:28:30 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:28:37.422689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24a09a-d25d-4b09-b947-c581869de53e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:37.423130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24a09a-d25d-4b09-b947-c581869de53e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:37.423231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec24a09a-d25d-4b09-b947-c581869de53e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:37.468737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ec24a09a-d25d-4b09-b947-c581869de53e None None] MFA Rules not processed for user `da78d19e83fe41a99ae64d52d2d10d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:37.470155 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ec24a09a-d25d-4b09-b947-c581869de53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:37.547128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1106/2208] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:28:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:40.654067 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=70,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:47.540742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=30 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:28:49.908202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3ae2-28e0-472e-bbcb-bce83b27df69 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:49.908687 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3ae2-28e0-472e-bbcb-bce83b27df69 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:49.908881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12b3ae2-28e0-472e-bbcb-bce83b27df69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:49.929369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f12b3ae2-28e0-472e-bbcb-bce83b27df69 None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:28:49.931236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f12b3ae2-28e0-472e-bbcb-bce83b27df69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:50.031878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1103/2209] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:28:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:28:50.093280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24a09a-d25d-4b09-b947-c581869de53e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:28:50.095604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ec24a09a-d25d-4b09-b947-c581869de53e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:28:50.180267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec24a09a-d25d-4b09-b947-c581869de53e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:28:50.187652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4062d701-2363-48a7-bc64-a9ae8e55ca03 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:28:50.189798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d701-2363-48a7-bc64-a9ae8e55ca03 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:28:50.190186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d701-2363-48a7-bc64-a9ae8e55ca03 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:28:50.191175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4062d701-2363-48a7-bc64-a9ae8e55ca03 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:28:50.202178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d701-2363-48a7-bc64-a9ae8e55ca03 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:28:50.204054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4062d701-2363-48a7-bc64-a9ae8e55ca03 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:28:50.215630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1107/2210] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:28:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:29:00.023429 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=25 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:00.211617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=32 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:04.782307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b3ae2-28e0-472e-bbcb-bce83b27df69 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:04.852600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12b3ae2-28e0-472e-bbcb-bce83b27df69 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:04.857273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:04.857887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:04.858163 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:04.858434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] PATH_INFO: `/v3/users/2a9893c3d6cc421886f78ee50d5cd34b` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:04.859552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a9893c3d6cc421886f78ee50d5cd34b)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:04.861575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:04.917878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a9893c3d6cc421886f78ee50d5cd34b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:29:04.918771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a9893c3d6cc421886f78ee50d5cd34b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:29:04.935258 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a9893c3d6cc421886f78ee50d5cd34b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:29:04.936247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a9893c3d6cc421886f78ee50d5cd34b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:29:04.945507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a9893c3d6cc421886f78ee50d5cd34b'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:29:04.964550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1104/2211] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:29:04 2022] DELETE /identity/v3/users/2a9893c3d6cc421886f78ee50d5cd34b => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:29:04.969484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04fb2c-cb80-423d-9873-da05b63fdd6f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:04.969954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04fb2c-cb80-423d-9873-da05b63fdd6f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:04.970049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04fb2c-cb80-423d-9873-da05b63fdd6f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:04.991474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9c04fb2c-cb80-423d-9873-da05b63fdd6f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:04.992745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9c04fb2c-cb80-423d-9873-da05b63fdd6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:05.054970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1108/2212] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:29:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:29:05.065031 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:05.066563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:05.130221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a94fdf-6958-408f-9294-74ba5bc8e7c1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:05.134116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf9f285-0b6e-45bf-af88-6410c7bca4bc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:05.134738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9f285-0b6e-45bf-af88-6410c7bca4bc service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.135015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9f285-0b6e-45bf-af88-6410c7bca4bc service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.135285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf9f285-0b6e-45bf-af88-6410c7bca4bc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.145508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9f285-0b6e-45bf-af88-6410c7bca4bc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:05.146950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf9f285-0b6e-45bf-af88-6410c7bca4bc service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:05.157021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1105/2213] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:29:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:29:05.247340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c873d-42a8-4d87-ad16-e6f633fd1836 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.247723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c873d-42a8-4d87-ad16-e6f633fd1836 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.248291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f00c873d-42a8-4d87-ad16-e6f633fd1836 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.249871 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1109/2214] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:29:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:29:05.257571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0904b-ffa5-40e6-ada6-b4ac6e39332f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.258069 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0904b-ffa5-40e6-ada6-b4ac6e39332f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.258541 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae0904b-ffa5-40e6-ada6-b4ac6e39332f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.281326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9ae0904b-ffa5-40e6-ada6-b4ac6e39332f None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:05.282642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9ae0904b-ffa5-40e6-ada6-b4ac6e39332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:05.303663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:05.368602 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1106/2215] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:29:05.394354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c873d-42a8-4d87-ad16-e6f633fd1836 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:05.397248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f00c873d-42a8-4d87-ad16-e6f633fd1836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:05.467512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f00c873d-42a8-4d87-ad16-e6f633fd1836 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:05.476129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0904b-ffa5-40e6-ada6-b4ac6e39332f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:05.478133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-693bf2d0-b49c-4f3a-832a-5e7955c6d0cd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ece8645e0954e1d81837cdcaa2ef1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:05.478751 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf2d0-b49c-4f3a-832a-5e7955c6d0cd service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.479032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf2d0-b49c-4f3a-832a-5e7955c6d0cd service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.479305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-693bf2d0-b49c-4f3a-832a-5e7955c6d0cd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.481504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9ae0904b-ffa5-40e6-ada6-b4ac6e39332f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:05.493072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bf2d0-b49c-4f3a-832a-5e7955c6d0cd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:05.496863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-693bf2d0-b49c-4f3a-832a-5e7955c6d0cd service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:05.497307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae0904b-ffa5-40e6-ada6-b4ac6e39332f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:05.502978 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:05.503838 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.504240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.506005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] PATH_INFO: `/v3/projects/484ee87e0d9a433ab48252313271b6ec` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.508428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=484ee87e0d9a433ab48252313271b6ec)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:05.510344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:05.511403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1110/2216] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:29:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:29:05.567124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '484ee87e0d9a433ab48252313271b6ec', 'request_id': 'req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:29:05.573452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '484ee87e0d9a433ab48252313271b6ec', 'request_id': 'req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:29:05.581086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '484ee87e0d9a433ab48252313271b6ec', 'request_id': 'req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:29:05.587777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d248db-a6d4-4e68-974f-34514118c785 None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.588132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d248db-a6d4-4e68-974f-34514118c785 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.588500 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d248db-a6d4-4e68-974f-34514118c785 None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.589900 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1111/2217] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:29:05.594462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4716f4-1853-4788-8a7d-a6d07f5d6007 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.594854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4716f4-1853-4788-8a7d-a6d07f5d6007 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.595158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4716f4-1853-4788-8a7d-a6d07f5d6007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.595842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] The token cache is being invalidate because project 484ee87e0d9a433ab48252313271b6ec was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:29:05.596734 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:29:05.597439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d5594226-a6a6-4fe4-b9d6-d26a3bde26b8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:29:05.598946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1107/2218] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:29:05 2022] DELETE /identity/v3/projects/484ee87e0d9a433ab48252313271b6ec => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:29:05.603702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597e01-0029-47ab-a63e-e83becfbaa3e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.603991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597e01-0029-47ab-a63e-e83becfbaa3e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.605247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83597e01-0029-47ab-a63e-e83becfbaa3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.615781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4e4716f4-1853-4788-8a7d-a6d07f5d6007 None None] MFA Rules not processed for user `7014b2868d4b4acea242d068f247c21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:05.617117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4e4716f4-1853-4788-8a7d-a6d07f5d6007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:05.626657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-83597e01-0029-47ab-a63e-e83becfbaa3e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:05.628921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-83597e01-0029-47ab-a63e-e83becfbaa3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:05.671253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1112/2219] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:29:05.683622 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4716f4-1853-4788-8a7d-a6d07f5d6007 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:05.685008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4e4716f4-1853-4788-8a7d-a6d07f5d6007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:05.689452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1108/2220] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:29:05.695997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4716f4-1853-4788-8a7d-a6d07f5d6007 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:05.697101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbbd05-c46e-469d-8f81-3c5c3588b822 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.697390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbbd05-c46e-469d-8f81-3c5c3588b822 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.697666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bbbbd05-c46e-469d-8f81-3c5c3588b822 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.699902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1b4c2-9c5d-4af8-a8ee-09b83992e5d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:05.700561 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1b4c2-9c5d-4af8-a8ee-09b83992e5d0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.700862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1b4c2-9c5d-4af8-a8ee-09b83992e5d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.701132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a1b4c2-9c5d-4af8-a8ee-09b83992e5d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.709097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1b4c2-9c5d-4af8-a8ee-09b83992e5d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:05.710800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35a1b4c2-9c5d-4af8-a8ee-09b83992e5d0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:05.717642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6bbbbd05-c46e-469d-8f81-3c5c3588b822 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:05.718788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6bbbbd05-c46e-469d-8f81-3c5c3588b822 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:05.719125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1113/2221] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:29:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:29:05.727292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1109/2222] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:29:05.731422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1b4c2-9c5d-4af8-a8ee-09b83992e5d0 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:05.742917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a1b4c2-9c5d-4af8-a8ee-09b83992e5d0 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:05.747545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df151c3-37f3-4555-8a03-e652e981afb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:05.748146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df151c3-37f3-4555-8a03-e652e981afb2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.748486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df151c3-37f3-4555-8a03-e652e981afb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.748873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df151c3-37f3-4555-8a03-e652e981afb2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.749539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df151c3-37f3-4555-8a03-e652e981afb2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:29:05.749848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df151c3-37f3-4555-8a03-e652e981afb2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:05.751469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df151c3-37f3-4555-8a03-e652e981afb2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:05.767533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1114/2223] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:29:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:29:05.769370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbbd05-c46e-469d-8f81-3c5c3588b822 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:05.779035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bbbbd05-c46e-469d-8f81-3c5c3588b822 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:05.783997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f959417-6cc3-4254-90f7-05f73b34853b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:05.784641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959417-6cc3-4254-90f7-05f73b34853b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.784905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959417-6cc3-4254-90f7-05f73b34853b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.785177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f959417-6cc3-4254-90f7-05f73b34853b admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.785814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f959417-6cc3-4254-90f7-05f73b34853b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:05.787771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f959417-6cc3-4254-90f7-05f73b34853b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:05.820912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1110/2224] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:29:05 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:29:05.822232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df151c3-37f3-4555-8a03-e652e981afb2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:05.833521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df151c3-37f3-4555-8a03-e652e981afb2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:05.842073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a8d5-293c-42c4-b1a9-c7b25a5e23bc None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.842353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a8d5-293c-42c4-b1a9-c7b25a5e23bc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.842631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a8d5-293c-42c4-b1a9-c7b25a5e23bc None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.844098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1111/2225] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:29:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Sep 24 14:29:05.848600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80a7ab-46eb-4059-816d-4889fa6f9868 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.848881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80a7ab-46eb-4059-816d-4889fa6f9868 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.849155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc80a7ab-46eb-4059-816d-4889fa6f9868 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.859293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:05.869205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fc80a7ab-46eb-4059-816d-4889fa6f9868 None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:05.870430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fc80a7ab-46eb-4059-816d-4889fa6f9868 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:05.874854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:05.895695 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a8b06-f3c9-4376-bfb7-f070d6d58785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:05.896400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a8b06-f3c9-4376-bfb7-f070d6d58785 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.896713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a8b06-f3c9-4376-bfb7-f070d6d58785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.897040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3a8b06-f3c9-4376-bfb7-f070d6d58785 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.897716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a8b06-f3c9-4376-bfb7-f070d6d58785 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:05.899881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3a8b06-f3c9-4376-bfb7-f070d6d58785 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:05.923452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1115/2226] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:29:05 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:29:05.928059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a8b06-f3c9-4376-bfb7-f070d6d58785 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:05.938926 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3a8b06-f3c9-4376-bfb7-f070d6d58785 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:05.944519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b72f6b-d897-4c9e-8341-09e2ff81ab92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:05.945137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72f6b-d897-4c9e-8341-09e2ff81ab92 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.945447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72f6b-d897-4c9e-8341-09e2ff81ab92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.945733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b72f6b-d897-4c9e-8341-09e2ff81ab92 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.946481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b72f6b-d897-4c9e-8341-09e2ff81ab92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:05.948295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b72f6b-d897-4c9e-8341-09e2ff81ab92 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:05.951182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1112/2227] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:29:05 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:29:05.963106 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1116/2228] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:29:05.964466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b72f6b-d897-4c9e-8341-09e2ff81ab92 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:05.964666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80a7ab-46eb-4059-816d-4889fa6f9868 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:05.974466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b72f6b-d897-4c9e-8341-09e2ff81ab92 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:05.979436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c68527-cefe-4838-ba74-aaa7cfa30c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:05.980064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68527-cefe-4838-ba74-aaa7cfa30c13 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:05.980439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68527-cefe-4838-ba74-aaa7cfa30c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:05.980713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c68527-cefe-4838-ba74-aaa7cfa30c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:05.981371 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c68527-cefe-4838-ba74-aaa7cfa30c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:05.983015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c68527-cefe-4838-ba74-aaa7cfa30c13 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:05.994776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1117/2229] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:29:05 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:29:05.999014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c68527-cefe-4838-ba74-aaa7cfa30c13 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:06.009865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c68527-cefe-4838-ba74-aaa7cfa30c13 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:06.014815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9589d05-1e56-4fe6-84ce-746da44cb52e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:06.015504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9589d05-1e56-4fe6-84ce-746da44cb52e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:06.015845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9589d05-1e56-4fe6-84ce-746da44cb52e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:06.016080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9589d05-1e56-4fe6-84ce-746da44cb52e admin admin] PATH_INFO: `/v3/projects/875c914ac8464d2d882941e71be425ab/users/4f99d2c0ee5645eead533ce1870a423b/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:06.022295 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc80a7ab-46eb-4059-816d-4889fa6f9868 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:06.026134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0477140-dbb6-4004-96fb-d80323c21a42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:06.026737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0477140-dbb6-4004-96fb-d80323c21a42 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:06.027015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0477140-dbb6-4004-96fb-d80323c21a42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:06.027287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0477140-dbb6-4004-96fb-d80323c21a42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:06.031167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9589d05-1e56-4fe6-84ce-746da44cb52e admin admin] RBAC: Authorizing `identity:create_grant(project_id=875c914ac8464d2d882941e71be425ab, user_id=4f99d2c0ee5645eead533ce1870a423b, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:06.033950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9589d05-1e56-4fe6-84ce-746da44cb52e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:06.037561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0477140-dbb6-4004-96fb-d80323c21a42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:06.039007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0477140-dbb6-4004-96fb-d80323c21a42 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:06.051757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1113/2230] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:29:05 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:29:06.060722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1118/2231] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:29:05 2022] PUT /identity/v3/projects/875c914ac8464d2d882941e71be425ab/users/4f99d2c0ee5645eead533ce1870a423b/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:29:06.064178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0da50-88d8-4d85-a1c7-4a3059925071 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:06.064468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0da50-88d8-4d85-a1c7-4a3059925071 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:06.064749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf0da50-88d8-4d85-a1c7-4a3059925071 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:06.085632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8bf0da50-88d8-4d85-a1c7-4a3059925071 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:06.086842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8bf0da50-88d8-4d85-a1c7-4a3059925071 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:06.169568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1114/2232] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:29:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:29:06.179951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9589d05-1e56-4fe6-84ce-746da44cb52e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:06.272930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9589d05-1e56-4fe6-84ce-746da44cb52e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:06.277901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c970-7c23-4aa5-b129-17c188c38405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:06.278630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c970-7c23-4aa5-b129-17c188c38405 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:06.279277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c970-7c23-4aa5-b129-17c188c38405 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:06.279610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d14c970-7c23-4aa5-b129-17c188c38405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:06.290470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14c970-7c23-4aa5-b129-17c188c38405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:06.292008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d14c970-7c23-4aa5-b129-17c188c38405 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:06.303471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1119/2233] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:29:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:29:08.931816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f7612-6b27-4c0a-8e5b-1641ed5ea226 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:08.932361 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f7612-6b27-4c0a-8e5b-1641ed5ea226 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:08.932482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-636f7612-6b27-4c0a-8e5b-1641ed5ea226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:08.956297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-636f7612-6b27-4c0a-8e5b-1641ed5ea226 None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:08.957688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-636f7612-6b27-4c0a-8e5b-1641ed5ea226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:09.004063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:09.024344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1115/2234] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:29:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:29:09.050307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c970-7c23-4aa5-b129-17c188c38405 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:09.052135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0d14c970-7c23-4aa5-b129-17c188c38405 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:09.137275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d14c970-7c23-4aa5-b129-17c188c38405 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:09.146325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1250b6-d5a1-4309-b338-e3f40ac2da6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:09.146962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1250b6-d5a1-4309-b338-e3f40ac2da6f service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:09.147244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1250b6-d5a1-4309-b338-e3f40ac2da6f service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:09.147530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1250b6-d5a1-4309-b338-e3f40ac2da6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:09.163400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1250b6-d5a1-4309-b338-e3f40ac2da6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:09.165242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1250b6-d5a1-4309-b338-e3f40ac2da6f service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:09.178968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1120/2235] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:29:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 129 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:29:11.073052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361075a4-0023-484f-b312-2c69c36fc8b3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:11.074064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361075a4-0023-484f-b312-2c69c36fc8b3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:11.074581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361075a4-0023-484f-b312-2c69c36fc8b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:11.126832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-361075a4-0023-484f-b312-2c69c36fc8b3 None None] MFA Rules not processed for user `4f99d2c0ee5645eead533ce1870a423b`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:11.128710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-361075a4-0023-484f-b312-2c69c36fc8b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:11.227692 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1116/2236] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:29:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:29:11.232225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1250b6-d5a1-4309-b338-e3f40ac2da6f service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:11.238465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:11.246365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1250b6-d5a1-4309-b338-e3f40ac2da6f service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:11.253447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df89b4-27b7-46a4-958b-3d5095a9f5e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:11.254290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df89b4-27b7-46a4-958b-3d5095a9f5e2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:11.254752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df89b4-27b7-46a4-958b-3d5095a9f5e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:11.255448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16df89b4-27b7-46a4-958b-3d5095a9f5e2 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:11.256301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df89b4-27b7-46a4-958b-3d5095a9f5e2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:11.258408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16df89b4-27b7-46a4-958b-3d5095a9f5e2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:11.292378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1121/2237] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:29:11 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:29:11.298121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361075a4-0023-484f-b312-2c69c36fc8b3 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:11.309917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361075a4-0023-484f-b312-2c69c36fc8b3 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:11.408631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c0598-f40e-4109-9411-0af4962ce44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:11.409260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c0598-f40e-4109-9411-0af4962ce44b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:11.409543 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c0598-f40e-4109-9411-0af4962ce44b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:11.409819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14c0598-f40e-4109-9411-0af4962ce44b admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:11.410542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c0598-f40e-4109-9411-0af4962ce44b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:11.412472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c14c0598-f40e-4109-9411-0af4962ce44b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:11.485856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1117/2238] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:29:11 2022] POST /identity/v3/users => generated 293 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:29:11.491229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df89b4-27b7-46a4-958b-3d5095a9f5e2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:11.511392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16df89b4-27b7-46a4-958b-3d5095a9f5e2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:11.524299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86851aca-7936-456d-a346-4847d2e2b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:11.525212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86851aca-7936-456d-a346-4847d2e2b868 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:11.525655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86851aca-7936-456d-a346-4847d2e2b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:11.526237 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86851aca-7936-456d-a346-4847d2e2b868 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:11.527047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86851aca-7936-456d-a346-4847d2e2b868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:11.531306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86851aca-7936-456d-a346-4847d2e2b868 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:11.562422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1122/2239] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:29:11.565975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c0598-f40e-4109-9411-0af4962ce44b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:11.581111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14c0598-f40e-4109-9411-0af4962ce44b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:11.597246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4727ead-f975-4820-ac73-472b3e196cd4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:11.598312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4727ead-f975-4820-ac73-472b3e196cd4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:11.598781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4727ead-f975-4820-ac73-472b3e196cd4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:11.599218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4727ead-f975-4820-ac73-472b3e196cd4 admin admin] PATH_INFO: `/v3/projects/0edba950a0f2460a991c4e5b6417c6fa/users/c768ab5d2bce4d4d92fed37e98e40518/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:11.622103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4727ead-f975-4820-ac73-472b3e196cd4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0edba950a0f2460a991c4e5b6417c6fa, user_id=c768ab5d2bce4d4d92fed37e98e40518, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:11.630835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4727ead-f975-4820-ac73-472b3e196cd4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:11.668203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1118/2240] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:29:11 2022] PUT /identity/v3/projects/0edba950a0f2460a991c4e5b6417c6fa/users/c768ab5d2bce4d4d92fed37e98e40518/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:29:11.671577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86851aca-7936-456d-a346-4847d2e2b868 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:11.691650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86851aca-7936-456d-a346-4847d2e2b868 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:11.814137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-640ef0c3-cba8-4a57-b612-09c8632c2e8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:11.821712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef0c3-cba8-4a57-b612-09c8632c2e8f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:11.821712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef0c3-cba8-4a57-b612-09c8632c2e8f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:11.821712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-640ef0c3-cba8-4a57-b612-09c8632c2e8f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:11.823951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ef0c3-cba8-4a57-b612-09c8632c2e8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:11.826591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-640ef0c3-cba8-4a57-b612-09c8632c2e8f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:11.841914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1123/2241] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:29:11 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:29:11.845662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4727ead-f975-4820-ac73-472b3e196cd4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:11.860786 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4727ead-f975-4820-ac73-472b3e196cd4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:11.865955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ec7d5-c6c2-41bd-ab02-b15f5b4ae388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:11.866792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ec7d5-c6c2-41bd-ab02-b15f5b4ae388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:11.867072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ec7d5-c6c2-41bd-ab02-b15f5b4ae388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:11.867341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-233ec7d5-c6c2-41bd-ab02-b15f5b4ae388 admin admin] PATH_INFO: `/v3/projects/0edba950a0f2460a991c4e5b6417c6fa/users/c768ab5d2bce4d4d92fed37e98e40518/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:11.869337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ec7d5-c6c2-41bd-ab02-b15f5b4ae388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0edba950a0f2460a991c4e5b6417c6fa, user_id=c768ab5d2bce4d4d92fed37e98e40518, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:11.871998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-233ec7d5-c6c2-41bd-ab02-b15f5b4ae388 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:11.885240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1119/2242] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:29:11 2022] PUT /identity/v3/projects/0edba950a0f2460a991c4e5b6417c6fa/users/c768ab5d2bce4d4d92fed37e98e40518/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:29:18.585337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c163b4-d31b-4aa1-b309-2fde07f65af7 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:18.585933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c163b4-d31b-4aa1-b309-2fde07f65af7 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:18.585933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88c163b4-d31b-4aa1-b309-2fde07f65af7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:18.616757 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-88c163b4-d31b-4aa1-b309-2fde07f65af7 None None] MFA Rules not processed for user `c768ab5d2bce4d4d92fed37e98e40518`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:18.617989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-88c163b4-d31b-4aa1-b309-2fde07f65af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:18.723965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1124/2243] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:29:18 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:29:18.741371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ec7d5-c6c2-41bd-ab02-b15f5b4ae388 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:18.743607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-233ec7d5-c6c2-41bd-ab02-b15f5b4ae388 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:18.787414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:18.835518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-233ec7d5-c6c2-41bd-ab02-b15f5b4ae388 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:18.841845 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2157b2b-f3aa-418c-9a47-6b44f0a79f3f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:18.848249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2157b2b-f3aa-418c-9a47-6b44f0a79f3f service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:18.848249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2157b2b-f3aa-418c-9a47-6b44f0a79f3f service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:18.848249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2157b2b-f3aa-418c-9a47-6b44f0a79f3f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:18.944053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2157b2b-f3aa-418c-9a47-6b44f0a79f3f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:18.946155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2157b2b-f3aa-418c-9a47-6b44f0a79f3f service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:18.964360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1120/2244] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:29:18 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:29:20.328485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05c7ed-3a3c-49f8-a40a-05843749497f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:20.329052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05c7ed-3a3c-49f8-a40a-05843749497f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:20.329052 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f05c7ed-3a3c-49f8-a40a-05843749497f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:20.351101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5f05c7ed-3a3c-49f8-a40a-05843749497f None None] MFA Rules not processed for user `4f99d2c0ee5645eead533ce1870a423b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:20.352913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5f05c7ed-3a3c-49f8-a40a-05843749497f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:20.360686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1125/2245] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:29:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:29:23.362262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbb587-70bc-470a-ab61-67d25571e5d0 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:23.362780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbb587-70bc-470a-ab61-67d25571e5d0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:23.362884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cbbb587-70bc-470a-ab61-67d25571e5d0 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:23.364323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1121/2246] 10.222.0.16 () {54 vars in 961 bytes} [Sat Sep 24 14:29:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:29:23.369591 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be190b8-ea3b-4ee4-b6ad-e62cc0157831 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:23.370017 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be190b8-ea3b-4ee4-b6ad-e62cc0157831 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:23.370139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be190b8-ea3b-4ee4-b6ad-e62cc0157831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:23.395742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4be190b8-ea3b-4ee4-b6ad-e62cc0157831 None None] MFA Rules not processed for user `2bc00e6583d7424cbdc13732a962fc7b`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:23.397552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4be190b8-ea3b-4ee4-b6ad-e62cc0157831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:23.447024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:23.474705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1126/2247] 10.222.0.16 () {58 vars in 1058 bytes} [Sat Sep 24 14:29:23 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:29:23.483090 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbb587-70bc-470a-ab61-67d25571e5d0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:23.496640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cbbb587-70bc-470a-ab61-67d25571e5d0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:23.501597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab34944-3449-4543-bb7e-4631344073cf service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc00e6583d7424cbdc13732a962fc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:23.502193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab34944-3449-4543-bb7e-4631344073cf service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:23.502467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab34944-3449-4543-bb7e-4631344073cf service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:23.502738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab34944-3449-4543-bb7e-4631344073cf service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:23.504492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0ab34944-3449-4543-bb7e-4631344073cf service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:23.516625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab34944-3449-4543-bb7e-4631344073cf service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:23.519002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab34944-3449-4543-bb7e-4631344073cf service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:23.529339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1122/2248] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:29:23 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:29:29.272762 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d823-b633-4b88-ae60-ef78aaf5f28b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:29.273276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d823-b633-4b88-ae60-ef78aaf5f28b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:29.273378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d3d823-b633-4b88-ae60-ef78aaf5f28b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:29.298650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d0d3d823-b633-4b88-ae60-ef78aaf5f28b None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:29.298650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d0d3d823-b633-4b88-ae60-ef78aaf5f28b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:29.354271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1127/2249] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 24 14:29:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:29:29.367374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab34944-3449-4543-bb7e-4631344073cf service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:29.437859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab34944-3449-4543-bb7e-4631344073cf service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:29.442929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123b1f46-ddac-40ed-9bfc-336c75c88396 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:29.443531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1f46-ddac-40ed-9bfc-336c75c88396 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:29.443814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1f46-ddac-40ed-9bfc-336c75c88396 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:29.444091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123b1f46-ddac-40ed-9bfc-336c75c88396 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:29.452640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1f46-ddac-40ed-9bfc-336c75c88396 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:29.455085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123b1f46-ddac-40ed-9bfc-336c75c88396 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:29.463895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1123/2250] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:29:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:29:39.347672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=34 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:39.460532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=80 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:29:51.313258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d823-b633-4b88-ae60-ef78aaf5f28b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:29:51.378050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d3d823-b633-4b88-ae60-ef78aaf5f28b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:29:51.381949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e74ddb-242e-4082-8af6-8c6a8535b826 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:29:51.382697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74ddb-242e-4082-8af6-8c6a8535b826 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:51.382978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74ddb-242e-4082-8af6-8c6a8535b826 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:51.383489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e74ddb-242e-4082-8af6-8c6a8535b826 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:51.394404 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e74ddb-242e-4082-8af6-8c6a8535b826 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:29:51.396102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0e74ddb-242e-4082-8af6-8c6a8535b826 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:29:51.419163 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1128/2251] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:29:51 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:29:51.420669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3685-9700-4165-968c-cee98cc0bfb4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:29:51.421146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3685-9700-4165-968c-cee98cc0bfb4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:29:51.421244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4dd3685-9700-4165-968c-cee98cc0bfb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:29:51.443589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b4dd3685-9700-4165-968c-cee98cc0bfb4 None None] MFA Rules not processed for user `5a3a7f87ef4349eb9b21745be3a6b8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:29:51.445010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b4dd3685-9700-4165-968c-cee98cc0bfb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:29:51.520665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1124/2252] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:29:51 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:30:01.405092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=26 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:01.512583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=25 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:13.159054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8afb7f-37c3-411f-9e49-6e235e8b7b6e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:30:13.159856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8afb7f-37c3-411f-9e49-6e235e8b7b6e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:30:13.160038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8afb7f-37c3-411f-9e49-6e235e8b7b6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:30:13.180733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6d8afb7f-37c3-411f-9e49-6e235e8b7b6e None None] MFA Rules not processed for user `da78d19e83fe41a99ae64d52d2d10d8a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:30:13.181968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6d8afb7f-37c3-411f-9e49-6e235e8b7b6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:30:13.248021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1129/2253] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:30:13 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:30:23.242102 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=25 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:30:23.737755 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4379b0-7ba8-404e-9821-db61de9f2584 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:30:23.738517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4379b0-7ba8-404e-9821-db61de9f2584 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:30:23.738517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4379b0-7ba8-404e-9821-db61de9f2584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:30:23.758877 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9e4379b0-7ba8-404e-9821-db61de9f2584 None None] MFA Rules not processed for user `40f99377b0134e59802907c55b1c6949`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:30:23.760101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9e4379b0-7ba8-404e-9821-db61de9f2584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:30:23.824408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1125/2254] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:30:23 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:30:33.817682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=25 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:06.069182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a54e87-3c22-40c7-972d-13796ece3af6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:06.069902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a54e87-3c22-40c7-972d-13796ece3af6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:06.069902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a54e87-3c22-40c7-972d-13796ece3af6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:06.091657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-36a54e87-3c22-40c7-972d-13796ece3af6 None None] MFA Rules not processed for user `e1fcaec552f7441f941b6c1bd6b5bdac`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:06.093041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-36a54e87-3c22-40c7-972d-13796ece3af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:06.166783 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1130/2255] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:31:10.708123 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da8e26-5324-4d92-9af2-cfe3d1a1e533 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:10.708650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da8e26-5324-4d92-9af2-cfe3d1a1e533 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:10.708790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30da8e26-5324-4d92-9af2-cfe3d1a1e533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:10.729294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-30da8e26-5324-4d92-9af2-cfe3d1a1e533 None None] MFA Rules not processed for user `5a3a7f87ef4349eb9b21745be3a6b8ea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:10.730534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-30da8e26-5324-4d92-9af2-cfe3d1a1e533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:10.737663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1126/2256] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:10 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:15.422333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a54e87-3c22-40c7-972d-13796ece3af6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:15.423866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-36a54e87-3c22-40c7-972d-13796ece3af6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:15.436673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a54e87-3c22-40c7-972d-13796ece3af6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:15.440389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba981f-5626-4c32-8053-97b516c8dedd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:15.441147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba981f-5626-4c32-8053-97b516c8dedd service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:15.441416 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba981f-5626-4c32-8053-97b516c8dedd service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:15.441689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ba981f-5626-4c32-8053-97b516c8dedd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:15.443518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-04ba981f-5626-4c32-8053-97b516c8dedd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:15.458671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba981f-5626-4c32-8053-97b516c8dedd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:15.460137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ba981f-5626-4c32-8053-97b516c8dedd service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:15.472438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1131/2257] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:16.766383 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da8e26-5324-4d92-9af2-cfe3d1a1e533 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:16.777272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30da8e26-5324-4d92-9af2-cfe3d1a1e533 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:16.781011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3689c-473e-4530-b193-cf1e1e38e656 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:16.781615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3689c-473e-4530-b193-cf1e1e38e656 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:16.782171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3689c-473e-4530-b193-cf1e1e38e656 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:16.782171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3689c-473e-4530-b193-cf1e1e38e656 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:16.783916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96a3689c-473e-4530-b193-cf1e1e38e656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:16.798873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3689c-473e-4530-b193-cf1e1e38e656 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:16.800352 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3689c-473e-4530-b193-cf1e1e38e656 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:16.812279 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1127/2258] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:23.258814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba981f-5626-4c32-8053-97b516c8dedd service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:23.269432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ba981f-5626-4c32-8053-97b516c8dedd service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:23.273971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4daee-eb02-4685-a3b8-8e01044040f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:23.275314 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4daee-eb02-4685-a3b8-8e01044040f4 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:23.276660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4daee-eb02-4685-a3b8-8e01044040f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:23.277347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00e4daee-eb02-4685-a3b8-8e01044040f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:23.279512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-00e4daee-eb02-4685-a3b8-8e01044040f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:23.349005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4daee-eb02-4685-a3b8-8e01044040f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:23.350452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00e4daee-eb02-4685-a3b8-8e01044040f4 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:23.360977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1132/2259] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:26.806894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=9 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:27.317220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3689c-473e-4530-b193-cf1e1e38e656 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:27.319283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-96a3689c-473e-4530-b193-cf1e1e38e656 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:27.336929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3689c-473e-4530-b193-cf1e1e38e656 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:27.343608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:27.344628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:27.344907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:27.345428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] PATH_INFO: `/v3/users/da78d19e83fe41a99ae64d52d2d10d8a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:27.346988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da78d19e83fe41a99ae64d52d2d10d8a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:27.349630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:27.400604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da78d19e83fe41a99ae64d52d2d10d8a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:27.401275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da78d19e83fe41a99ae64d52d2d10d8a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:27.417572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da78d19e83fe41a99ae64d52d2d10d8a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:27.418437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da78d19e83fe41a99ae64d52d2d10d8a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:27.427837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-477dad24-c1cb-46e8-93e7-89f4a9a807d7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da78d19e83fe41a99ae64d52d2d10d8a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:27.442074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1128/2260] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:27 2022] DELETE /identity/v3/users/da78d19e83fe41a99ae64d52d2d10d8a => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:27.651019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4daee-eb02-4685-a3b8-8e01044040f4 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:27.662736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00e4daee-eb02-4685-a3b8-8e01044040f4 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:27.724714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:27.725350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:27.725625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:27.725973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] PATH_INFO: `/v3/projects/c53f86a15d924963b0dd3f78acc462fb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:27.727553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c53f86a15d924963b0dd3f78acc462fb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:27.730092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:27.763720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:27.779692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c53f86a15d924963b0dd3f78acc462fb', 'request_id': 'req-4911d016-9557-4aef-8e68-e6facb0d1a29'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:27.785835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c53f86a15d924963b0dd3f78acc462fb', 'request_id': 'req-4911d016-9557-4aef-8e68-e6facb0d1a29'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:27.791893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c53f86a15d924963b0dd3f78acc462fb', 'request_id': 'req-4911d016-9557-4aef-8e68-e6facb0d1a29'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:27.804341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] The token cache is being invalidate because project c53f86a15d924963b0dd3f78acc462fb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:27.804636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:27.805311 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4911d016-9557-4aef-8e68-e6facb0d1a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:27.806848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1133/2261] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:27 2022] DELETE /identity/v3/projects/c53f86a15d924963b0dd3f78acc462fb => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:27.812399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e8f6-c292-434d-94a7-5b4157f5d3ef None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:27.812887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e8f6-c292-434d-94a7-5b4157f5d3ef None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:27.813016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5376e8f6-c292-434d-94a7-5b4157f5d3ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:27.832812 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5376e8f6-c292-434d-94a7-5b4157f5d3ef None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:27.833950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5376e8f6-c292-434d-94a7-5b4157f5d3ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:27.893197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1129/2262] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:27.901481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace99e-bbf0-45eb-969c-5e44e12535bf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:27.901767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace99e-bbf0-45eb-969c-5e44e12535bf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:27.902042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ace99e-bbf0-45eb-969c-5e44e12535bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:27.921634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-39ace99e-bbf0-45eb-969c-5e44e12535bf None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:27.922854 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-39ace99e-bbf0-45eb-969c-5e44e12535bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:27.930876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1134/2263] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:27.935248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376e8f6-c292-434d-94a7-5b4157f5d3ef None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:27.945059 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5376e8f6-c292-434d-94a7-5b4157f5d3ef None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:27.950171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff2882-7dc5-4efd-83df-aba4f83f127c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:27.950771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2882-7dc5-4efd-83df-aba4f83f127c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:27.951053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2882-7dc5-4efd-83df-aba4f83f127c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:27.951326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ff2882-7dc5-4efd-83df-aba4f83f127c admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:27.952300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff2882-7dc5-4efd-83df-aba4f83f127c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:31:27.952300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff2882-7dc5-4efd-83df-aba4f83f127c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:27.953909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ff2882-7dc5-4efd-83df-aba4f83f127c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:27.966119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1130/2264] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:31:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:31:27.970325 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace99e-bbf0-45eb-969c-5e44e12535bf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:27.979487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ace99e-bbf0-45eb-969c-5e44e12535bf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:27.984183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d637a-1f6b-4186-8d1f-80ae6af9471c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:27.984788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d637a-1f6b-4186-8d1f-80ae6af9471c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:27.985094 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d637a-1f6b-4186-8d1f-80ae6af9471c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:27.985369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0d637a-1f6b-4186-8d1f-80ae6af9471c admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:27.986004 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d637a-1f6b-4186-8d1f-80ae6af9471c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:27.987896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0d637a-1f6b-4186-8d1f-80ae6af9471c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:28.017339 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1135/2265] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:27 2022] POST /identity/v3/projects => generated 403 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:28.021641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff2882-7dc5-4efd-83df-aba4f83f127c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:28.032301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ff2882-7dc5-4efd-83df-aba4f83f127c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:28.086942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bbb9d-5bb4-4523-ad0d-93fedeafd1d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:28.087465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bbb9d-5bb4-4523-ad0d-93fedeafd1d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:28.087743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bbb9d-5bb4-4523-ad0d-93fedeafd1d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:28.088009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247bbb9d-5bb4-4523-ad0d-93fedeafd1d6 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:28.089199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bbb9d-5bb4-4523-ad0d-93fedeafd1d6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:28.091096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247bbb9d-5bb4-4523-ad0d-93fedeafd1d6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:28.098940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:28.113079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1131/2266] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:28 2022] POST /identity/v3/users => generated 302 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:28.117276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d637a-1f6b-4186-8d1f-80ae6af9471c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:28.128525 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0d637a-1f6b-4186-8d1f-80ae6af9471c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:28.133666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e81df-a109-466e-b27f-3a9bd74f80eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:28.135892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e81df-a109-466e-b27f-3a9bd74f80eb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:28.135892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e81df-a109-466e-b27f-3a9bd74f80eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:28.135892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e81df-a109-466e-b27f-3a9bd74f80eb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:28.135892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e81df-a109-466e-b27f-3a9bd74f80eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:28.137219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78e81df-a109-466e-b27f-3a9bd74f80eb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:28.147063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1136/2267] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:28.151165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bbb9d-5bb4-4523-ad0d-93fedeafd1d6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:28.161139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247bbb9d-5bb4-4523-ad0d-93fedeafd1d6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:28.165759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d83a937-2074-4112-91b4-1e4a7771d606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:28.166353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a937-2074-4112-91b4-1e4a7771d606 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:28.166630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a937-2074-4112-91b4-1e4a7771d606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:28.166903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83a937-2074-4112-91b4-1e4a7771d606 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:28.167539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83a937-2074-4112-91b4-1e4a7771d606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:28.169158 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d83a937-2074-4112-91b4-1e4a7771d606 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:28.179464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1132/2268] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:28.184103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e81df-a109-466e-b27f-3a9bd74f80eb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:28.194403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78e81df-a109-466e-b27f-3a9bd74f80eb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:28.202281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87431f0b-ca83-46d8-9b8b-9f941e080956 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:28.203257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87431f0b-ca83-46d8-9b8b-9f941e080956 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:28.203892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87431f0b-ca83-46d8-9b8b-9f941e080956 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:28.204484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87431f0b-ca83-46d8-9b8b-9f941e080956 admin admin] PATH_INFO: `/v3/projects/dd80b918366e44ea86a387efe1685f88/users/f3b346037fdc4486a4eb97170939c000/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:28.222332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87431f0b-ca83-46d8-9b8b-9f941e080956 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd80b918366e44ea86a387efe1685f88, user_id=f3b346037fdc4486a4eb97170939c000, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:28.225032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87431f0b-ca83-46d8-9b8b-9f941e080956 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:28.238707 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1137/2269] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:28 2022] PUT /identity/v3/projects/dd80b918366e44ea86a387efe1685f88/users/f3b346037fdc4486a4eb97170939c000/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:28.243946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8ed0e-9e0d-4866-8589-9357ae84d22a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:28.244950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8ed0e-9e0d-4866-8589-9357ae84d22a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:28.245720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b8ed0e-9e0d-4866-8589-9357ae84d22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:28.267379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a3b8ed0e-9e0d-4866-8589-9357ae84d22a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:28.268799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a3b8ed0e-9e0d-4866-8589-9357ae84d22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:28.333422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1133/2270] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:28.344637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87431f0b-ca83-46d8-9b8b-9f941e080956 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:28.346420 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-87431f0b-ca83-46d8-9b8b-9f941e080956 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:28.405968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87431f0b-ca83-46d8-9b8b-9f941e080956 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:28.410092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183aaab-31b4-4fc2-8e26-f0bd5bf59131 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:28.410745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183aaab-31b4-4fc2-8e26-f0bd5bf59131 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:28.411061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183aaab-31b4-4fc2-8e26-f0bd5bf59131 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:28.411350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5183aaab-31b4-4fc2-8e26-f0bd5bf59131 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:28.421507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183aaab-31b4-4fc2-8e26-f0bd5bf59131 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:28.422924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5183aaab-31b4-4fc2-8e26-f0bd5bf59131 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:28.432704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1138/2271] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:29.135286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ddeeb-bbba-4e30-bdf5-a7b39e24ba63 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:29.135286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ddeeb-bbba-4e30-bdf5-a7b39e24ba63 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:29.136031 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049ddeeb-bbba-4e30-bdf5-a7b39e24ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:29.166035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-049ddeeb-bbba-4e30-bdf5-a7b39e24ba63 None None] MFA Rules not processed for user `f3b346037fdc4486a4eb97170939c000`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:29.167702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-049ddeeb-bbba-4e30-bdf5-a7b39e24ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:29.242142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1134/2272] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:29 2022] POST /identity/v3/auth/tokens => generated 3280 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:29.247140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183aaab-31b4-4fc2-8e26-f0bd5bf59131 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:29.256560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5183aaab-31b4-4fc2-8e26-f0bd5bf59131 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:29.261908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ca9c8-da61-426b-84ed-3bc539ce08e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:29.262513 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ca9c8-da61-426b-84ed-3bc539ce08e0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:29.262797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ca9c8-da61-426b-84ed-3bc539ce08e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:29.263074 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f47ca9c8-da61-426b-84ed-3bc539ce08e0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:29.263718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ca9c8-da61-426b-84ed-3bc539ce08e0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:29.265892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f47ca9c8-da61-426b-84ed-3bc539ce08e0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:29.294941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1139/2273] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:29 2022] POST /identity/v3/projects => generated 401 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:29.299103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ddeeb-bbba-4e30-bdf5-a7b39e24ba63 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:29.309901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049ddeeb-bbba-4e30-bdf5-a7b39e24ba63 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:29.367539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f3f1-58d5-46f0-93d2-13b396bda879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:29.368170 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f3f1-58d5-46f0-93d2-13b396bda879 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:29.368451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f3f1-58d5-46f0-93d2-13b396bda879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:29.368721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f7f3f1-58d5-46f0-93d2-13b396bda879 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:29.369909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7f3f1-58d5-46f0-93d2-13b396bda879 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:29.371819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f7f3f1-58d5-46f0-93d2-13b396bda879 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:29.388762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:29.399146 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1135/2274] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:29 2022] POST /identity/v3/users => generated 307 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:29.403015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ca9c8-da61-426b-84ed-3bc539ce08e0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:29.413539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f47ca9c8-da61-426b-84ed-3bc539ce08e0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:29.419083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708f6c1-40df-45c7-817a-c9116e1b561b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:29.419618 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708f6c1-40df-45c7-817a-c9116e1b561b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:29.419932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708f6c1-40df-45c7-817a-c9116e1b561b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:29.420385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4708f6c1-40df-45c7-817a-c9116e1b561b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:29.421037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708f6c1-40df-45c7-817a-c9116e1b561b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:29.422630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4708f6c1-40df-45c7-817a-c9116e1b561b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:29.437564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1140/2275] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:29.441780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f3f1-58d5-46f0-93d2-13b396bda879 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:29.452651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f7f3f1-58d5-46f0-93d2-13b396bda879 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:29.457623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1de79-63cf-4fe1-9396-89f9f94cd17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:29.458285 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1de79-63cf-4fe1-9396-89f9f94cd17a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:29.458567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1de79-63cf-4fe1-9396-89f9f94cd17a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:29.458849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff1de79-63cf-4fe1-9396-89f9f94cd17a admin admin] PATH_INFO: `/v3/projects/39e26adf788f41b99c0a5a868de2b051/users/325d81d55f9c465e9034802adae93f24/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:29.477287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1de79-63cf-4fe1-9396-89f9f94cd17a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e26adf788f41b99c0a5a868de2b051, user_id=325d81d55f9c465e9034802adae93f24, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:29.480573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff1de79-63cf-4fe1-9396-89f9f94cd17a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:29.499115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1136/2276] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:29 2022] PUT /identity/v3/projects/39e26adf788f41b99c0a5a868de2b051/users/325d81d55f9c465e9034802adae93f24/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:29.504044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708f6c1-40df-45c7-817a-c9116e1b561b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:29.515651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4708f6c1-40df-45c7-817a-c9116e1b561b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:29.536973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:29.584575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35abd81b-651c-48c6-b781-438041d05c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:29.585182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd81b-651c-48c6-b781-438041d05c76 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:29.585462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd81b-651c-48c6-b781-438041d05c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:29.585734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35abd81b-651c-48c6-b781-438041d05c76 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:29.586400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abd81b-651c-48c6-b781-438041d05c76 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:29.588026 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35abd81b-651c-48c6-b781-438041d05c76 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:29.600406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1141/2277] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:31:29.604910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1de79-63cf-4fe1-9396-89f9f94cd17a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:29.615859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff1de79-63cf-4fe1-9396-89f9f94cd17a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:29.622742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df211a-48de-468b-b58b-baa8d0ef238c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:29.623396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df211a-48de-468b-b58b-baa8d0ef238c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:29.623672 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df211a-48de-468b-b58b-baa8d0ef238c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:29.623943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63df211a-48de-468b-b58b-baa8d0ef238c admin admin] PATH_INFO: `/v3/projects/39e26adf788f41b99c0a5a868de2b051/users/325d81d55f9c465e9034802adae93f24/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:29.626231 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df211a-48de-468b-b58b-baa8d0ef238c admin admin] RBAC: Authorizing `identity:create_grant(project_id=39e26adf788f41b99c0a5a868de2b051, user_id=325d81d55f9c465e9034802adae93f24, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:29.629015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63df211a-48de-468b-b58b-baa8d0ef238c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:29.639646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1137/2278] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:29 2022] PUT /identity/v3/projects/39e26adf788f41b99c0a5a868de2b051/users/325d81d55f9c465e9034802adae93f24/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:30.392177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dda33-7406-4929-a42b-75293cea9404 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:30.392755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dda33-7406-4929-a42b-75293cea9404 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:30.393148 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287dda33-7406-4929-a42b-75293cea9404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:30.436686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-287dda33-7406-4929-a42b-75293cea9404 None None] MFA Rules not processed for user `325d81d55f9c465e9034802adae93f24`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:30.438216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-287dda33-7406-4929-a42b-75293cea9404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:30.542986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1142/2279] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:30 2022] POST /identity/v3/auth/tokens => generated 3345 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:31.233948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df211a-48de-468b-b58b-baa8d0ef238c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:31.235733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-63df211a-48de-468b-b58b-baa8d0ef238c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:31.307099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63df211a-48de-468b-b58b-baa8d0ef238c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:31.311504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0843d-94d0-4cf5-893e-1c048a25d152 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:31.312266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0843d-94d0-4cf5-893e-1c048a25d152 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:31.312645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0843d-94d0-4cf5-893e-1c048a25d152 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:31.313020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b0843d-94d0-4cf5-893e-1c048a25d152 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:31.315502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-11b0843d-94d0-4cf5-893e-1c048a25d152 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:31.390925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0843d-94d0-4cf5-893e-1c048a25d152 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:31.393109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b0843d-94d0-4cf5-893e-1c048a25d152 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:31.407514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1138/2280] 10.222.0.16 () {60 vars in 1396 bytes} [Sat Sep 24 14:31:31 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3266 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:31.971078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dda33-7406-4929-a42b-75293cea9404 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:32.036682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287dda33-7406-4929-a42b-75293cea9404 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:32.041345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:32.041972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:32.042253 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:32.042531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] PATH_INFO: `/v3/users/f3b346037fdc4486a4eb97170939c000` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:32.043651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3b346037fdc4486a4eb97170939c000)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:32.045611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:32.095260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:32.097449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3b346037fdc4486a4eb97170939c000'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.098699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3b346037fdc4486a4eb97170939c000'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.099726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3b346037fdc4486a4eb97170939c000'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.107986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3b346037fdc4486a4eb97170939c000'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.121279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3b346037fdc4486a4eb97170939c000'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.137228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1143/2281] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:31 2022] DELETE /identity/v3/users/f3b346037fdc4486a4eb97170939c000 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:32.318371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0843d-94d0-4cf5-893e-1c048a25d152 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:32.339891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b0843d-94d0-4cf5-893e-1c048a25d152 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:32.399260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:32.399880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:32.400177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:32.400501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] PATH_INFO: `/v3/projects/dd80b918366e44ea86a387efe1685f88` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:32.401885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd80b918366e44ea86a387efe1685f88)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:32.403861 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:32.420918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:32.452630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd80b918366e44ea86a387efe1685f88', 'request_id': 'req-2ed97dc3-d9e5-462f-b8f7-a6e370579739'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.458606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd80b918366e44ea86a387efe1685f88', 'request_id': 'req-2ed97dc3-d9e5-462f-b8f7-a6e370579739'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.466187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd80b918366e44ea86a387efe1685f88', 'request_id': 'req-2ed97dc3-d9e5-462f-b8f7-a6e370579739'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.478196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] The token cache is being invalidate because project dd80b918366e44ea86a387efe1685f88 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:32.479130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.479807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.481337 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1139/2282] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:32 2022] DELETE /identity/v3/projects/dd80b918366e44ea86a387efe1685f88 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:32.486484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:32.487917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:32.501902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8909d5c-1767-4e06-9194-cb73e6a53576 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:32.558214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:32.558829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:32.559115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:32.559392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] PATH_INFO: `/v3/users/325d81d55f9c465e9034802adae93f24` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:32.560565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=325d81d55f9c465e9034802adae93f24)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:32.563760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:32.618586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '325d81d55f9c465e9034802adae93f24'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.619300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '325d81d55f9c465e9034802adae93f24'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.620019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '325d81d55f9c465e9034802adae93f24'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.628773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '325d81d55f9c465e9034802adae93f24'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.644690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6652d418-21bf-4b4e-957a-c8d5f2d330c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '325d81d55f9c465e9034802adae93f24'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:32.660205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1144/2283] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:32 2022] DELETE /identity/v3/users/325d81d55f9c465e9034802adae93f24 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:31:32.850594 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:32.852078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:32.868144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed97dc3-d9e5-462f-b8f7-a6e370579739 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:32.945847 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:32.946475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:32.946749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:32.947045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] PATH_INFO: `/v3/projects/39e26adf788f41b99c0a5a868de2b051` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:32.948335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] RBAC: Authorizing `identity:delete_project(project_id=39e26adf788f41b99c0a5a868de2b051)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:32.950242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:32.997070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39e26adf788f41b99c0a5a868de2b051', 'request_id': 'req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:33.002737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39e26adf788f41b99c0a5a868de2b051', 'request_id': 'req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:33.010879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39e26adf788f41b99c0a5a868de2b051', 'request_id': 'req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:33.022259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] The token cache is being invalidate because project 39e26adf788f41b99c0a5a868de2b051 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:33.022548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:33.023195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9ec6e330-7203-4fac-88f6-f29c54c4cf0a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:33.024716 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1140/2284] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:32 2022] DELETE /identity/v3/projects/39e26adf788f41b99c0a5a868de2b051 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:33.030343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb1b9-c2be-482f-b9aa-4e46c6c9c758 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.030851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb1b9-c2be-482f-b9aa-4e46c6c9c758 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.030963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20eb1b9-c2be-482f-b9aa-4e46c6c9c758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.050713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d20eb1b9-c2be-482f-b9aa-4e46c6c9c758 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:33.051948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d20eb1b9-c2be-482f-b9aa-4e46c6c9c758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:33.090359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:33.114602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1145/2285] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:33.122395 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a966161-0b2d-462d-aac2-8a1363a0f602 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.122673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a966161-0b2d-462d-aac2-8a1363a0f602 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.122950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a966161-0b2d-462d-aac2-8a1363a0f602 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.142951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0a966161-0b2d-462d-aac2-8a1363a0f602 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:33.144053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0a966161-0b2d-462d-aac2-8a1363a0f602 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:33.155129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1141/2286] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:33.159661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eb1b9-c2be-482f-b9aa-4e46c6c9c758 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.170059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20eb1b9-c2be-482f-b9aa-4e46c6c9c758 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.174727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d35eb-85d4-4d57-8e74-bdab3deba50e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.175322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d35eb-85d4-4d57-8e74-bdab3deba50e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.175607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d35eb-85d4-4d57-8e74-bdab3deba50e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.175886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38d35eb-85d4-4d57-8e74-bdab3deba50e admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.176565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d35eb-85d4-4d57-8e74-bdab3deba50e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:31:33.176897 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d35eb-85d4-4d57-8e74-bdab3deba50e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.178491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38d35eb-85d4-4d57-8e74-bdab3deba50e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.190544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1146/2287] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:31:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:31:33.195417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a966161-0b2d-462d-aac2-8a1363a0f602 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.205639 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a966161-0b2d-462d-aac2-8a1363a0f602 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.210738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ed918-cc8a-45da-93a1-48c6fccf6069 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.211454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ed918-cc8a-45da-93a1-48c6fccf6069 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.211878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ed918-cc8a-45da-93a1-48c6fccf6069 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.212304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-371ed918-cc8a-45da-93a1-48c6fccf6069 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.213038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ed918-cc8a-45da-93a1-48c6fccf6069 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.215091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-371ed918-cc8a-45da-93a1-48c6fccf6069 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.243174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1142/2288] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:33 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:33.248396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d35eb-85d4-4d57-8e74-bdab3deba50e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.258462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38d35eb-85d4-4d57-8e74-bdab3deba50e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.317331 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed28a6-7e64-4443-8f47-34301cefde78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.317935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed28a6-7e64-4443-8f47-34301cefde78 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.318216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed28a6-7e64-4443-8f47-34301cefde78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.318492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abed28a6-7e64-4443-8f47-34301cefde78 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.319119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed28a6-7e64-4443-8f47-34301cefde78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.321063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abed28a6-7e64-4443-8f47-34301cefde78 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.343019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1147/2289] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:33 2022] POST /identity/v3/users => generated 283 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:33.347330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ed918-cc8a-45da-93a1-48c6fccf6069 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.358368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-371ed918-cc8a-45da-93a1-48c6fccf6069 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.363031 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918df905-d0ed-487d-88c0-495f9509546c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.363630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df905-d0ed-487d-88c0-495f9509546c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.363916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df905-d0ed-487d-88c0-495f9509546c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.364221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-918df905-d0ed-487d-88c0-495f9509546c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.364865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918df905-d0ed-487d-88c0-495f9509546c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.366463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-918df905-d0ed-487d-88c0-495f9509546c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.367825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:33.379374 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1143/2290] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:33.383645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed28a6-7e64-4443-8f47-34301cefde78 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.393806 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abed28a6-7e64-4443-8f47-34301cefde78 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.399066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c196c2b-65c0-4539-9fac-837143f119c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.399671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196c2b-65c0-4539-9fac-837143f119c8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.399951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196c2b-65c0-4539-9fac-837143f119c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.400839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c196c2b-65c0-4539-9fac-837143f119c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.401507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196c2b-65c0-4539-9fac-837143f119c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.403126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c196c2b-65c0-4539-9fac-837143f119c8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.414350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1148/2291] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:33.419515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918df905-d0ed-487d-88c0-495f9509546c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.429496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-918df905-d0ed-487d-88c0-495f9509546c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.434125 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954bd9-f82c-4378-b05d-caaadb1ec954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.434766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954bd9-f82c-4378-b05d-caaadb1ec954 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.435048 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954bd9-f82c-4378-b05d-caaadb1ec954 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.435323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20954bd9-f82c-4378-b05d-caaadb1ec954 admin admin] PATH_INFO: `/v3/projects/e76229043b874ce8b840b82d5b0b1922/users/ee2ab6f25f3b47ee9b0cde6b672281c6/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.451298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20954bd9-f82c-4378-b05d-caaadb1ec954 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e76229043b874ce8b840b82d5b0b1922, user_id=ee2ab6f25f3b47ee9b0cde6b672281c6, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.454106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20954bd9-f82c-4378-b05d-caaadb1ec954 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.469400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1144/2292] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:33 2022] PUT /identity/v3/projects/e76229043b874ce8b840b82d5b0b1922/users/ee2ab6f25f3b47ee9b0cde6b672281c6/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:33.481385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d9f9e-fe22-498f-93ce-b811b75692ce None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.481780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d9f9e-fe22-498f-93ce-b811b75692ce None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.482159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59d9f9e-fe22-498f-93ce-b811b75692ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.510656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a59d9f9e-fe22-498f-93ce-b811b75692ce None None] MFA Rules not processed for user `ee2ab6f25f3b47ee9b0cde6b672281c6`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:33.511914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a59d9f9e-fe22-498f-93ce-b811b75692ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:33.576933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1149/2293] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:33 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:33.581895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954bd9-f82c-4378-b05d-caaadb1ec954 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.643652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20954bd9-f82c-4378-b05d-caaadb1ec954 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.648432 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda108d-5052-48c7-93b1-de5b37b57cf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.648981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda108d-5052-48c7-93b1-de5b37b57cf9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.649259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda108d-5052-48c7-93b1-de5b37b57cf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.649531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cda108d-5052-48c7-93b1-de5b37b57cf9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.650688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda108d-5052-48c7-93b1-de5b37b57cf9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.652647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cda108d-5052-48c7-93b1-de5b37b57cf9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.679477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1145/2294] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:33 2022] POST /identity/v3/projects => generated 365 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:33.684227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d9f9e-fe22-498f-93ce-b811b75692ce None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.694987 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59d9f9e-fe22-498f-93ce-b811b75692ce None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.730883 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:33.755738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b92325-c882-4506-b06b-25e2db459ced admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.756380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b92325-c882-4506-b06b-25e2db459ced admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.756665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b92325-c882-4506-b06b-25e2db459ced admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.756938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b92325-c882-4506-b06b-25e2db459ced admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.757577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b92325-c882-4506-b06b-25e2db459ced admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.760014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18b92325-c882-4506-b06b-25e2db459ced admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.781983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1150/2295] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:33 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:31:33.786171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda108d-5052-48c7-93b1-de5b37b57cf9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.796995 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cda108d-5052-48c7-93b1-de5b37b57cf9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.801775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccce5a-bcf7-4711-afdd-ea3f54504c5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.802373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccce5a-bcf7-4711-afdd-ea3f54504c5d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.802658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccce5a-bcf7-4711-afdd-ea3f54504c5d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.802927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ccce5a-bcf7-4711-afdd-ea3f54504c5d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.803573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccce5a-bcf7-4711-afdd-ea3f54504c5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.805223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ccce5a-bcf7-4711-afdd-ea3f54504c5d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.816112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1146/2296] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:33.820969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b92325-c882-4506-b06b-25e2db459ced admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.833066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b92325-c882-4506-b06b-25e2db459ced admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.841057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7373f1-0a93-4e6d-b3e8-fcf293e6a64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.842178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7373f1-0a93-4e6d-b3e8-fcf293e6a64e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.842700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7373f1-0a93-4e6d-b3e8-fcf293e6a64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.843180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7373f1-0a93-4e6d-b3e8-fcf293e6a64e admin admin] PATH_INFO: `/v3/projects/e8fd73adea4e4672a7957fc7ccef12bf/users/eef306e5a7e84099945921c20678cc98/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.868549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7373f1-0a93-4e6d-b3e8-fcf293e6a64e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fd73adea4e4672a7957fc7ccef12bf, user_id=eef306e5a7e84099945921c20678cc98, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.873103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d7373f1-0a93-4e6d-b3e8-fcf293e6a64e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.888050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1151/2297] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:33 2022] PUT /identity/v3/projects/e8fd73adea4e4672a7957fc7ccef12bf/users/eef306e5a7e84099945921c20678cc98/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:33.893320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccce5a-bcf7-4711-afdd-ea3f54504c5d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:33.904723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ccce5a-bcf7-4711-afdd-ea3f54504c5d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:33.974696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29c57ce-def3-4e75-a1a6-d26f130f22ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:33.975197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c57ce-def3-4e75-a1a6-d26f130f22ed admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:33.975598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c57ce-def3-4e75-a1a6-d26f130f22ed admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:33.976110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29c57ce-def3-4e75-a1a6-d26f130f22ed admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:33.976826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c57ce-def3-4e75-a1a6-d26f130f22ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:33.978996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29c57ce-def3-4e75-a1a6-d26f130f22ed admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:33.990872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1147/2298] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:33 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:33.995353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7373f1-0a93-4e6d-b3e8-fcf293e6a64e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:34.007367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d7373f1-0a93-4e6d-b3e8-fcf293e6a64e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:34.013334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf52d04-a641-4a3a-9f0a-0c121f1ac977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:34.014173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52d04-a641-4a3a-9f0a-0c121f1ac977 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:34.014554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52d04-a641-4a3a-9f0a-0c121f1ac977 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:34.015002 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf52d04-a641-4a3a-9f0a-0c121f1ac977 admin admin] PATH_INFO: `/v3/projects/e8fd73adea4e4672a7957fc7ccef12bf/users/eef306e5a7e84099945921c20678cc98/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:34.017468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf52d04-a641-4a3a-9f0a-0c121f1ac977 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8fd73adea4e4672a7957fc7ccef12bf, user_id=eef306e5a7e84099945921c20678cc98, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:34.020294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf52d04-a641-4a3a-9f0a-0c121f1ac977 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:34.032453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1152/2299] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:33 2022] PUT /identity/v3/projects/e8fd73adea4e4672a7957fc7ccef12bf/users/eef306e5a7e84099945921c20678cc98/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:34.043142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435f47-a90d-45c4-a40c-2a850929e4aa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:34.043427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435f47-a90d-45c4-a40c-2a850929e4aa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:34.043705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a435f47-a90d-45c4-a40c-2a850929e4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:34.070905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2a435f47-a90d-45c4-a40c-2a850929e4aa None None] MFA Rules not processed for user `eef306e5a7e84099945921c20678cc98`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:34.072680 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2a435f47-a90d-45c4-a40c-2a850929e4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:34.103497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:34.143230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1148/2300] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:34 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:34.154611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf52d04-a641-4a3a-9f0a-0c121f1ac977 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:34.156433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fdf52d04-a641-4a3a-9f0a-0c121f1ac977 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:34.214690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf52d04-a641-4a3a-9f0a-0c121f1ac977 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:34.218362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9a8b5-5704-4ecb-a150-4ef2d66d11d6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:34.218956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9a8b5-5704-4ecb-a150-4ef2d66d11d6 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:34.219236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9a8b5-5704-4ecb-a150-4ef2d66d11d6 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:34.219511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa9a8b5-5704-4ecb-a150-4ef2d66d11d6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:34.228619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9a8b5-5704-4ecb-a150-4ef2d66d11d6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:34.230032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa9a8b5-5704-4ecb-a150-4ef2d66d11d6 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:34.239315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1153/2301] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:34.319183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a435f47-a90d-45c4-a40c-2a850929e4aa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:34.328827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a435f47-a90d-45c4-a40c-2a850929e4aa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:34.332750 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04079108-bf90-4960-9bc7-74df01457e20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:34.333590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04079108-bf90-4960-9bc7-74df01457e20 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:34.333965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04079108-bf90-4960-9bc7-74df01457e20 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:34.334371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04079108-bf90-4960-9bc7-74df01457e20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:34.396091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04079108-bf90-4960-9bc7-74df01457e20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:34.397568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04079108-bf90-4960-9bc7-74df01457e20 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:34.407000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1149/2302] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:34 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:41.524717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9a8b5-5704-4ecb-a150-4ef2d66d11d6 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:41.708727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa9a8b5-5704-4ecb-a150-4ef2d66d11d6 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:41.713824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:41.714452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:41.714913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:41.715192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] PATH_INFO: `/v3/users/ee2ab6f25f3b47ee9b0cde6b672281c6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:41.716429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ee2ab6f25f3b47ee9b0cde6b672281c6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:41.718338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:41.757290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:41.769411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ee2ab6f25f3b47ee9b0cde6b672281c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:41.770173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ee2ab6f25f3b47ee9b0cde6b672281c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:41.770853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ee2ab6f25f3b47ee9b0cde6b672281c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:41.778656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ee2ab6f25f3b47ee9b0cde6b672281c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:41.792392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ee2ab6f25f3b47ee9b0cde6b672281c6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:41.811334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1154/2303] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:41 2022] DELETE /identity/v3/users/ee2ab6f25f3b47ee9b0cde6b672281c6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:41.816105 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1739df-206c-497c-87cb-1b1c73464a33 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:41.816699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1739df-206c-497c-87cb-1b1c73464a33 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:41.816699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1739df-206c-497c-87cb-1b1c73464a33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:41.835896 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0c1739df-206c-497c-87cb-1b1c73464a33 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:41.837153 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0c1739df-206c-497c-87cb-1b1c73464a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:41.896540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1150/2304] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:41.907370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:41.908840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:41.969065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd344db7-3dad-405b-a422-43757ac9b628 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:41.972567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331e60f-0e38-4a42-b5de-97525531fb03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:41.973165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331e60f-0e38-4a42-b5de-97525531fb03 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:41.973441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331e60f-0e38-4a42-b5de-97525531fb03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:41.973711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b331e60f-0e38-4a42-b5de-97525531fb03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:41.983326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331e60f-0e38-4a42-b5de-97525531fb03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:41.984799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b331e60f-0e38-4a42-b5de-97525531fb03 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:41.994898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1155/2305] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:41 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:42.362895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1739df-206c-497c-87cb-1b1c73464a33 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:42.364416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0c1739df-206c-497c-87cb-1b1c73464a33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:42.377050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1739df-206c-497c-87cb-1b1c73464a33 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:42.387504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:42.388502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:42.388920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:42.389336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] PATH_INFO: `/v3/projects/e76229043b874ce8b840b82d5b0b1922` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:42.390837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e76229043b874ce8b840b82d5b0b1922)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:42.392888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:42.441187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e76229043b874ce8b840b82d5b0b1922', 'request_id': 'req-6af42475-327d-46ef-9427-24663bfbc602'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:42.446944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e76229043b874ce8b840b82d5b0b1922', 'request_id': 'req-6af42475-327d-46ef-9427-24663bfbc602'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:42.449643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:42.455501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e76229043b874ce8b840b82d5b0b1922', 'request_id': 'req-6af42475-327d-46ef-9427-24663bfbc602'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:42.470591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] The token cache is being invalidate because project e76229043b874ce8b840b82d5b0b1922 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:42.470993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:42.471734 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:42.473350 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1151/2306] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:42 2022] DELETE /identity/v3/projects/e76229043b874ce8b840b82d5b0b1922 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:42.479318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331e60f-0e38-4a42-b5de-97525531fb03 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:42.489238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b331e60f-0e38-4a42-b5de-97525531fb03 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:42.546254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:42.546918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:42.547051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:42.547324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] PATH_INFO: `/v3/users/eef306e5a7e84099945921c20678cc98` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:42.548481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef306e5a7e84099945921c20678cc98)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:42.550368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:42.595411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef306e5a7e84099945921c20678cc98'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:42.596064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef306e5a7e84099945921c20678cc98'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:42.596733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef306e5a7e84099945921c20678cc98'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:42.603974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef306e5a7e84099945921c20678cc98'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:42.605216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:42.619791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-124ac9c5-b816-4943-86ab-bb7452e0f843 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef306e5a7e84099945921c20678cc98'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:42.633626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1156/2307] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:42 2022] DELETE /identity/v3/users/eef306e5a7e84099945921c20678cc98 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:42.940620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:42.942070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:42.957730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af42475-327d-46ef-9427-24663bfbc602 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:43.030612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:43.031289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.031746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.032033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] PATH_INFO: `/v3/projects/e8fd73adea4e4672a7957fc7ccef12bf` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.033814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8fd73adea4e4672a7957fc7ccef12bf)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:43.035227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:43.093052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8fd73adea4e4672a7957fc7ccef12bf', 'request_id': 'req-9a519730-b23c-4690-833b-6f7f56b5a800'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:43.100061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8fd73adea4e4672a7957fc7ccef12bf', 'request_id': 'req-9a519730-b23c-4690-833b-6f7f56b5a800'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:43.110301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8fd73adea4e4672a7957fc7ccef12bf', 'request_id': 'req-9a519730-b23c-4690-833b-6f7f56b5a800'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:43.134058 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] The token cache is being invalidate because project e8fd73adea4e4672a7957fc7ccef12bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:43.134354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:43.135022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9a519730-b23c-4690-833b-6f7f56b5a800 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:43.136797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1152/2308] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:42 2022] DELETE /identity/v3/projects/e8fd73adea4e4672a7957fc7ccef12bf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:31:43.142484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e803-12fb-43a5-84ea-2d7d5014c513 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.142938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e803-12fb-43a5-84ea-2d7d5014c513 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.143374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaa0e803-12fb-43a5-84ea-2d7d5014c513 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.175358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-aaa0e803-12fb-43a5-84ea-2d7d5014c513 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:43.176675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aaa0e803-12fb-43a5-84ea-2d7d5014c513 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:43.264124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1157/2309] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:31:43.274088 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1656-c384-4bce-907b-8d9fd137f5f4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.274373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1656-c384-4bce-907b-8d9fd137f5f4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.276399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ad1656-c384-4bce-907b-8d9fd137f5f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.295205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a32d5-b90c-4e1a-93b0-bd564f4c8793 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.295713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a32d5-b90c-4e1a-93b0-bd564f4c8793 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.296247 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309a32d5-b90c-4e1a-93b0-bd564f4c8793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.308975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-95ad1656-c384-4bce-907b-8d9fd137f5f4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:43.310260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-95ad1656-c384-4bce-907b-8d9fd137f5f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:43.321178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1153/2310] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:31:43.325920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad1656-c384-4bce-907b-8d9fd137f5f4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:43.326116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-309a32d5-b90c-4e1a-93b0-bd564f4c8793 None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:43.327274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-309a32d5-b90c-4e1a-93b0-bd564f4c8793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:43.335906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ad1656-c384-4bce-907b-8d9fd137f5f4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:43.341274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b803d9c-ac9a-4e3c-9c9c-7b8e3cae8036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:43.342213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b803d9c-ac9a-4e3c-9c9c-7b8e3cae8036 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.342213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b803d9c-ac9a-4e3c-9c9c-7b8e3cae8036 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.342502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b803d9c-ac9a-4e3c-9c9c-7b8e3cae8036 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.343155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b803d9c-ac9a-4e3c-9c9c-7b8e3cae8036 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:31:43.343398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b803d9c-ac9a-4e3c-9c9c-7b8e3cae8036 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:43.345051 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b803d9c-ac9a-4e3c-9c9c-7b8e3cae8036 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:43.363207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1154/2311] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:31:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:31:43.367355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b803d9c-ac9a-4e3c-9c9c-7b8e3cae8036 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:43.378432 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b803d9c-ac9a-4e3c-9c9c-7b8e3cae8036 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:43.383993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6992e4-7541-464c-9081-8156057d6b6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:43.384820 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6992e4-7541-464c-9081-8156057d6b6f admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.385241 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6992e4-7541-464c-9081-8156057d6b6f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.385657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f6992e4-7541-464c-9081-8156057d6b6f admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.388742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6992e4-7541-464c-9081-8156057d6b6f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:43.390897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f6992e4-7541-464c-9081-8156057d6b6f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:43.391521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1158/2312] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:31:43 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:31:43.437099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1155/2313] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:43 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:31:43.438251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a32d5-b90c-4e1a-93b0-bd564f4c8793 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:43.453825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309a32d5-b90c-4e1a-93b0-bd564f4c8793 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:43.469892 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6992e4-7541-464c-9081-8156057d6b6f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:43.474356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8f6992e4-7541-464c-9081-8156057d6b6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:43.553624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085ed50-318d-4402-95a5-e6c38de75a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:43.554484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085ed50-318d-4402-95a5-e6c38de75a47 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.555223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085ed50-318d-4402-95a5-e6c38de75a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.555805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2085ed50-318d-4402-95a5-e6c38de75a47 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.557145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085ed50-318d-4402-95a5-e6c38de75a47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:43.563487 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:43.565909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2085ed50-318d-4402-95a5-e6c38de75a47 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:43.599980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f6992e4-7541-464c-9081-8156057d6b6f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:43.608492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279aafc-e612-4d28-8ffb-e52cd2f68ef3 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:43.609145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279aafc-e612-4d28-8ffb-e52cd2f68ef3 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.609412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279aafc-e612-4d28-8ffb-e52cd2f68ef3 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.610225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9279aafc-e612-4d28-8ffb-e52cd2f68ef3 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.622780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1159/2314] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:43 2022] POST /identity/v3/users => generated 292 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:43.623968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085ed50-318d-4402-95a5-e6c38de75a47 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:43.637856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2085ed50-318d-4402-95a5-e6c38de75a47 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:43.655319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc19e6-b6dd-46d7-ad00-040542545fa8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:43.656942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc19e6-b6dd-46d7-ad00-040542545fa8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.657675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc19e6-b6dd-46d7-ad00-040542545fa8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.659407 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89bc19e6-b6dd-46d7-ad00-040542545fa8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.670706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc19e6-b6dd-46d7-ad00-040542545fa8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:43.670706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89bc19e6-b6dd-46d7-ad00-040542545fa8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:43.674306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:43.696316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1160/2315] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:31:43.697777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279aafc-e612-4d28-8ffb-e52cd2f68ef3 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:43.699617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9279aafc-e612-4d28-8ffb-e52cd2f68ef3 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:43.701097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc19e6-b6dd-46d7-ad00-040542545fa8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:43.710766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1156/2316] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:31:43.715115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89bc19e6-b6dd-46d7-ad00-040542545fa8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:43.724019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720bf0a7-adc4-41c9-b447-644145657beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:43.725398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf0a7-adc4-41c9-b447-644145657beb admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.725398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf0a7-adc4-41c9-b447-644145657beb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.725398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720bf0a7-adc4-41c9-b447-644145657beb admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.726053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bf0a7-adc4-41c9-b447-644145657beb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:43.728189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720bf0a7-adc4-41c9-b447-644145657beb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:43.755865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1161/2317] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:43.756789 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279aafc-e612-4d28-8ffb-e52cd2f68ef3 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:43.769681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9279aafc-e612-4d28-8ffb-e52cd2f68ef3 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:43.783971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a774b17-41fe-4fb2-9659-6b75dc1632eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:43.784708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a774b17-41fe-4fb2-9659-6b75dc1632eb admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.784984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a774b17-41fe-4fb2-9659-6b75dc1632eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.785257 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a774b17-41fe-4fb2-9659-6b75dc1632eb admin admin] PATH_INFO: `/v3/projects/48af5a51670e444fae692a7e91599b7d/users/775323d57db941c596155b520da55d3a/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.806853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a774b17-41fe-4fb2-9659-6b75dc1632eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=48af5a51670e444fae692a7e91599b7d, user_id=775323d57db941c596155b520da55d3a, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:43.810120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a774b17-41fe-4fb2-9659-6b75dc1632eb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:43.826122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1157/2318] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:43 2022] PUT /identity/v3/projects/48af5a51670e444fae692a7e91599b7d/users/775323d57db941c596155b520da55d3a/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:43.838548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6760d9-766e-4766-ad08-914b02abab07 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:43.838903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6760d9-766e-4766-ad08-914b02abab07 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:43.839093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6760d9-766e-4766-ad08-914b02abab07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:43.871954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-aa6760d9-766e-4766-ad08-914b02abab07 None None] MFA Rules not processed for user `775323d57db941c596155b520da55d3a`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:43.873129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-aa6760d9-766e-4766-ad08-914b02abab07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:43.945904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1162/2319] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:43 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:43.950489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a774b17-41fe-4fb2-9659-6b75dc1632eb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:44.026312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a774b17-41fe-4fb2-9659-6b75dc1632eb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:44.031141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff17cc-1729-4ab6-9dab-edaa2bb05974 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:44.031754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff17cc-1729-4ab6-9dab-edaa2bb05974 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:44.034144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff17cc-1729-4ab6-9dab-edaa2bb05974 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:44.034438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff17cc-1729-4ab6-9dab-edaa2bb05974 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:44.035180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff17cc-1729-4ab6-9dab-edaa2bb05974 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:44.037232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff17cc-1729-4ab6-9dab-edaa2bb05974 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:44.069595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1158/2320] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:43 2022] POST /identity/v3/projects => generated 387 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:44.073399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6760d9-766e-4766-ad08-914b02abab07 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:44.085161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6760d9-766e-4766-ad08-914b02abab07 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:44.155242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb432a08-3fe6-4cd2-a169-ab4f87cff6c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:44.156090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb432a08-3fe6-4cd2-a169-ab4f87cff6c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:44.156472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb432a08-3fe6-4cd2-a169-ab4f87cff6c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:44.156808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb432a08-3fe6-4cd2-a169-ab4f87cff6c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:44.157534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb432a08-3fe6-4cd2-a169-ab4f87cff6c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:44.159745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb432a08-3fe6-4cd2-a169-ab4f87cff6c9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:44.185798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1163/2321] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:44 2022] POST /identity/v3/users => generated 300 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:31:44.189736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff17cc-1729-4ab6-9dab-edaa2bb05974 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:44.201400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff17cc-1729-4ab6-9dab-edaa2bb05974 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:44.209110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4a7b3-416a-42e8-8299-7a9fd7b6586f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:44.209726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a7b3-416a-42e8-8299-7a9fd7b6586f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:44.210010 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a7b3-416a-42e8-8299-7a9fd7b6586f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:44.210293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc4a7b3-416a-42e8-8299-7a9fd7b6586f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:44.210948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4a7b3-416a-42e8-8299-7a9fd7b6586f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:44.212783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc4a7b3-416a-42e8-8299-7a9fd7b6586f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:44.229302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1159/2322] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:44.230847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb432a08-3fe6-4cd2-a169-ab4f87cff6c9 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:44.241638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb432a08-3fe6-4cd2-a169-ab4f87cff6c9 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:44.246759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a475-b4b9-4609-b0af-64ebf3652087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:44.247503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a475-b4b9-4609-b0af-64ebf3652087 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:44.247852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a475-b4b9-4609-b0af-64ebf3652087 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:44.248225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8204a475-b4b9-4609-b0af-64ebf3652087 admin admin] PATH_INFO: `/v3/projects/af6ea240f31e4230a19b2b1d9c8c7ef7/users/42dd7bc2cae741ebb976a3bd6b4838ac/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:44.265788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204a475-b4b9-4609-b0af-64ebf3652087 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6ea240f31e4230a19b2b1d9c8c7ef7, user_id=42dd7bc2cae741ebb976a3bd6b4838ac, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:44.268630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8204a475-b4b9-4609-b0af-64ebf3652087 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:44.288548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1164/2323] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:44 2022] PUT /identity/v3/projects/af6ea240f31e4230a19b2b1d9c8c7ef7/users/42dd7bc2cae741ebb976a3bd6b4838ac/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:44.289667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4a7b3-416a-42e8-8299-7a9fd7b6586f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:44.301193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc4a7b3-416a-42e8-8299-7a9fd7b6586f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:44.333189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:44.368674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac828b-a483-4983-92d6-a261a5377488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:44.369398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac828b-a483-4983-92d6-a261a5377488 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:44.369677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac828b-a483-4983-92d6-a261a5377488 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:44.369952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac828b-a483-4983-92d6-a261a5377488 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:44.370600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac828b-a483-4983-92d6-a261a5377488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:44.372607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac828b-a483-4983-92d6-a261a5377488 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:44.385099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1160/2324] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:44 2022] GET /identity/v3/roles => generated 1420 bytes in 96 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:44.389206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a475-b4b9-4609-b0af-64ebf3652087 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:44.399951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8204a475-b4b9-4609-b0af-64ebf3652087 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:44.406967 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb9bdf-bdfd-4365-8654-2fde8e49414e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:44.407754 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb9bdf-bdfd-4365-8654-2fde8e49414e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:44.408326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb9bdf-bdfd-4365-8654-2fde8e49414e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:44.408767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3deb9bdf-bdfd-4365-8654-2fde8e49414e admin admin] PATH_INFO: `/v3/projects/af6ea240f31e4230a19b2b1d9c8c7ef7/users/42dd7bc2cae741ebb976a3bd6b4838ac/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:44.410775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb9bdf-bdfd-4365-8654-2fde8e49414e admin admin] RBAC: Authorizing `identity:create_grant(project_id=af6ea240f31e4230a19b2b1d9c8c7ef7, user_id=42dd7bc2cae741ebb976a3bd6b4838ac, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:44.413662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3deb9bdf-bdfd-4365-8654-2fde8e49414e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:44.435408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1165/2325] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:44 2022] PUT /identity/v3/projects/af6ea240f31e4230a19b2b1d9c8c7ef7/users/42dd7bc2cae741ebb976a3bd6b4838ac/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:31:44.438378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965cb91-d08b-44d7-b68f-4b61f76d3fcc None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:44.438895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965cb91-d08b-44d7-b68f-4b61f76d3fcc None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:44.439290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a965cb91-d08b-44d7-b68f-4b61f76d3fcc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:44.471643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a965cb91-d08b-44d7-b68f-4b61f76d3fcc None None] MFA Rules not processed for user `42dd7bc2cae741ebb976a3bd6b4838ac`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:44.472928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a965cb91-d08b-44d7-b68f-4b61f76d3fcc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:44.552932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1161/2326] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:44.567030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb9bdf-bdfd-4365-8654-2fde8e49414e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:44.569362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3deb9bdf-bdfd-4365-8654-2fde8e49414e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:44.605263 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:44.637054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3deb9bdf-bdfd-4365-8654-2fde8e49414e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:44.643544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672e0d7a-a4f3-47d0-b6d8-e2e277a71995 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:44.644491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e0d7a-a4f3-47d0-b6d8-e2e277a71995 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:44.644983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e0d7a-a4f3-47d0-b6d8-e2e277a71995 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:44.645437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672e0d7a-a4f3-47d0-b6d8-e2e277a71995 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:44.656491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e0d7a-a4f3-47d0-b6d8-e2e277a71995 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:44.658036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672e0d7a-a4f3-47d0-b6d8-e2e277a71995 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:44.669803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1166/2327] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:44 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:44.747194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965cb91-d08b-44d7-b68f-4b61f76d3fcc None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:44.850490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a965cb91-d08b-44d7-b68f-4b61f76d3fcc None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:44.858364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:44.859155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:44.859437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:44.859711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] PATH_INFO: `/v3/users/775323d57db941c596155b520da55d3a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:44.861001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] RBAC: Authorizing `identity:delete_user(user_id=775323d57db941c596155b520da55d3a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:44.863001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:44.939153 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '775323d57db941c596155b520da55d3a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:44.940065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '775323d57db941c596155b520da55d3a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:44.946229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:44.957377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '775323d57db941c596155b520da55d3a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:44.958161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '775323d57db941c596155b520da55d3a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:44.970151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '775323d57db941c596155b520da55d3a'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:44.991586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1162/2328] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:44 2022] DELETE /identity/v3/users/775323d57db941c596155b520da55d3a => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:44.996405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0cce-a815-4c3b-9e28-9c809a591c5d None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:44.996690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0cce-a815-4c3b-9e28-9c809a591c5d None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:44.996973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4e0cce-a815-4c3b-9e28-9c809a591c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:45.019068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9a4e0cce-a815-4c3b-9e28-9c809a591c5d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:45.020405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9a4e0cce-a815-4c3b-9e28-9c809a591c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:45.112285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1167/2329] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:45.126947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:45.128850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:45.204826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9274240f-e601-4987-94b4-f079ab972151 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:45.209144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45805d23-5d50-4638-83ea-35cc3fb7223b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:45.209961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45805d23-5d50-4638-83ea-35cc3fb7223b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:45.210333 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45805d23-5d50-4638-83ea-35cc3fb7223b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:45.210742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45805d23-5d50-4638-83ea-35cc3fb7223b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:45.224335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45805d23-5d50-4638-83ea-35cc3fb7223b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:45.226090 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45805d23-5d50-4638-83ea-35cc3fb7223b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:45.246392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1163/2330] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:45.590287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e0cce-a815-4c3b-9e28-9c809a591c5d None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:45.592861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9a4e0cce-a815-4c3b-9e28-9c809a591c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:45.616373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4e0cce-a815-4c3b-9e28-9c809a591c5d None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:45.624423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:45.625651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:45.626188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:45.626477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] PATH_INFO: `/v3/projects/48af5a51670e444fae692a7e91599b7d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:45.627940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=48af5a51670e444fae692a7e91599b7d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:45.630019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:45.696554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '48af5a51670e444fae692a7e91599b7d', 'request_id': 'req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:45.704868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '48af5a51670e444fae692a7e91599b7d', 'request_id': 'req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:45.711861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '48af5a51670e444fae692a7e91599b7d', 'request_id': 'req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:45.729189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] The token cache is being invalidate because project 48af5a51670e444fae692a7e91599b7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:45.729723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:45.730479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:45.732095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1168/2331] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:45 2022] DELETE /identity/v3/projects/48af5a51670e444fae692a7e91599b7d => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:45.736096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45805d23-5d50-4638-83ea-35cc3fb7223b service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:45.748451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45805d23-5d50-4638-83ea-35cc3fb7223b service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:45.811758 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:45.812560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:45.812840 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:45.813114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] PATH_INFO: `/v3/users/42dd7bc2cae741ebb976a3bd6b4838ac` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:45.814232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] RBAC: Authorizing `identity:delete_user(user_id=42dd7bc2cae741ebb976a3bd6b4838ac)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:45.816174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:45.898150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42dd7bc2cae741ebb976a3bd6b4838ac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:45.899278 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42dd7bc2cae741ebb976a3bd6b4838ac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:45.919679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42dd7bc2cae741ebb976a3bd6b4838ac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:45.920771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42dd7bc2cae741ebb976a3bd6b4838ac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:45.932803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-14eccaf7-9b58-45c6-b5f2-051230cb44de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42dd7bc2cae741ebb976a3bd6b4838ac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:45.934825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=12,keystone:SELECT=87,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:45.963804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1164/2332] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:45 2022] DELETE /identity/v3/users/42dd7bc2cae741ebb976a3bd6b4838ac => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:46.286063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:46.290159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:46.304145 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed97ac3-85e9-4b02-a6a4-1d8937ba93bf admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:46.396509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:46.409182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:46.410162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:46.410800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:46.411319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] PATH_INFO: `/v3/projects/af6ea240f31e4230a19b2b1d9c8c7ef7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:46.412559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af6ea240f31e4230a19b2b1d9c8c7ef7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:46.414687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:46.467767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af6ea240f31e4230a19b2b1d9c8c7ef7', 'request_id': 'req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:46.480996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af6ea240f31e4230a19b2b1d9c8c7ef7', 'request_id': 'req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:46.487620 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af6ea240f31e4230a19b2b1d9c8c7ef7', 'request_id': 'req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:46.504035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] The token cache is being invalidate because project af6ea240f31e4230a19b2b1d9c8c7ef7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:46.504377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:46.505245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-57f685c9-c56d-42ea-b9b2-e33fbe7bd785 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:46.506927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1169/2333] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:46 2022] DELETE /identity/v3/projects/af6ea240f31e4230a19b2b1d9c8c7ef7 => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:46.512390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22405ed-19cd-4f3e-8a3a-0fb77488e4ea None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:46.512793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22405ed-19cd-4f3e-8a3a-0fb77488e4ea None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:46.513216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f22405ed-19cd-4f3e-8a3a-0fb77488e4ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:46.537331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f22405ed-19cd-4f3e-8a3a-0fb77488e4ea None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:46.538804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f22405ed-19cd-4f3e-8a3a-0fb77488e4ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:46.607704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1165/2334] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:46.615504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1097fa-aa5e-4672-afae-66e03b8097b9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:46.616018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1097fa-aa5e-4672-afae-66e03b8097b9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:46.616140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1097fa-aa5e-4672-afae-66e03b8097b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:46.641526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3d1097fa-aa5e-4672-afae-66e03b8097b9 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:46.642859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3d1097fa-aa5e-4672-afae-66e03b8097b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:46.651752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1170/2335] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:46.656381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22405ed-19cd-4f3e-8a3a-0fb77488e4ea None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:46.667134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f22405ed-19cd-4f3e-8a3a-0fb77488e4ea None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:46.672188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af77ed-91a2-446d-92f4-22990112258b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:46.672802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af77ed-91a2-446d-92f4-22990112258b admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:46.673080 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af77ed-91a2-446d-92f4-22990112258b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:46.673353 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85af77ed-91a2-446d-92f4-22990112258b admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:46.674007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af77ed-91a2-446d-92f4-22990112258b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:31:46.674314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af77ed-91a2-446d-92f4-22990112258b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:46.675955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85af77ed-91a2-446d-92f4-22990112258b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:46.696620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1166/2336] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:31:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:31:46.698360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1097fa-aa5e-4672-afae-66e03b8097b9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:46.708399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1097fa-aa5e-4672-afae-66e03b8097b9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:46.713158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6379b06-13c7-4924-9b49-71a642bd3499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:46.714030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6379b06-13c7-4924-9b49-71a642bd3499 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:46.714498 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6379b06-13c7-4924-9b49-71a642bd3499 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:46.714892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6379b06-13c7-4924-9b49-71a642bd3499 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:46.715880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6379b06-13c7-4924-9b49-71a642bd3499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:46.718520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6379b06-13c7-4924-9b49-71a642bd3499 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:46.753429 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1171/2337] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:46 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:46.754638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af77ed-91a2-446d-92f4-22990112258b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:46.767545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85af77ed-91a2-446d-92f4-22990112258b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:46.834913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674a0ba-7178-4539-b7bf-91bb4a35427f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:46.835583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674a0ba-7178-4539-b7bf-91bb4a35427f admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:46.835859 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674a0ba-7178-4539-b7bf-91bb4a35427f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:46.836131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b674a0ba-7178-4539-b7bf-91bb4a35427f admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:46.836899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674a0ba-7178-4539-b7bf-91bb4a35427f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:46.838919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b674a0ba-7178-4539-b7bf-91bb4a35427f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:46.866643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1167/2338] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:46 2022] POST /identity/v3/users => generated 294 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:31:46.871115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6379b06-13c7-4924-9b49-71a642bd3499 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:46.886486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6379b06-13c7-4924-9b49-71a642bd3499 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:46.891507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d3b40-5669-4dc8-b95d-17be15c6d66d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:46.892133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3b40-5669-4dc8-b95d-17be15c6d66d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:46.892445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3b40-5669-4dc8-b95d-17be15c6d66d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:46.892733 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d3b40-5669-4dc8-b95d-17be15c6d66d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:46.893383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d3b40-5669-4dc8-b95d-17be15c6d66d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:46.894991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d3b40-5669-4dc8-b95d-17be15c6d66d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:46.906899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1172/2339] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:31:46.910843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674a0ba-7178-4539-b7bf-91bb4a35427f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:46.921979 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b674a0ba-7178-4539-b7bf-91bb4a35427f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:46.929503 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1ad0be-a5e9-4d3d-a277-d31c9c517fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:46.930120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ad0be-a5e9-4d3d-a277-d31c9c517fa5 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:46.930399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ad0be-a5e9-4d3d-a277-d31c9c517fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:46.930705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1ad0be-a5e9-4d3d-a277-d31c9c517fa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:46.931364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ad0be-a5e9-4d3d-a277-d31c9c517fa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:46.933155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1ad0be-a5e9-4d3d-a277-d31c9c517fa5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:46.951344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1168/2340] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:46 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:46.953526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d3b40-5669-4dc8-b95d-17be15c6d66d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:46.965033 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d3b40-5669-4dc8-b95d-17be15c6d66d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:46.970179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7996d-d813-42cc-bf53-d489f2de7e31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:46.970836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7996d-d813-42cc-bf53-d489f2de7e31 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:46.971118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7996d-d813-42cc-bf53-d489f2de7e31 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:46.971395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee7996d-d813-42cc-bf53-d489f2de7e31 admin admin] PATH_INFO: `/v3/projects/cea72947f5444baeb6e4cee5233a6532/users/9911bdd340fb4171a55e0a1622af6d82/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:46.986911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7996d-d813-42cc-bf53-d489f2de7e31 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cea72947f5444baeb6e4cee5233a6532, user_id=9911bdd340fb4171a55e0a1622af6d82, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:46.989581 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee7996d-d813-42cc-bf53-d489f2de7e31 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:47.003530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1173/2341] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:46 2022] PUT /identity/v3/projects/cea72947f5444baeb6e4cee5233a6532/users/9911bdd340fb4171a55e0a1622af6d82/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:47.015052 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594814-706c-4d75-9107-7619d6cf852a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:47.015484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594814-706c-4d75-9107-7619d6cf852a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:47.015750 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e594814-706c-4d75-9107-7619d6cf852a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:47.052789 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5e594814-706c-4d75-9107-7619d6cf852a None None] MFA Rules not processed for user `9911bdd340fb4171a55e0a1622af6d82`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:47.054138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5e594814-706c-4d75-9107-7619d6cf852a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:47.107486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:47.134046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1169/2342] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:47 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:47.138231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7996d-d813-42cc-bf53-d489f2de7e31 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:47.226521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee7996d-d813-42cc-bf53-d489f2de7e31 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:47.232436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c334b3-496b-4178-a937-81fb9fdcfed0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:47.233221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c334b3-496b-4178-a937-81fb9fdcfed0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:47.233776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c334b3-496b-4178-a937-81fb9fdcfed0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:47.234204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c334b3-496b-4178-a937-81fb9fdcfed0 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:47.235001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c334b3-496b-4178-a937-81fb9fdcfed0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:47.237114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c334b3-496b-4178-a937-81fb9fdcfed0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:47.281419 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1174/2343] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:47 2022] POST /identity/v3/projects => generated 385 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:47.283415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e594814-706c-4d75-9107-7619d6cf852a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:47.303316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e594814-706c-4d75-9107-7619d6cf852a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:47.397216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b354-8c0e-4f8b-a948-5c5104b44b8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:47.398122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b354-8c0e-4f8b-a948-5c5104b44b8b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:47.398586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b354-8c0e-4f8b-a948-5c5104b44b8b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:47.399027 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c4b354-8c0e-4f8b-a948-5c5104b44b8b admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:47.399754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b354-8c0e-4f8b-a948-5c5104b44b8b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:47.401795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c4b354-8c0e-4f8b-a948-5c5104b44b8b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:47.427045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1170/2344] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:47 2022] POST /identity/v3/users => generated 299 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:31:47.432467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c334b3-496b-4178-a937-81fb9fdcfed0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:47.443475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c334b3-496b-4178-a937-81fb9fdcfed0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:47.449355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357daff8-7cd4-4297-acc7-e4ddbe9ed64e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:47.449961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357daff8-7cd4-4297-acc7-e4ddbe9ed64e admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:47.450249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357daff8-7cd4-4297-acc7-e4ddbe9ed64e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:47.450556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-357daff8-7cd4-4297-acc7-e4ddbe9ed64e admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:47.451173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357daff8-7cd4-4297-acc7-e4ddbe9ed64e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:47.452840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-357daff8-7cd4-4297-acc7-e4ddbe9ed64e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:47.459210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:47.478266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1175/2345] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:47.486615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b354-8c0e-4f8b-a948-5c5104b44b8b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:47.497714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c4b354-8c0e-4f8b-a948-5c5104b44b8b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:47.502577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94c651-b94c-4b78-b68e-edd3a0ee3a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:47.503237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94c651-b94c-4b78-b68e-edd3a0ee3a26 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:47.503513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94c651-b94c-4b78-b68e-edd3a0ee3a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:47.503790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d94c651-b94c-4b78-b68e-edd3a0ee3a26 admin admin] PATH_INFO: `/v3/projects/1860915d5cbf489da26e4b2d7c66af4f/users/661b8245393a4c11842840e1c5fb267f/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:47.523119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94c651-b94c-4b78-b68e-edd3a0ee3a26 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1860915d5cbf489da26e4b2d7c66af4f, user_id=661b8245393a4c11842840e1c5fb267f, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:47.526779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d94c651-b94c-4b78-b68e-edd3a0ee3a26 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:47.542247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1171/2346] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:47 2022] PUT /identity/v3/projects/1860915d5cbf489da26e4b2d7c66af4f/users/661b8245393a4c11842840e1c5fb267f/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:47.546063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357daff8-7cd4-4297-acc7-e4ddbe9ed64e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:47.556040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-357daff8-7cd4-4297-acc7-e4ddbe9ed64e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:47.621203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f6ef24-5996-47fa-9ad3-c474b7741ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:47.621907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ef24-5996-47fa-9ad3-c474b7741ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:47.622101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ef24-5996-47fa-9ad3-c474b7741ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:47.622375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f6ef24-5996-47fa-9ad3-c474b7741ba8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:47.623018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6ef24-5996-47fa-9ad3-c474b7741ba8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:47.624678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f6ef24-5996-47fa-9ad3-c474b7741ba8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:47.636350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1176/2347] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:47 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:47.640405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94c651-b94c-4b78-b68e-edd3a0ee3a26 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:47.651077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d94c651-b94c-4b78-b68e-edd3a0ee3a26 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:47.655906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9bc0-ed11-467f-ba02-b818d546783c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:47.656714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9bc0-ed11-467f-ba02-b818d546783c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:47.657097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9bc0-ed11-467f-ba02-b818d546783c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:47.657470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454a9bc0-ed11-467f-ba02-b818d546783c admin admin] PATH_INFO: `/v3/projects/1860915d5cbf489da26e4b2d7c66af4f/users/661b8245393a4c11842840e1c5fb267f/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:47.659637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a9bc0-ed11-467f-ba02-b818d546783c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1860915d5cbf489da26e4b2d7c66af4f, user_id=661b8245393a4c11842840e1c5fb267f, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:47.662375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454a9bc0-ed11-467f-ba02-b818d546783c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:47.674343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1172/2348] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:47 2022] PUT /identity/v3/projects/1860915d5cbf489da26e4b2d7c66af4f/users/661b8245393a4c11842840e1c5fb267f/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:47.687385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceed699-a8a6-4fb3-bbe0-5a9b924993b3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:47.687731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceed699-a8a6-4fb3-bbe0-5a9b924993b3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:47.688006 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceed699-a8a6-4fb3-bbe0-5a9b924993b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:47.718965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-3ceed699-a8a6-4fb3-bbe0-5a9b924993b3 None None] MFA Rules not processed for user `661b8245393a4c11842840e1c5fb267f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:47.720302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3ceed699-a8a6-4fb3-bbe0-5a9b924993b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:47.815533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1177/2349] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:47 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:47.822452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9bc0-ed11-467f-ba02-b818d546783c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:47.825286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-454a9bc0-ed11-467f-ba02-b818d546783c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:47.897098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454a9bc0-ed11-467f-ba02-b818d546783c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:47.902256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb56855-923b-4235-bd1b-5711dc16bec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:47.902878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb56855-923b-4235-bd1b-5711dc16bec3 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:47.903217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb56855-923b-4235-bd1b-5711dc16bec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:47.903500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb56855-923b-4235-bd1b-5711dc16bec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:47.915409 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb56855-923b-4235-bd1b-5711dc16bec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:47.916887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb56855-923b-4235-bd1b-5711dc16bec3 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:47.929919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1173/2350] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:47 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:48.076587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceed699-a8a6-4fb3-bbe0-5a9b924993b3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:48.151088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceed699-a8a6-4fb3-bbe0-5a9b924993b3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:48.157214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:48.157911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:48.158202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:48.158493 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] PATH_INFO: `/v3/users/9911bdd340fb4171a55e0a1622af6d82` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:48.160430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9911bdd340fb4171a55e0a1622af6d82)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:48.162628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:48.188852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:48.224094 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9911bdd340fb4171a55e0a1622af6d82'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:48.224831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9911bdd340fb4171a55e0a1622af6d82'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:48.225506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9911bdd340fb4171a55e0a1622af6d82'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:48.235261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9911bdd340fb4171a55e0a1622af6d82'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:48.249118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9911bdd340fb4171a55e0a1622af6d82'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:48.265242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1178/2351] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:48 2022] DELETE /identity/v3/users/9911bdd340fb4171a55e0a1622af6d82 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:48.269726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac326-9ce6-425a-be35-0855cd860734 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:48.270175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac326-9ce6-425a-be35-0855cd860734 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:48.270339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40eac326-9ce6-425a-be35-0855cd860734 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:48.292670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-40eac326-9ce6-425a-be35-0855cd860734 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:48.293929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-40eac326-9ce6-425a-be35-0855cd860734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:48.339068 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:48.363221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1174/2352] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:31:48.372959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:48.374828 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:48.491478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2f1b046-a9ac-4ef3-83cf-a6a5544018b1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:48.495469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362b2bc-67e1-48d3-bcae-752046b899ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:48.496209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362b2bc-67e1-48d3-bcae-752046b899ef service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:48.496588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362b2bc-67e1-48d3-bcae-752046b899ef service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:48.496976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1362b2bc-67e1-48d3-bcae-752046b899ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:48.510719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362b2bc-67e1-48d3-bcae-752046b899ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:48.512315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1362b2bc-67e1-48d3-bcae-752046b899ef service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:48.540120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1179/2353] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:48.850765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eac326-9ce6-425a-be35-0855cd860734 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:48.852255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-40eac326-9ce6-425a-be35-0855cd860734 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:48.871984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40eac326-9ce6-425a-be35-0855cd860734 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:48.882533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:48.883184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:48.883469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:48.884379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] PATH_INFO: `/v3/projects/cea72947f5444baeb6e4cee5233a6532` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:48.890092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cea72947f5444baeb6e4cee5233a6532)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:48.892033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:48.957733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cea72947f5444baeb6e4cee5233a6532', 'request_id': 'req-91862b16-c69d-494a-a0b9-7a514748d7d3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:48.964490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cea72947f5444baeb6e4cee5233a6532', 'request_id': 'req-91862b16-c69d-494a-a0b9-7a514748d7d3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:48.976289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cea72947f5444baeb6e4cee5233a6532', 'request_id': 'req-91862b16-c69d-494a-a0b9-7a514748d7d3'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:48.992482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] The token cache is being invalidate because project cea72947f5444baeb6e4cee5233a6532 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:48.992925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:48.993866 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:48.995413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1175/2354] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:48 2022] DELETE /identity/v3/projects/cea72947f5444baeb6e4cee5233a6532 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:48.999724 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362b2bc-67e1-48d3-bcae-752046b899ef service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:49.013151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1362b2bc-67e1-48d3-bcae-752046b899ef service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:49.089864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:49.090535 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:49.090817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:49.091095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] PATH_INFO: `/v3/users/661b8245393a4c11842840e1c5fb267f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:49.092327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=661b8245393a4c11842840e1c5fb267f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:49.094306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:49.143464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:49.150289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '661b8245393a4c11842840e1c5fb267f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:49.151144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '661b8245393a4c11842840e1c5fb267f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:49.151868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '661b8245393a4c11842840e1c5fb267f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:49.161663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '661b8245393a4c11842840e1c5fb267f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:49.176728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8dfefa79-03a4-419f-ba57-e5628010d2c0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '661b8245393a4c11842840e1c5fb267f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:49.195554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1180/2355] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:48 2022] DELETE /identity/v3/users/661b8245393a4c11842840e1c5fb267f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:49.504059 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:49.505766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:49.531713 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91862b16-c69d-494a-a0b9-7a514748d7d3 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:49.613056 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:49.613823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:49.614177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:49.614935 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] PATH_INFO: `/v3/projects/1860915d5cbf489da26e4b2d7c66af4f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:49.616690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1860915d5cbf489da26e4b2d7c66af4f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:49.619386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:49.693418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1860915d5cbf489da26e4b2d7c66af4f', 'request_id': 'req-e7033c87-8048-4078-bb4e-d029427f1629'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:49.702659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1860915d5cbf489da26e4b2d7c66af4f', 'request_id': 'req-e7033c87-8048-4078-bb4e-d029427f1629'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:49.715307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1860915d5cbf489da26e4b2d7c66af4f', 'request_id': 'req-e7033c87-8048-4078-bb4e-d029427f1629'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:49.719423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:49.739850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] The token cache is being invalidate because project 1860915d5cbf489da26e4b2d7c66af4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:49.739850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:49.740590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e7033c87-8048-4078-bb4e-d029427f1629 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:49.748304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1176/2356] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:49 2022] DELETE /identity/v3/projects/1860915d5cbf489da26e4b2d7c66af4f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:49.751114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa26a0d-93b4-48e8-bec2-0a9946bce945 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:49.751396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa26a0d-93b4-48e8-bec2-0a9946bce945 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:49.751672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa26a0d-93b4-48e8-bec2-0a9946bce945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:49.778801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-cfa26a0d-93b4-48e8-bec2-0a9946bce945 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:49.780870 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cfa26a0d-93b4-48e8-bec2-0a9946bce945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:49.878679 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1181/2357] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:49.887953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb041f-3d3c-4c31-8d47-baf75832ef84 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:49.888265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb041f-3d3c-4c31-8d47-baf75832ef84 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:49.888570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42eb041f-3d3c-4c31-8d47-baf75832ef84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:49.909776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-42eb041f-3d3c-4c31-8d47-baf75832ef84 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:49.911026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-42eb041f-3d3c-4c31-8d47-baf75832ef84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:49.921193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1177/2358] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:49.925689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa26a0d-93b4-48e8-bec2-0a9946bce945 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:49.936456 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa26a0d-93b4-48e8-bec2-0a9946bce945 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:49.941437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e410da-9f3e-4ffe-979a-1917a5a14d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:49.942066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e410da-9f3e-4ffe-979a-1917a5a14d28 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:49.942345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e410da-9f3e-4ffe-979a-1917a5a14d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:49.942624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e410da-9f3e-4ffe-979a-1917a5a14d28 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:49.943284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e410da-9f3e-4ffe-979a-1917a5a14d28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:31:49.943649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e410da-9f3e-4ffe-979a-1917a5a14d28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:49.945240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e410da-9f3e-4ffe-979a-1917a5a14d28 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:49.958716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1182/2359] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:31:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:31:49.964076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb041f-3d3c-4c31-8d47-baf75832ef84 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:49.976648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42eb041f-3d3c-4c31-8d47-baf75832ef84 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:49.982193 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac383-8673-4530-bc8d-9f347d62c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:49.982811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac383-8673-4530-bc8d-9f347d62c11c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:49.983092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac383-8673-4530-bc8d-9f347d62c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:49.983367 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2ac383-8673-4530-bc8d-9f347d62c11c admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:49.984143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac383-8673-4530-bc8d-9f347d62c11c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:49.986261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f2ac383-8673-4530-bc8d-9f347d62c11c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.022182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1178/2360] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:49 2022] POST /identity/v3/projects => generated 379 bytes in 59 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:50.027300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e410da-9f3e-4ffe-979a-1917a5a14d28 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:50.038802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e410da-9f3e-4ffe-979a-1917a5a14d28 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:50.108001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef1a08-091e-4fae-9024-4ec33c31ae7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:50.108666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1a08-091e-4fae-9024-4ec33c31ae7c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.108950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1a08-091e-4fae-9024-4ec33c31ae7c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.109220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcef1a08-091e-4fae-9024-4ec33c31ae7c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.109868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef1a08-091e-4fae-9024-4ec33c31ae7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:50.111972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcef1a08-091e-4fae-9024-4ec33c31ae7c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.142042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1183/2361] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:50 2022] POST /identity/v3/users => generated 290 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:31:50.145940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac383-8673-4530-bc8d-9f347d62c11c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:50.158977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f2ac383-8673-4530-bc8d-9f347d62c11c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:50.169077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb8fbc-9215-4360-8e9b-2bced1672668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:50.169869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb8fbc-9215-4360-8e9b-2bced1672668 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.170502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb8fbc-9215-4360-8e9b-2bced1672668 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.170873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efb8fbc-9215-4360-8e9b-2bced1672668 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.171644 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb8fbc-9215-4360-8e9b-2bced1672668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:50.173500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efb8fbc-9215-4360-8e9b-2bced1672668 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.187536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1179/2362] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:50.189180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef1a08-091e-4fae-9024-4ec33c31ae7c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:50.200518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcef1a08-091e-4fae-9024-4ec33c31ae7c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:50.205837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be368226-30ab-4e62-8a68-bf434ebb8276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:50.206488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368226-30ab-4e62-8a68-bf434ebb8276 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.206783 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368226-30ab-4e62-8a68-bf434ebb8276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.207069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be368226-30ab-4e62-8a68-bf434ebb8276 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.207714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be368226-30ab-4e62-8a68-bf434ebb8276 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:50.209401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be368226-30ab-4e62-8a68-bf434ebb8276 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.225781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1184/2363] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:31:50.227621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb8fbc-9215-4360-8e9b-2bced1672668 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:50.238523 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efb8fbc-9215-4360-8e9b-2bced1672668 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:50.243508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ecd98-4392-4713-a6b1-db603f70ec24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:50.244195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ecd98-4392-4713-a6b1-db603f70ec24 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.245467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ecd98-4392-4713-a6b1-db603f70ec24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.245467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234ecd98-4392-4713-a6b1-db603f70ec24 admin admin] PATH_INFO: `/v3/projects/31bb5f9d29194ff3b4eeb7e1e7c6bb6e/users/591abd71e54749859d12a21c5bba5634/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.261765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ecd98-4392-4713-a6b1-db603f70ec24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=31bb5f9d29194ff3b4eeb7e1e7c6bb6e, user_id=591abd71e54749859d12a21c5bba5634, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:50.264610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234ecd98-4392-4713-a6b1-db603f70ec24 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.292172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1180/2364] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:50 2022] PUT /identity/v3/projects/31bb5f9d29194ff3b4eeb7e1e7c6bb6e/users/591abd71e54749859d12a21c5bba5634/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:50.293902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036f50-79a6-485d-a333-50454c91f5ce None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.294194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036f50-79a6-485d-a333-50454c91f5ce None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.294476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6036f50-79a6-485d-a333-50454c91f5ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.328524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e6036f50-79a6-485d-a333-50454c91f5ce None None] MFA Rules not processed for user `591abd71e54749859d12a21c5bba5634`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:50.329852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e6036f50-79a6-485d-a333-50454c91f5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:50.343719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:50.411867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1185/2365] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:50 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:50.416566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ecd98-4392-4713-a6b1-db603f70ec24 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:50.503931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234ecd98-4392-4713-a6b1-db603f70ec24 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:50.509816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168114d5-6a94-4940-8ea3-8a70ce0abf7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:50.510423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168114d5-6a94-4940-8ea3-8a70ce0abf7e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.510708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168114d5-6a94-4940-8ea3-8a70ce0abf7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.510988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168114d5-6a94-4940-8ea3-8a70ce0abf7e admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.511648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168114d5-6a94-4940-8ea3-8a70ce0abf7e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:50.513628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168114d5-6a94-4940-8ea3-8a70ce0abf7e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.545450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1181/2366] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:50 2022] POST /identity/v3/projects => generated 381 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:50.550301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036f50-79a6-485d-a333-50454c91f5ce None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:50.562892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6036f50-79a6-485d-a333-50454c91f5ce None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:50.627373 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1496b9-4407-4f41-be56-672760ee4f6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:50.627993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1496b9-4407-4f41-be56-672760ee4f6d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.628309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1496b9-4407-4f41-be56-672760ee4f6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.628632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e1496b9-4407-4f41-be56-672760ee4f6d admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.629271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1496b9-4407-4f41-be56-672760ee4f6d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:50.631387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e1496b9-4407-4f41-be56-672760ee4f6d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.661068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1186/2367] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:50 2022] POST /identity/v3/users => generated 297 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:31:50.663538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168114d5-6a94-4940-8ea3-8a70ce0abf7e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:50.675674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168114d5-6a94-4940-8ea3-8a70ce0abf7e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:50.683467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a433fe-6e1a-411a-97ef-6819799c7044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:50.684098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a433fe-6e1a-411a-97ef-6819799c7044 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.684405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a433fe-6e1a-411a-97ef-6819799c7044 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.684810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a433fe-6e1a-411a-97ef-6819799c7044 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.685469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a433fe-6e1a-411a-97ef-6819799c7044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:50.687108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91a433fe-6e1a-411a-97ef-6819799c7044 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.701140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1182/2368] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:50.705106 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1496b9-4407-4f41-be56-672760ee4f6d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:50.718722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e1496b9-4407-4f41-be56-672760ee4f6d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:50.723579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f8b4-ce73-4bd4-936c-fff12bfc5884 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:50.724353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f8b4-ce73-4bd4-936c-fff12bfc5884 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.724639 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f8b4-ce73-4bd4-936c-fff12bfc5884 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.724913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a972f8b4-ce73-4bd4-936c-fff12bfc5884 admin admin] PATH_INFO: `/v3/projects/aba84b94bf514356bc1035705455b565/users/eca27cb332cf4f5db414611ed6c715b4/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.744412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972f8b4-ce73-4bd4-936c-fff12bfc5884 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba84b94bf514356bc1035705455b565, user_id=eca27cb332cf4f5db414611ed6c715b4, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:50.747542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a972f8b4-ce73-4bd4-936c-fff12bfc5884 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.763947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1187/2369] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:50 2022] PUT /identity/v3/projects/aba84b94bf514356bc1035705455b565/users/eca27cb332cf4f5db414611ed6c715b4/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:31:50.769371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a433fe-6e1a-411a-97ef-6819799c7044 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:50.787128 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a433fe-6e1a-411a-97ef-6819799c7044 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:50.861062 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c275d1-6e9a-460f-9cc4-474c9bff47c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:50.863124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c275d1-6e9a-460f-9cc4-474c9bff47c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.863530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c275d1-6e9a-460f-9cc4-474c9bff47c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.863937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c275d1-6e9a-460f-9cc4-474c9bff47c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.864639 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c275d1-6e9a-460f-9cc4-474c9bff47c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:50.866262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c275d1-6e9a-460f-9cc4-474c9bff47c0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.881376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1183/2370] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:50 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:50.882369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f8b4-ce73-4bd4-936c-fff12bfc5884 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:50.896168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a972f8b4-ce73-4bd4-936c-fff12bfc5884 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:50.902674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c02b4-35d3-4dd2-9ad3-0a1a914eca83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:50.902964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c02b4-35d3-4dd2-9ad3-0a1a914eca83 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.903316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c02b4-35d3-4dd2-9ad3-0a1a914eca83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.903663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e34c02b4-35d3-4dd2-9ad3-0a1a914eca83 admin admin] PATH_INFO: `/v3/projects/aba84b94bf514356bc1035705455b565/users/eca27cb332cf4f5db414611ed6c715b4/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.905722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c02b4-35d3-4dd2-9ad3-0a1a914eca83 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aba84b94bf514356bc1035705455b565, user_id=eca27cb332cf4f5db414611ed6c715b4, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:50.908609 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e34c02b4-35d3-4dd2-9ad3-0a1a914eca83 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:50.932565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1188/2371] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:50 2022] PUT /identity/v3/projects/aba84b94bf514356bc1035705455b565/users/eca27cb332cf4f5db414611ed6c715b4/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:50.934387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da138757-af06-4176-8687-966aec81460c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:50.934926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da138757-af06-4176-8687-966aec81460c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:50.935276 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da138757-af06-4176-8687-966aec81460c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:50.945623 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:50.977180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-da138757-af06-4176-8687-966aec81460c None None] MFA Rules not processed for user `eca27cb332cf4f5db414611ed6c715b4`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:50.979070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-da138757-af06-4176-8687-966aec81460c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:51.086006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1184/2372] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:50 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:51.096697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c02b4-35d3-4dd2-9ad3-0a1a914eca83 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:51.098499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e34c02b4-35d3-4dd2-9ad3-0a1a914eca83 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:51.166220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e34c02b4-35d3-4dd2-9ad3-0a1a914eca83 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:51.171433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a4e5d-6f50-4e34-904a-e588f85a0739 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:51.172192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4e5d-6f50-4e34-904a-e588f85a0739 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:51.172563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4e5d-6f50-4e34-904a-e588f85a0739 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:51.172933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a4e5d-6f50-4e34-904a-e588f85a0739 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:51.183819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a4e5d-6f50-4e34-904a-e588f85a0739 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:51.185494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a4e5d-6f50-4e34-904a-e588f85a0739 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:51.198055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1189/2373] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:51 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:51.633779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da138757-af06-4176-8687-966aec81460c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:51.710357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da138757-af06-4176-8687-966aec81460c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:51.716425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:51.717275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:51.717552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:51.717823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] PATH_INFO: `/v3/users/591abd71e54749859d12a21c5bba5634` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:51.718956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] RBAC: Authorizing `identity:delete_user(user_id=591abd71e54749859d12a21c5bba5634)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:51.720928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:51.776246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '591abd71e54749859d12a21c5bba5634'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:51.776963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '591abd71e54749859d12a21c5bba5634'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:51.792968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '591abd71e54749859d12a21c5bba5634'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:51.793819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '591abd71e54749859d12a21c5bba5634'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:51.803177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '591abd71e54749859d12a21c5bba5634'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:51.822849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1185/2374] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:51 2022] DELETE /identity/v3/users/591abd71e54749859d12a21c5bba5634 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:51.824628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452c04-9daa-4232-9ce1-4308b76a5129 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:51.824963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452c04-9daa-4232-9ce1-4308b76a5129 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:51.825218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b452c04-9daa-4232-9ce1-4308b76a5129 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:51.851056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4b452c04-9daa-4232-9ce1-4308b76a5129 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:51.853354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b452c04-9daa-4232-9ce1-4308b76a5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:51.857090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:51.923466 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1190/2375] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:31:51.933217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:51.934770 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:51.949424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:52.013633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56183ba8-1bbc-43e6-94bb-547e189cf9ca admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:52.017940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886d61e-5673-4852-bdc9-335efb64f03c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:52.018579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886d61e-5673-4852-bdc9-335efb64f03c service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:52.018861 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886d61e-5673-4852-bdc9-335efb64f03c service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:52.019134 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1886d61e-5673-4852-bdc9-335efb64f03c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:52.029468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886d61e-5673-4852-bdc9-335efb64f03c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:52.031224 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1886d61e-5673-4852-bdc9-335efb64f03c service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:52.043989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1186/2376] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:52.429184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b452c04-9daa-4232-9ce1-4308b76a5129 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:52.431321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b452c04-9daa-4232-9ce1-4308b76a5129 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:52.455193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b452c04-9daa-4232-9ce1-4308b76a5129 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:52.463243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:52.463985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:52.464340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:52.464687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] PATH_INFO: `/v3/projects/31bb5f9d29194ff3b4eeb7e1e7c6bb6e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:52.466011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] RBAC: Authorizing `identity:delete_project(project_id=31bb5f9d29194ff3b4eeb7e1e7c6bb6e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:52.475934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:52.549397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '31bb5f9d29194ff3b4eeb7e1e7c6bb6e', 'request_id': 'req-cf714032-dacc-4f29-b423-a6a609486f48'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:52.557584 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '31bb5f9d29194ff3b4eeb7e1e7c6bb6e', 'request_id': 'req-cf714032-dacc-4f29-b423-a6a609486f48'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:52.564833 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '31bb5f9d29194ff3b4eeb7e1e7c6bb6e', 'request_id': 'req-cf714032-dacc-4f29-b423-a6a609486f48'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:52.578684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] The token cache is being invalidate because project 31bb5f9d29194ff3b4eeb7e1e7c6bb6e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:52.578998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:52.579677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:52.581563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1191/2377] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:52 2022] DELETE /identity/v3/projects/31bb5f9d29194ff3b4eeb7e1e7c6bb6e => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:52.588484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886d61e-5673-4852-bdc9-335efb64f03c service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:52.598634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1886d61e-5673-4852-bdc9-335efb64f03c service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:52.669235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:52.669944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:52.670162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:52.670438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] PATH_INFO: `/v3/users/eca27cb332cf4f5db414611ed6c715b4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:52.671614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] RBAC: Authorizing `identity:delete_user(user_id=eca27cb332cf4f5db414611ed6c715b4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:52.673601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:52.731962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eca27cb332cf4f5db414611ed6c715b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:52.732662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eca27cb332cf4f5db414611ed6c715b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:52.747292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eca27cb332cf4f5db414611ed6c715b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:52.748031 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eca27cb332cf4f5db414611ed6c715b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:52.755914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a8fdba19-9a4f-48e2-8718-b0f00b37362c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eca27cb332cf4f5db414611ed6c715b4'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:52.807292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1187/2378] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:52 2022] DELETE /identity/v3/users/eca27cb332cf4f5db414611ed6c715b4 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:53.136928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:53.141688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:53.169283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf714032-dacc-4f29-b423-a6a609486f48 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:53.243565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:53.244251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:53.244539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:53.244817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] PATH_INFO: `/v3/projects/aba84b94bf514356bc1035705455b565` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:53.246246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aba84b94bf514356bc1035705455b565)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:53.248365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:53.306734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:53.319797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aba84b94bf514356bc1035705455b565', 'request_id': 'req-c037a080-51d4-463b-ae82-f06db9b83648'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:53.326846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aba84b94bf514356bc1035705455b565', 'request_id': 'req-c037a080-51d4-463b-ae82-f06db9b83648'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:53.335231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aba84b94bf514356bc1035705455b565', 'request_id': 'req-c037a080-51d4-463b-ae82-f06db9b83648'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:53.350173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] The token cache is being invalidate because project aba84b94bf514356bc1035705455b565 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:53.350473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:53.351114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c037a080-51d4-463b-ae82-f06db9b83648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:53.356540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1192/2379] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:53 2022] DELETE /identity/v3/projects/aba84b94bf514356bc1035705455b565 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:53.358254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fc17b-5771-471b-9be0-603c6cd04e97 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:53.358620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fc17b-5771-471b-9be0-603c6cd04e97 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:53.358988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7fc17b-5771-471b-9be0-603c6cd04e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:53.385355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6c7fc17b-5771-471b-9be0-603c6cd04e97 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:53.386775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6c7fc17b-5771-471b-9be0-603c6cd04e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:53.417185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:53.474412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1188/2380] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:53.545399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75aad-0708-4334-82ff-b8656f5816ba None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:53.546018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75aad-0708-4334-82ff-b8656f5816ba None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:53.546018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b75aad-0708-4334-82ff-b8656f5816ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:53.575711 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-26b75aad-0708-4334-82ff-b8656f5816ba None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:53.576978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-26b75aad-0708-4334-82ff-b8656f5816ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:53.589776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1193/2381] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:53.590940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7fc17b-5771-471b-9be0-603c6cd04e97 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:53.602821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7fc17b-5771-471b-9be0-603c6cd04e97 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:53.608019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb58e6-25a5-4068-97cd-3f037dde42b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:53.608711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb58e6-25a5-4068-97cd-3f037dde42b4 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:53.609097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb58e6-25a5-4068-97cd-3f037dde42b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:53.609338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafb58e6-25a5-4068-97cd-3f037dde42b4 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:53.610283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb58e6-25a5-4068-97cd-3f037dde42b4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:31:53.610631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb58e6-25a5-4068-97cd-3f037dde42b4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:53.612441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafb58e6-25a5-4068-97cd-3f037dde42b4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:53.627705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1189/2382] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:31:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:31:53.632455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b75aad-0708-4334-82ff-b8656f5816ba None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:53.643545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b75aad-0708-4334-82ff-b8656f5816ba None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:53.648668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca51adb-1fbd-455e-a403-f5f4f29ae590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:53.649385 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51adb-1fbd-455e-a403-f5f4f29ae590 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:53.649723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51adb-1fbd-455e-a403-f5f4f29ae590 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:53.650008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca51adb-1fbd-455e-a403-f5f4f29ae590 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:53.650785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca51adb-1fbd-455e-a403-f5f4f29ae590 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:53.652933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca51adb-1fbd-455e-a403-f5f4f29ae590 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:53.682839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1194/2383] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:53 2022] POST /identity/v3/projects => generated 361 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:31:53.686927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb58e6-25a5-4068-97cd-3f037dde42b4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:53.698714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafb58e6-25a5-4068-97cd-3f037dde42b4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:53.760477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6355f-67c7-4f4d-aebc-0342518d4a5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:53.761084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6355f-67c7-4f4d-aebc-0342518d4a5e admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:53.761364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6355f-67c7-4f4d-aebc-0342518d4a5e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:53.761641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e6355f-67c7-4f4d-aebc-0342518d4a5e admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:53.762276 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6355f-67c7-4f4d-aebc-0342518d4a5e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:53.764202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24e6355f-67c7-4f4d-aebc-0342518d4a5e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:53.785431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1190/2384] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:53 2022] POST /identity/v3/users => generated 281 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:53.789798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca51adb-1fbd-455e-a403-f5f4f29ae590 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:53.800138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca51adb-1fbd-455e-a403-f5f4f29ae590 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:53.804866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01158351-394c-468b-a917-627655729ff4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:53.805998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01158351-394c-468b-a917-627655729ff4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:53.806274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01158351-394c-468b-a917-627655729ff4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:53.806545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01158351-394c-468b-a917-627655729ff4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:53.807186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01158351-394c-468b-a917-627655729ff4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:53.808808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01158351-394c-468b-a917-627655729ff4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:53.819086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1195/2385] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:31:53.823766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6355f-67c7-4f4d-aebc-0342518d4a5e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:53.834551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24e6355f-67c7-4f4d-aebc-0342518d4a5e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:53.839329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcea85e3-8bcc-4fdc-b402-f6f7461ef244 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:53.839939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea85e3-8bcc-4fdc-b402-f6f7461ef244 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:53.840261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea85e3-8bcc-4fdc-b402-f6f7461ef244 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:53.840538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcea85e3-8bcc-4fdc-b402-f6f7461ef244 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:53.841211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea85e3-8bcc-4fdc-b402-f6f7461ef244 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:53.842850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcea85e3-8bcc-4fdc-b402-f6f7461ef244 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:53.856407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1191/2386] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:53 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:53.860453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01158351-394c-468b-a917-627655729ff4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:53.872022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01158351-394c-468b-a917-627655729ff4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:53.876976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7ff53-125e-4599-9182-fc360d967996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:53.877643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7ff53-125e-4599-9182-fc360d967996 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:53.877925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7ff53-125e-4599-9182-fc360d967996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:53.878201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc7ff53-125e-4599-9182-fc360d967996 admin admin] PATH_INFO: `/v3/projects/385d0e69218b4477926d04fd20756f59/users/f5e2f301b58f4a9f8bc3e94cdb0fc1a2/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:53.894488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7ff53-125e-4599-9182-fc360d967996 admin admin] RBAC: Authorizing `identity:create_grant(project_id=385d0e69218b4477926d04fd20756f59, user_id=f5e2f301b58f4a9f8bc3e94cdb0fc1a2, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:53.897115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc7ff53-125e-4599-9182-fc360d967996 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:53.910778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1196/2387] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:53 2022] PUT /identity/v3/projects/385d0e69218b4477926d04fd20756f59/users/f5e2f301b58f4a9f8bc3e94cdb0fc1a2/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:53.921267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc058bb-57e4-4661-888d-f4b0aaf1001e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:53.921549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc058bb-57e4-4661-888d-f4b0aaf1001e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:53.921822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbc058bb-57e4-4661-888d-f4b0aaf1001e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:53.953704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cbc058bb-57e4-4661-888d-f4b0aaf1001e None None] MFA Rules not processed for user `f5e2f301b58f4a9f8bc3e94cdb0fc1a2`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:53.954917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cbc058bb-57e4-4661-888d-f4b0aaf1001e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:54.030142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1192/2388] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:54.065475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7ff53-125e-4599-9182-fc360d967996 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:54.067299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5bc7ff53-125e-4599-9182-fc360d967996 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:54.124642 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc7ff53-125e-4599-9182-fc360d967996 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:54.128340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48f319-5b6c-4da7-b033-147478f5dabf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:54.128942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48f319-5b6c-4da7-b033-147478f5dabf service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:54.129222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48f319-5b6c-4da7-b033-147478f5dabf service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:54.129494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48f319-5b6c-4da7-b033-147478f5dabf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:54.138017 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48f319-5b6c-4da7-b033-147478f5dabf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:54.139447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f48f319-5b6c-4da7-b033-147478f5dabf service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:54.148778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1197/2389] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:54.163590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc058bb-57e4-4661-888d-f4b0aaf1001e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:54.192074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:54.228213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbc058bb-57e4-4661-888d-f4b0aaf1001e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:54.232758 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:54.233437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:54.233669 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:54.233942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] PATH_INFO: `/v3/users/f5e2f301b58f4a9f8bc3e94cdb0fc1a2` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:54.235127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] RBAC: Authorizing `identity:delete_user(user_id=f5e2f301b58f4a9f8bc3e94cdb0fc1a2)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:54.237091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:54.283844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f5e2f301b58f4a9f8bc3e94cdb0fc1a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:54.284532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f5e2f301b58f4a9f8bc3e94cdb0fc1a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:54.296993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f5e2f301b58f4a9f8bc3e94cdb0fc1a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:54.297638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f5e2f301b58f4a9f8bc3e94cdb0fc1a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:54.304520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f5e2f301b58f4a9f8bc3e94cdb0fc1a2'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:54.317913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1193/2390] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:31:54 2022] DELETE /identity/v3/users/f5e2f301b58f4a9f8bc3e94cdb0fc1a2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:54.322552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f8d9-f922-45d9-9565-aefa6ed99511 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:54.322840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f8d9-f922-45d9-9565-aefa6ed99511 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:54.323115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e94f8d9-f922-45d9-9565-aefa6ed99511 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:54.342697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6e94f8d9-f922-45d9-9565-aefa6ed99511 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:54.343899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6e94f8d9-f922-45d9-9565-aefa6ed99511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:54.393255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:54.394893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:54.406898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1198/2391] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:31:54.413311 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94f8d9-f922-45d9-9565-aefa6ed99511 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:54.415727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6e94f8d9-f922-45d9-9565-aefa6ed99511 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:54.420662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=5,keystone:SELECT=92,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:54.458246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b378e6e-6259-480b-b907-9cb175f5027f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:54.462520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6da1b-c296-4344-94bc-e373adf91a8d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:54.463130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6da1b-c296-4344-94bc-e373adf91a8d service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:54.463411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6da1b-c296-4344-94bc-e373adf91a8d service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:54.463689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc6da1b-c296-4344-94bc-e373adf91a8d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:54.465611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-adc6da1b-c296-4344-94bc-e373adf91a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:54.475566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6da1b-c296-4344-94bc-e373adf91a8d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:54.476220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e94f8d9-f922-45d9-9565-aefa6ed99511 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:54.477044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc6da1b-c296-4344-94bc-e373adf91a8d service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:54.480452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b443783-6b17-495f-a5c9-5c4c34e1ba0e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:54.481066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443783-6b17-495f-a5c9-5c4c34e1ba0e service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:54.481342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443783-6b17-495f-a5c9-5c4c34e1ba0e service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:54.482517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b443783-6b17-495f-a5c9-5c4c34e1ba0e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:54.486248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1194/2392] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:54.491829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b443783-6b17-495f-a5c9-5c4c34e1ba0e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:54.493351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b443783-6b17-495f-a5c9-5c4c34e1ba0e service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:54.503336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1199/2393] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:31:55.057138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6da1b-c296-4344-94bc-e373adf91a8d service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.058636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-adc6da1b-c296-4344-94bc-e373adf91a8d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:55.074645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc6da1b-c296-4344-94bc-e373adf91a8d service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.079214 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.080901 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.081191 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.081471 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] PATH_INFO: `/v3/projects/385d0e69218b4477926d04fd20756f59` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.082649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] RBAC: Authorizing `identity:delete_project(project_id=385d0e69218b4477926d04fd20756f59)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.084642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.128239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:55.136501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '385d0e69218b4477926d04fd20756f59', 'request_id': 'req-b7eb183c-666b-48e6-a5fc-2cc110b7d876'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:55.142238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '385d0e69218b4477926d04fd20756f59', 'request_id': 'req-b7eb183c-666b-48e6-a5fc-2cc110b7d876'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:55.149261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '385d0e69218b4477926d04fd20756f59', 'request_id': 'req-b7eb183c-666b-48e6-a5fc-2cc110b7d876'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:55.161796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] The token cache is being invalidate because project 385d0e69218b4477926d04fd20756f59 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:31:55.162079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:55.162705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b7eb183c-666b-48e6-a5fc-2cc110b7d876 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:31:55.164230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1195/2394] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:31:55 2022] DELETE /identity/v3/projects/385d0e69218b4477926d04fd20756f59 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:55.174921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607e8a8-4cc2-45a8-8aa7-474861b4522b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.175490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607e8a8-4cc2-45a8-8aa7-474861b4522b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.175490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b607e8a8-4cc2-45a8-8aa7-474861b4522b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.194783 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b607e8a8-4cc2-45a8-8aa7-474861b4522b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:55.196588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b607e8a8-4cc2-45a8-8aa7-474861b4522b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:55.257453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1200/2395] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:55.265765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427759-9a12-42e1-8380-94efa5cd2efa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.266074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427759-9a12-42e1-8380-94efa5cd2efa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.266371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a427759-9a12-42e1-8380-94efa5cd2efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.286156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6a427759-9a12-42e1-8380-94efa5cd2efa None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:55.287354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6a427759-9a12-42e1-8380-94efa5cd2efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:55.295178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1196/2396] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:55.299531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607e8a8-4cc2-45a8-8aa7-474861b4522b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.309632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b607e8a8-4cc2-45a8-8aa7-474861b4522b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.314176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db73246-2370-4bab-bed8-1033c373d73a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.314798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73246-2370-4bab-bed8-1033c373d73a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.315075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73246-2370-4bab-bed8-1033c373d73a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.315344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db73246-2370-4bab-bed8-1033c373d73a admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.315979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db73246-2370-4bab-bed8-1033c373d73a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:31:55.316320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db73246-2370-4bab-bed8-1033c373d73a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.317927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db73246-2370-4bab-bed8-1033c373d73a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.329977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1201/2397] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:31:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:31:55.339494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a427759-9a12-42e1-8380-94efa5cd2efa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.348973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a427759-9a12-42e1-8380-94efa5cd2efa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.353616 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39284b3-528f-4783-999e-aa971d468a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.354208 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39284b3-528f-4783-999e-aa971d468a6d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.354483 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39284b3-528f-4783-999e-aa971d468a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.354751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39284b3-528f-4783-999e-aa971d468a6d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.355385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39284b3-528f-4783-999e-aa971d468a6d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.357315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b39284b3-528f-4783-999e-aa971d468a6d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.385096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1197/2398] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:55 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:55.389391 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db73246-2370-4bab-bed8-1033c373d73a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.399318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db73246-2370-4bab-bed8-1033c373d73a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.456056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e1020-fe60-4ff9-a5c9-a5e5000d6a02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.456605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e1020-fe60-4ff9-a5c9-a5e5000d6a02 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.456880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e1020-fe60-4ff9-a5c9-a5e5000d6a02 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.457150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e1020-fe60-4ff9-a5c9-a5e5000d6a02 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.457774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e1020-fe60-4ff9-a5c9-a5e5000d6a02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.459819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404e1020-fe60-4ff9-a5c9-a5e5000d6a02 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.481533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1202/2399] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:55 2022] POST /identity/v3/users => generated 293 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:55.485445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39284b3-528f-4783-999e-aa971d468a6d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.496074 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39284b3-528f-4783-999e-aa971d468a6d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.500922 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c8985-14fd-45d8-80ca-1f14c29272be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.501525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c8985-14fd-45d8-80ca-1f14c29272be admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.501804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c8985-14fd-45d8-80ca-1f14c29272be admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.502078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df9c8985-14fd-45d8-80ca-1f14c29272be admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.502721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c8985-14fd-45d8-80ca-1f14c29272be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.504351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df9c8985-14fd-45d8-80ca-1f14c29272be admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.514698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1198/2400] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:55.518737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e1020-fe60-4ff9-a5c9-a5e5000d6a02 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.530000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e1020-fe60-4ff9-a5c9-a5e5000d6a02 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.534499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef6fd3c-754c-4ce8-a043-aebb8efed1ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.535175 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6fd3c-754c-4ce8-a043-aebb8efed1ef admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.535447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6fd3c-754c-4ce8-a043-aebb8efed1ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.535760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef6fd3c-754c-4ce8-a043-aebb8efed1ef admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.536502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6fd3c-754c-4ce8-a043-aebb8efed1ef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.538073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef6fd3c-754c-4ce8-a043-aebb8efed1ef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.548542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1203/2401] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:55.553143 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c8985-14fd-45d8-80ca-1f14c29272be admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.564116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df9c8985-14fd-45d8-80ca-1f14c29272be admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.569641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81597bc6-0ad9-4fea-a707-7c2a2593e1e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.570292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597bc6-0ad9-4fea-a707-7c2a2593e1e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.570576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597bc6-0ad9-4fea-a707-7c2a2593e1e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.571377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81597bc6-0ad9-4fea-a707-7c2a2593e1e5 admin admin] PATH_INFO: `/v3/projects/c3c96c0ce814437b977969a0a7148ef5/users/b4e3dc88517e47a9b32665398aebb592/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.587484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81597bc6-0ad9-4fea-a707-7c2a2593e1e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c3c96c0ce814437b977969a0a7148ef5, user_id=b4e3dc88517e47a9b32665398aebb592, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.590145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81597bc6-0ad9-4fea-a707-7c2a2593e1e5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.603121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1199/2402] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:55 2022] PUT /identity/v3/projects/c3c96c0ce814437b977969a0a7148ef5/users/b4e3dc88517e47a9b32665398aebb592/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:55.614437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbca7b-4bb7-4f60-841c-4bedaa877190 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.614726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbca7b-4bb7-4f60-841c-4bedaa877190 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.615004 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73bbca7b-4bb7-4f60-841c-4bedaa877190 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.635677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:55.643863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-73bbca7b-4bb7-4f60-841c-4bedaa877190 None None] MFA Rules not processed for user `b4e3dc88517e47a9b32665398aebb592`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:55.645489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-73bbca7b-4bb7-4f60-841c-4bedaa877190 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:55.709395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1204/2403] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:55 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:55.714364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81597bc6-0ad9-4fea-a707-7c2a2593e1e5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.781072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81597bc6-0ad9-4fea-a707-7c2a2593e1e5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.785748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12edee8-e587-4558-9f9b-322adfa3de86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.786351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12edee8-e587-4558-9f9b-322adfa3de86 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.786631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12edee8-e587-4558-9f9b-322adfa3de86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.786907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d12edee8-e587-4558-9f9b-322adfa3de86 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.787539 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12edee8-e587-4558-9f9b-322adfa3de86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.789516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d12edee8-e587-4558-9f9b-322adfa3de86 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.815164 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1200/2404] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:55 2022] POST /identity/v3/projects => generated 383 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:55.819274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbca7b-4bb7-4f60-841c-4bedaa877190 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.830896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73bbca7b-4bb7-4f60-841c-4bedaa877190 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.887167 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725db9d3-71ac-46c8-bdf4-5564e46b9a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.887763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725db9d3-71ac-46c8-bdf4-5564e46b9a09 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.888041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725db9d3-71ac-46c8-bdf4-5564e46b9a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.888342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725db9d3-71ac-46c8-bdf4-5564e46b9a09 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.888976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725db9d3-71ac-46c8-bdf4-5564e46b9a09 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.890860 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725db9d3-71ac-46c8-bdf4-5564e46b9a09 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.912887 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1205/2405] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:55 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:55.917190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12edee8-e587-4558-9f9b-322adfa3de86 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.927286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d12edee8-e587-4558-9f9b-322adfa3de86 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.932708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c1583-80e1-42b8-980f-79a36eab606d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.933308 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c1583-80e1-42b8-980f-79a36eab606d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.933590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c1583-80e1-42b8-980f-79a36eab606d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.933863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7c1583-80e1-42b8-980f-79a36eab606d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.934498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c1583-80e1-42b8-980f-79a36eab606d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.936093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7c1583-80e1-42b8-980f-79a36eab606d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.947181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1201/2406] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:55.951121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725db9d3-71ac-46c8-bdf4-5564e46b9a09 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.961285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725db9d3-71ac-46c8-bdf4-5564e46b9a09 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.965886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4094a6ba-485f-46a0-b3d9-0b041fd6091c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.966471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a6ba-485f-46a0-b3d9-0b041fd6091c admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.966753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a6ba-485f-46a0-b3d9-0b041fd6091c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.967020 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4094a6ba-485f-46a0-b3d9-0b041fd6091c admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:55.967651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094a6ba-485f-46a0-b3d9-0b041fd6091c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:55.969262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4094a6ba-485f-46a0-b3d9-0b041fd6091c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:55.978923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1206/2407] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:55 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:55.982858 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c1583-80e1-42b8-980f-79a36eab606d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:55.993154 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7c1583-80e1-42b8-980f-79a36eab606d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:55.997691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69964b22-615c-47ee-8033-5b1985538634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:55.998318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69964b22-615c-47ee-8033-5b1985538634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:55.998597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69964b22-615c-47ee-8033-5b1985538634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:55.998870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69964b22-615c-47ee-8033-5b1985538634 admin admin] PATH_INFO: `/v3/projects/caf6f0e9c6524491b74e4c0916615ea8/users/9acce85c4bfd40d9b0537674a03a2309/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:56.013513 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69964b22-615c-47ee-8033-5b1985538634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=caf6f0e9c6524491b74e4c0916615ea8, user_id=9acce85c4bfd40d9b0537674a03a2309, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:56.016175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69964b22-615c-47ee-8033-5b1985538634 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:56.029420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1202/2408] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:55 2022] PUT /identity/v3/projects/caf6f0e9c6524491b74e4c0916615ea8/users/9acce85c4bfd40d9b0537674a03a2309/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:56.039634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0538de-1c46-49e3-bc9e-eadd3e609b07 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:56.039946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0538de-1c46-49e3-bc9e-eadd3e609b07 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:56.040271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb0538de-1c46-49e3-bc9e-eadd3e609b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:56.068533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-bb0538de-1c46-49e3-bc9e-eadd3e609b07 None None] MFA Rules not processed for user `9acce85c4bfd40d9b0537674a03a2309`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:56.069727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bb0538de-1c46-49e3-bc9e-eadd3e609b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:56.135407 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1207/2409] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:56.140239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69964b22-615c-47ee-8033-5b1985538634 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:56.159290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:56.206068 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69964b22-615c-47ee-8033-5b1985538634 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:56.210761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a64a-d724-467c-87e8-7c30a04549fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:56.211980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a64a-d724-467c-87e8-7c30a04549fb admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:56.212361 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a64a-d724-467c-87e8-7c30a04549fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:56.212637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e4a64a-d724-467c-87e8-7c30a04549fb admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:56.213261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4a64a-d724-467c-87e8-7c30a04549fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:56.215148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e4a64a-d724-467c-87e8-7c30a04549fb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:56.247640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1203/2410] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:31:56 2022] POST /identity/v3/projects => generated 385 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:56.251953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0538de-1c46-49e3-bc9e-eadd3e609b07 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:56.263389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb0538de-1c46-49e3-bc9e-eadd3e609b07 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:56.268029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:56.324954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e37625-fa78-4ead-8e58-0a1e84822829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:56.325562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e37625-fa78-4ead-8e58-0a1e84822829 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:56.325849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e37625-fa78-4ead-8e58-0a1e84822829 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:56.326154 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e37625-fa78-4ead-8e58-0a1e84822829 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:56.326822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e37625-fa78-4ead-8e58-0a1e84822829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:56.328778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e37625-fa78-4ead-8e58-0a1e84822829 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:56.351196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1208/2411] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:31:56 2022] POST /identity/v3/users => generated 299 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:31:56.360447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a64a-d724-467c-87e8-7c30a04549fb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:56.370656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e4a64a-d724-467c-87e8-7c30a04549fb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:56.375297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6373f1a-6e0c-4a67-9525-f6047635fc86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:56.375894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6373f1a-6e0c-4a67-9525-f6047635fc86 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:56.376196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6373f1a-6e0c-4a67-9525-f6047635fc86 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:56.376472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6373f1a-6e0c-4a67-9525-f6047635fc86 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:56.377106 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6373f1a-6e0c-4a67-9525-f6047635fc86 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:56.378694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6373f1a-6e0c-4a67-9525-f6047635fc86 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:56.389489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1204/2412] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:56.393810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e37625-fa78-4ead-8e58-0a1e84822829 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:56.404444 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e37625-fa78-4ead-8e58-0a1e84822829 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:56.409063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8709cd-8a3d-43de-a907-55d2222e9190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:56.409704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8709cd-8a3d-43de-a907-55d2222e9190 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:56.410008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8709cd-8a3d-43de-a907-55d2222e9190 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:56.410284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8709cd-8a3d-43de-a907-55d2222e9190 admin admin] PATH_INFO: `/v3/projects/ffdbf10db9e341169337468f04351c45/users/19d0e3a6fdcb48c2b3e1adae32c5c322/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:56.425092 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8709cd-8a3d-43de-a907-55d2222e9190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdbf10db9e341169337468f04351c45, user_id=19d0e3a6fdcb48c2b3e1adae32c5c322, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:56.427729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8709cd-8a3d-43de-a907-55d2222e9190 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:56.440442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1209/2413] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:56 2022] PUT /identity/v3/projects/ffdbf10db9e341169337468f04351c45/users/19d0e3a6fdcb48c2b3e1adae32c5c322/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:56.444371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6373f1a-6e0c-4a67-9525-f6047635fc86 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:56.454501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6373f1a-6e0c-4a67-9525-f6047635fc86 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:56.510411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c762ff-99d9-4607-9835-843552765189 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:56.511019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c762ff-99d9-4607-9835-843552765189 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:56.511303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c762ff-99d9-4607-9835-843552765189 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:56.511584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c762ff-99d9-4607-9835-843552765189 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:56.512259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c762ff-99d9-4607-9835-843552765189 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:56.513896 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02c762ff-99d9-4607-9835-843552765189 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:56.523432 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1205/2414] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:31:56 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:31:56.527589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8709cd-8a3d-43de-a907-55d2222e9190 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:56.537818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8709cd-8a3d-43de-a907-55d2222e9190 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:56.542984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ed71-e83b-405a-98ea-731df1ad6710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:56.543626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ed71-e83b-405a-98ea-731df1ad6710 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:56.543910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ed71-e83b-405a-98ea-731df1ad6710 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:56.544216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e289ed71-e83b-405a-98ea-731df1ad6710 admin admin] PATH_INFO: `/v3/projects/ffdbf10db9e341169337468f04351c45/users/19d0e3a6fdcb48c2b3e1adae32c5c322/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:56.546128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ed71-e83b-405a-98ea-731df1ad6710 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ffdbf10db9e341169337468f04351c45, user_id=19d0e3a6fdcb48c2b3e1adae32c5c322, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:56.548789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e289ed71-e83b-405a-98ea-731df1ad6710 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:56.559664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1210/2415] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:31:56 2022] PUT /identity/v3/projects/ffdbf10db9e341169337468f04351c45/users/19d0e3a6fdcb48c2b3e1adae32c5c322/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:31:56.570808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dafea1-7cca-41f8-b09f-71323847160a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:56.571115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dafea1-7cca-41f8-b09f-71323847160a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:56.571380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35dafea1-7cca-41f8-b09f-71323847160a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:56.598671 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-35dafea1-7cca-41f8-b09f-71323847160a None None] MFA Rules not processed for user `19d0e3a6fdcb48c2b3e1adae32c5c322`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:31:56.599869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-35dafea1-7cca-41f8-b09f-71323847160a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:56.668379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1206/2416] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:31:56 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:31:56.679633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ed71-e83b-405a-98ea-731df1ad6710 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:56.681409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e289ed71-e83b-405a-98ea-731df1ad6710 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:56.738314 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e289ed71-e83b-405a-98ea-731df1ad6710 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:56.741928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e01568-7669-4aad-bf15-addac9f14a12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:56.742546 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e01568-7669-4aad-bf15-addac9f14a12 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:56.742829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e01568-7669-4aad-bf15-addac9f14a12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:56.743103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e01568-7669-4aad-bf15-addac9f14a12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:56.798686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e01568-7669-4aad-bf15-addac9f14a12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:56.800118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04e01568-7669-4aad-bf15-addac9f14a12 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:56.809475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1211/2417] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:56 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:58.206530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dafea1-7cca-41f8-b09f-71323847160a None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:58.208249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-35dafea1-7cca-41f8-b09f-71323847160a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:58.226152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:58.278533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35dafea1-7cca-41f8-b09f-71323847160a None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:58.282732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06594fb8-6649-4f8b-b572-c83c7bf69a11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:58.283366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06594fb8-6649-4f8b-b572-c83c7bf69a11 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:58.283646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06594fb8-6649-4f8b-b572-c83c7bf69a11 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:58.283921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06594fb8-6649-4f8b-b572-c83c7bf69a11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:58.285767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-06594fb8-6649-4f8b-b572-c83c7bf69a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:58.301396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06594fb8-6649-4f8b-b572-c83c7bf69a11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:58.302962 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06594fb8-6649-4f8b-b572-c83c7bf69a11 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:58.312700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1207/2418] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:58 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:58.503728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e01568-7669-4aad-bf15-addac9f14a12 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:58.515491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e01568-7669-4aad-bf15-addac9f14a12 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:58.519464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113510b9-d576-4143-8e69-7a08fd8b2c03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:58.520067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113510b9-d576-4143-8e69-7a08fd8b2c03 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:58.520376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113510b9-d576-4143-8e69-7a08fd8b2c03 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:58.520649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-113510b9-d576-4143-8e69-7a08fd8b2c03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:58.533364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:31:58.584072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113510b9-d576-4143-8e69-7a08fd8b2c03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:58.585753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-113510b9-d576-4143-8e69-7a08fd8b2c03 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:58.603099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1212/2419] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:58 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:31:58.675359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06594fb8-6649-4f8b-b572-c83c7bf69a11 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:58.676783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-06594fb8-6649-4f8b-b572-c83c7bf69a11 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:58.750940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06594fb8-6649-4f8b-b572-c83c7bf69a11 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:58.756120 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4ea88-2ca7-4c8b-af1d-61efe6f3589b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc00e6583d7424cbdc13732a962fc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:58.756752 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4ea88-2ca7-4c8b-af1d-61efe6f3589b service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:58.757035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4ea88-2ca7-4c8b-af1d-61efe6f3589b service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:58.757307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a4ea88-2ca7-4c8b-af1d-61efe6f3589b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:58.759079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d0a4ea88-2ca7-4c8b-af1d-61efe6f3589b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:31:58.770989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4ea88-2ca7-4c8b-af1d-61efe6f3589b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:58.772717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a4ea88-2ca7-4c8b-af1d-61efe6f3589b service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:58.783220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1208/2420] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:58 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:31:59.220351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113510b9-d576-4143-8e69-7a08fd8b2c03 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:31:59.240195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-113510b9-d576-4143-8e69-7a08fd8b2c03 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:31:59.240195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39df15af-9339-4f97-9ee9-c10a296ce270 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:31:59.240195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df15af-9339-4f97-9ee9-c10a296ce270 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:31:59.240195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df15af-9339-4f97-9ee9-c10a296ce270 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:31:59.240773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39df15af-9339-4f97-9ee9-c10a296ce270 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:31:59.245147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df15af-9339-4f97-9ee9-c10a296ce270 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:31:59.246624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39df15af-9339-4f97-9ee9-c10a296ce270 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:31:59.257338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1213/2421] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:31:59 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:01.107055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4ea88-2ca7-4c8b-af1d-61efe6f3589b service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:01.109097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d0a4ea88-2ca7-4c8b-af1d-61efe6f3589b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:01.130417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c25b8-ff4e-4963-9943-3d3058be3f35 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:01.130930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c25b8-ff4e-4963-9943-3d3058be3f35 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:01.131033 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b77c25b8-ff4e-4963-9943-3d3058be3f35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:01.151610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b77c25b8-ff4e-4963-9943-3d3058be3f35 None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:01.153123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b77c25b8-ff4e-4963-9943-3d3058be3f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:01.192762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a4ea88-2ca7-4c8b-af1d-61efe6f3589b service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:01.198340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c1383-ea42-4a23-8d56-6f92ed9af2c5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:01.198950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c1383-ea42-4a23-8d56-6f92ed9af2c5 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:01.199230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c1383-ea42-4a23-8d56-6f92ed9af2c5 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:01.199505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002c1383-ea42-4a23-8d56-6f92ed9af2c5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:01.202470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-002c1383-ea42-4a23-8d56-6f92ed9af2c5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:01.210285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1214/2422] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:32:01 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:32:01.225114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c25b8-ff4e-4963-9943-3d3058be3f35 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:01.226460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b77c25b8-ff4e-4963-9943-3d3058be3f35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:01.244184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:01.261949 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c1383-ea42-4a23-8d56-6f92ed9af2c5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:01.263673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-002c1383-ea42-4a23-8d56-6f92ed9af2c5 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:01.272747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1209/2423] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:01 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:01.298206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b77c25b8-ff4e-4963-9943-3d3058be3f35 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:01.303353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6539fa1-8c05-4e01-9fc8-9a5aab5a8b90 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:01.303964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6539fa1-8c05-4e01-9fc8-9a5aab5a8b90 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:01.304301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6539fa1-8c05-4e01-9fc8-9a5aab5a8b90 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:01.305596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6539fa1-8c05-4e01-9fc8-9a5aab5a8b90 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:01.313593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6539fa1-8c05-4e01-9fc8-9a5aab5a8b90 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:01.315173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6539fa1-8c05-4e01-9fc8-9a5aab5a8b90 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:01.323674 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1215/2424] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:32:01 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Sep 24 14:32:03.332849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c1383-ea42-4a23-8d56-6f92ed9af2c5 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:03.422222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002c1383-ea42-4a23-8d56-6f92ed9af2c5 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:03.427187 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:03.427854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:03.428133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:03.428454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] PATH_INFO: `/v3/users/b4e3dc88517e47a9b32665398aebb592` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:03.430095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b4e3dc88517e47a9b32665398aebb592)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:03.432038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:03.488875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b4e3dc88517e47a9b32665398aebb592'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:03.489601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b4e3dc88517e47a9b32665398aebb592'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:03.503651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b4e3dc88517e47a9b32665398aebb592'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:03.507552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b4e3dc88517e47a9b32665398aebb592'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:03.515952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b4e3dc88517e47a9b32665398aebb592'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:03.529779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1210/2425] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:03 2022] DELETE /identity/v3/users/b4e3dc88517e47a9b32665398aebb592 => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:03.534256 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249956ee-a18c-4421-9a70-d12bbdb472b9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:03.534760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249956ee-a18c-4421-9a70-d12bbdb472b9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:03.534954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-249956ee-a18c-4421-9a70-d12bbdb472b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:03.555299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-249956ee-a18c-4421-9a70-d12bbdb472b9 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:03.556586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-249956ee-a18c-4421-9a70-d12bbdb472b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:03.589887 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:03.621529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1216/2426] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:03.635015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:03.635015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:03.692784 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c1141f-aa9b-4362-b812-7aa94f6017a2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:03.696751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610feb5-fee9-4162-8cef-a15010e75a03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:03.697441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610feb5-fee9-4162-8cef-a15010e75a03 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:03.698131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610feb5-fee9-4162-8cef-a15010e75a03 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:03.698483 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9610feb5-fee9-4162-8cef-a15010e75a03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:03.711828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610feb5-fee9-4162-8cef-a15010e75a03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:03.713313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9610feb5-fee9-4162-8cef-a15010e75a03 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:03.724436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1211/2427] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:04.038332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249956ee-a18c-4421-9a70-d12bbdb472b9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:04.041812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-249956ee-a18c-4421-9a70-d12bbdb472b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:04.071448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-249956ee-a18c-4421-9a70-d12bbdb472b9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:04.076609 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:04.077400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:04.077807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:04.078087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] PATH_INFO: `/v3/projects/c3c96c0ce814437b977969a0a7148ef5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:04.079245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c3c96c0ce814437b977969a0a7148ef5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:04.081491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:04.155902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c3c96c0ce814437b977969a0a7148ef5', 'request_id': 'req-9f6ad9ba-d0e0-4ad7-a296-589884c62575'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.162812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c3c96c0ce814437b977969a0a7148ef5', 'request_id': 'req-9f6ad9ba-d0e0-4ad7-a296-589884c62575'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.171009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c3c96c0ce814437b977969a0a7148ef5', 'request_id': 'req-9f6ad9ba-d0e0-4ad7-a296-589884c62575'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.188542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] The token cache is being invalidate because project c3c96c0ce814437b977969a0a7148ef5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:04.188993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.192588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.202065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1217/2428] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:04 2022] DELETE /identity/v3/projects/c3c96c0ce814437b977969a0a7148ef5 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:04.206221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610feb5-fee9-4162-8cef-a15010e75a03 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:04.213340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:04.222772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9610feb5-fee9-4162-8cef-a15010e75a03 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:04.290481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:04.291039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:04.291320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:04.291595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] PATH_INFO: `/v3/users/9acce85c4bfd40d9b0537674a03a2309` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:04.292796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9acce85c4bfd40d9b0537674a03a2309)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:04.294998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:04.352761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9acce85c4bfd40d9b0537674a03a2309'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.354054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9acce85c4bfd40d9b0537674a03a2309'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.368748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9acce85c4bfd40d9b0537674a03a2309'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.369446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9acce85c4bfd40d9b0537674a03a2309'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.376431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9acce85c4bfd40d9b0537674a03a2309'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.390718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1212/2429] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:04 2022] DELETE /identity/v3/users/9acce85c4bfd40d9b0537674a03a2309 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:04.743137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:04.744845 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:04.758424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6ad9ba-d0e0-4ad7-a296-589884c62575 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:04.825136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:04.825693 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:04.825976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:04.826256 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] PATH_INFO: `/v3/projects/caf6f0e9c6524491b74e4c0916615ea8` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:04.827368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] RBAC: Authorizing `identity:delete_project(project_id=caf6f0e9c6524491b74e4c0916615ea8)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:04.829436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:04.880615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'caf6f0e9c6524491b74e4c0916615ea8', 'request_id': 'req-cf76e28c-a900-4527-ab91-784f3a378e93'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.886869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'caf6f0e9c6524491b74e4c0916615ea8', 'request_id': 'req-cf76e28c-a900-4527-ab91-784f3a378e93'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.891907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:04.893187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'caf6f0e9c6524491b74e4c0916615ea8', 'request_id': 'req-cf76e28c-a900-4527-ab91-784f3a378e93'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.910426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] The token cache is being invalidate because project caf6f0e9c6524491b74e4c0916615ea8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:04.910745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.911359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:04.913212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1218/2430] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:04 2022] DELETE /identity/v3/projects/caf6f0e9c6524491b74e4c0916615ea8 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:04.917318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:04.918723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:04.932465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14abd6e-1c2d-4ddb-a568-a4c34afd6c15 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:04.993725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:04.994366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:04.994645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:04.994942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] PATH_INFO: `/v3/users/19d0e3a6fdcb48c2b3e1adae32c5c322` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:04.996080 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] RBAC: Authorizing `identity:delete_user(user_id=19d0e3a6fdcb48c2b3e1adae32c5c322)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:04.998091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:05.021443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:05.053405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19d0e3a6fdcb48c2b3e1adae32c5c322'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:05.054061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19d0e3a6fdcb48c2b3e1adae32c5c322'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:05.068912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19d0e3a6fdcb48c2b3e1adae32c5c322'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:05.069632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19d0e3a6fdcb48c2b3e1adae32c5c322'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:05.077267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19d0e3a6fdcb48c2b3e1adae32c5c322'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:05.097331 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1213/2431] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:04 2022] DELETE /identity/v3/users/19d0e3a6fdcb48c2b3e1adae32c5c322 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:05.441774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:05.443700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:05.458795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf76e28c-a900-4527-ab91-784f3a378e93 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:05.546765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:05.547406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:05.547680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:05.547954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] PATH_INFO: `/v3/projects/ffdbf10db9e341169337468f04351c45` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:05.549125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ffdbf10db9e341169337468f04351c45)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:05.551038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:05.602060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ffdbf10db9e341169337468f04351c45', 'request_id': 'req-47f6f5f5-8804-4852-b4dc-35ef4521a401'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:05.608650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ffdbf10db9e341169337468f04351c45', 'request_id': 'req-47f6f5f5-8804-4852-b4dc-35ef4521a401'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:05.614888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ffdbf10db9e341169337468f04351c45', 'request_id': 'req-47f6f5f5-8804-4852-b4dc-35ef4521a401'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:05.628914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] The token cache is being invalidate because project ffdbf10db9e341169337468f04351c45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:05.629220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:05.629837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-47f6f5f5-8804-4852-b4dc-35ef4521a401 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:05.638412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1219/2432] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:05 2022] DELETE /identity/v3/projects/ffdbf10db9e341169337468f04351c45 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:14.251324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:14.252891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:14.331705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a6f8dd-18b7-4e68-a737-143d0a2b000e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:14.403518 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c679698a-3ff0-4152-8c3a-b01c91e3c70c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:14.404119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679698a-3ff0-4152-8c3a-b01c91e3c70c service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:14.404420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679698a-3ff0-4152-8c3a-b01c91e3c70c service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:14.404690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c679698a-3ff0-4152-8c3a-b01c91e3c70c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:14.406401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c679698a-3ff0-4152-8c3a-b01c91e3c70c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:14.446295 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:14.472088 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679698a-3ff0-4152-8c3a-b01c91e3c70c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:14.473735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c679698a-3ff0-4152-8c3a-b01c91e3c70c service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:14.483580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1214/2433] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:14 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:15.625627 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=54,keystone:INSERT=2,keystone:DELETE=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:16.581548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756cc29-66eb-4045-b785-843103ecfcfb None None] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:16.582121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756cc29-66eb-4045-b785-843103ecfcfb None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:16.582584 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e756cc29-66eb-4045-b785-843103ecfcfb None None] PATH_INFO: `/` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:16.586015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1220/2434] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:32:16 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:32:16.593871 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d00be-fd69-4a9a-9526-a3f6a1ae88a2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:16.594438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d00be-fd69-4a9a-9526-a3f6a1ae88a2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:16.594861 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1d00be-fd69-4a9a-9526-a3f6a1ae88a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:16.628056 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8f1d00be-fd69-4a9a-9526-a3f6a1ae88a2 None None] MFA Rules not processed for user `7014b2868d4b4acea242d068f247c21f`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:16.630176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8f1d00be-fd69-4a9a-9526-a3f6a1ae88a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:16.706136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1215/2435] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:32:16 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:16.721036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756cc29-66eb-4045-b785-843103ecfcfb None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:16.722963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e756cc29-66eb-4045-b785-843103ecfcfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:16.738001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e756cc29-66eb-4045-b785-843103ecfcfb None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:16.742174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7ea05-5938-4887-bf44-96a3840b4960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:16.742901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ea05-5938-4887-bf44-96a3840b4960 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:16.743347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ea05-5938-4887-bf44-96a3840b4960 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:16.743758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7ea05-5938-4887-bf44-96a3840b4960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:16.751938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7ea05-5938-4887-bf44-96a3840b4960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:16.753502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af7ea05-5938-4887-bf44-96a3840b4960 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:16.762461 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1221/2436] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:16 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:32:16.853608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901021-d769-4c4c-b52d-c9a70fbbbc19 None None] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:16.853850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901021-d769-4c4c-b52d-c9a70fbbbc19 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:16.854179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92901021-d769-4c4c-b52d-c9a70fbbbc19 None None] PATH_INFO: `/` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:16.855525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1216/2437] 10.222.0.16 () {54 vars in 921 bytes} [Sat Sep 24 14:32:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Sep 24 14:32:16.861969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6fd3c-7897-4fdf-8c24-8b4d76c9ca43 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:16.862266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6fd3c-7897-4fdf-8c24-8b4d76c9ca43 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:16.862603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f6fd3c-7897-4fdf-8c24-8b4d76c9ca43 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:16.884502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a6f6fd3c-7897-4fdf-8c24-8b4d76c9ca43 None None] MFA Rules not processed for user `758be68931aa49e5828bc2c164940571`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:16.885697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a6f6fd3c-7897-4fdf-8c24-8b4d76c9ca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:16.898501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1222/2438] 10.222.0.16 () {58 vars in 1018 bytes} [Sat Sep 24 14:32:16 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:32:16.909481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901021-d769-4c4c-b52d-c9a70fbbbc19 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:16.920952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92901021-d769-4c4c-b52d-c9a70fbbbc19 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:16.924589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bdefc1f-6b2d-4d49-9fb6-8531b49fed02 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:16.925175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdefc1f-6b2d-4d49-9fb6-8531b49fed02 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:16.925451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdefc1f-6b2d-4d49-9fb6-8531b49fed02 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:16.925721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdefc1f-6b2d-4d49-9fb6-8531b49fed02 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:16.935790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdefc1f-6b2d-4d49-9fb6-8531b49fed02 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:16.937242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bdefc1f-6b2d-4d49-9fb6-8531b49fed02 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:16.951225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1217/2439] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:16 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:17.442909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6fd3c-7897-4fdf-8c24-8b4d76c9ca43 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:17.449763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a6f6fd3c-7897-4fdf-8c24-8b4d76c9ca43 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:17.522819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f6fd3c-7897-4fdf-8c24-8b4d76c9ca43 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:17.538158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a91302-1a73-44b3-8285-6798dc54226b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:17.539885 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a91302-1a73-44b3-8285-6798dc54226b service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:17.540181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a91302-1a73-44b3-8285-6798dc54226b service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:17.540587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a91302-1a73-44b3-8285-6798dc54226b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:17.542650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-44a91302-1a73-44b3-8285-6798dc54226b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:17.558534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a91302-1a73-44b3-8285-6798dc54226b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:17.560122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a91302-1a73-44b3-8285-6798dc54226b service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:17.577760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1223/2440] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:17 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:32:19.855040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6bea0-87b1-47b0-a644-bc81909efc9c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:19.855512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6bea0-87b1-47b0-a644-bc81909efc9c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:19.855512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb6bea0-87b1-47b0-a644-bc81909efc9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:19.874903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7cb6bea0-87b1-47b0-a644-bc81909efc9c None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:19.876083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7cb6bea0-87b1-47b0-a644-bc81909efc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:19.938230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1218/2441] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 24 14:32:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:19.951114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a91302-1a73-44b3-8285-6798dc54226b service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:19.952556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-44a91302-1a73-44b3-8285-6798dc54226b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:20.027397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a91302-1a73-44b3-8285-6798dc54226b service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:20.032461 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8928d-f28b-4c4b-8103-586f19d5c961 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:20.033068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8928d-f28b-4c4b-8103-586f19d5c961 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:20.033346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8928d-f28b-4c4b-8103-586f19d5c961 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:20.033621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a8928d-f28b-4c4b-8103-586f19d5c961 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:20.042277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8928d-f28b-4c4b-8103-586f19d5c961 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:20.043994 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a8928d-f28b-4c4b-8103-586f19d5c961 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:20.052390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1224/2442] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:32:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:32:25.896516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6bea0-87b1-47b0-a644-bc81909efc9c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:25.898097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7cb6bea0-87b1-47b0-a644-bc81909efc9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:25.915648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb6bea0-87b1-47b0-a644-bc81909efc9c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:25.921218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b16d0c-0cbf-4707-8676-970a135d9ba4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:25.921831 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b16d0c-0cbf-4707-8676-970a135d9ba4 service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:25.922111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b16d0c-0cbf-4707-8676-970a135d9ba4 service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:25.922386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b16d0c-0cbf-4707-8676-970a135d9ba4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:25.924112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d6b16d0c-0cbf-4707-8676-970a135d9ba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:25.937103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b16d0c-0cbf-4707-8676-970a135d9ba4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:25.938990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b16d0c-0cbf-4707-8676-970a135d9ba4 service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:25.956827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1219/2443] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:30.049049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=47 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:32.508954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8928d-f28b-4c4b-8103-586f19d5c961 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:32.510605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a0a8928d-f28b-4c4b-8103-586f19d5c961 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:32.523984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a8928d-f28b-4c4b-8103-586f19d5c961 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:32.527706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088882d-ef9d-4a33-b8e4-1cc394e1acc6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:32.528350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088882d-ef9d-4a33-b8e4-1cc394e1acc6 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:32.528629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088882d-ef9d-4a33-b8e4-1cc394e1acc6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:32.528904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2088882d-ef9d-4a33-b8e4-1cc394e1acc6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:32.530648 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2088882d-ef9d-4a33-b8e4-1cc394e1acc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:32.600765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088882d-ef9d-4a33-b8e4-1cc394e1acc6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:32.602214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2088882d-ef9d-4a33-b8e4-1cc394e1acc6 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:32.612609 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1225/2444] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:35.951897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=71 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:35.961505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b16d0c-0cbf-4707-8676-970a135d9ba4 service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:35.963065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d6b16d0c-0cbf-4707-8676-970a135d9ba4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:36.046820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088882d-ef9d-4a33-b8e4-1cc394e1acc6 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:36.048873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2088882d-ef9d-4a33-b8e4-1cc394e1acc6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:36.064053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2088882d-ef9d-4a33-b8e4-1cc394e1acc6 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:36.070195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:36.070843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.071179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.071392 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] PATH_INFO: `/v3/users/5a3a7f87ef4349eb9b21745be3a6b8ea` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.072562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=5a3a7f87ef4349eb9b21745be3a6b8ea)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:36.074503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:36.083099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b16d0c-0cbf-4707-8676-970a135d9ba4 service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:36.090725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb6f23-d5ad-4c15-a706-2e5644c73335 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc00e6583d7424cbdc13732a962fc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:36.091343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6f23-d5ad-4c15-a706-2e5644c73335 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.091624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6f23-d5ad-4c15-a706-2e5644c73335 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.091897 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fb6f23-d5ad-4c15-a706-2e5644c73335 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.094311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-21fb6f23-d5ad-4c15-a706-2e5644c73335 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:36.119174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb6f23-d5ad-4c15-a706-2e5644c73335 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:36.120762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fb6f23-d5ad-4c15-a706-2e5644c73335 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:36.141418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1220/2445] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:35 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 181 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:36.142260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5a3a7f87ef4349eb9b21745be3a6b8ea'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:36.143037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5a3a7f87ef4349eb9b21745be3a6b8ea'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:36.143663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5a3a7f87ef4349eb9b21745be3a6b8ea'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:36.155150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5a3a7f87ef4349eb9b21745be3a6b8ea'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:36.179934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-6ce5f224-a44e-48d9-afd2-46f2068ae0ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5a3a7f87ef4349eb9b21745be3a6b8ea'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:36.192369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1226/2446] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:36 2022] DELETE /identity/v3/users/5a3a7f87ef4349eb9b21745be3a6b8ea => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:36.368805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb6f23-d5ad-4c15-a706-2e5644c73335 service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:36.379498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fb6f23-d5ad-4c15-a706-2e5644c73335 service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:36.447403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:36.448034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.448363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.448657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] PATH_INFO: `/v3/projects/50558a555112422aa524ccc099ebbadc` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.449759 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=50558a555112422aa524ccc099ebbadc)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:36.451698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:36.499267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '50558a555112422aa524ccc099ebbadc', 'request_id': 'req-b5d609dc-220c-4c55-a120-738e908e33eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:36.504869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '50558a555112422aa524ccc099ebbadc', 'request_id': 'req-b5d609dc-220c-4c55-a120-738e908e33eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:36.512344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '50558a555112422aa524ccc099ebbadc', 'request_id': 'req-b5d609dc-220c-4c55-a120-738e908e33eb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:36.524027 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] The token cache is being invalidate because project 50558a555112422aa524ccc099ebbadc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:36.524354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:36.524977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b5d609dc-220c-4c55-a120-738e908e33eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:36.526489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1221/2447] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:36 2022] DELETE /identity/v3/projects/50558a555112422aa524ccc099ebbadc => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:36.532530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d675-68b8-4632-9aa4-e35ca7a31c89 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.532966 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d675-68b8-4632-9aa4-e35ca7a31c89 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.533250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f1d675-68b8-4632-9aa4-e35ca7a31c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.553093 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c6f1d675-68b8-4632-9aa4-e35ca7a31c89 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:36.554301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c6f1d675-68b8-4632-9aa4-e35ca7a31c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:36.614928 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1227/2448] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:36.623209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcab86-6f6c-492f-b4f6-d29401b95039 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.623433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcab86-6f6c-492f-b4f6-d29401b95039 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.623708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effcab86-6f6c-492f-b4f6-d29401b95039 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.643369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-effcab86-6f6c-492f-b4f6-d29401b95039 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:36.644636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-effcab86-6f6c-492f-b4f6-d29401b95039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:36.653013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1222/2449] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:36.657204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1d675-68b8-4632-9aa4-e35ca7a31c89 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:36.667741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f1d675-68b8-4632-9aa4-e35ca7a31c89 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:36.673526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baac47-8b7f-42b1-a1d6-e8663133ee94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:36.674297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baac47-8b7f-42b1-a1d6-e8663133ee94 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.674688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baac47-8b7f-42b1-a1d6-e8663133ee94 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.674962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54baac47-8b7f-42b1-a1d6-e8663133ee94 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.675616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baac47-8b7f-42b1-a1d6-e8663133ee94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:32:36.675920 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baac47-8b7f-42b1-a1d6-e8663133ee94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:36.678142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54baac47-8b7f-42b1-a1d6-e8663133ee94 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:36.681316 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:36.696258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1228/2450] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:32:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:32:36.700676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcab86-6f6c-492f-b4f6-d29401b95039 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:36.710493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effcab86-6f6c-492f-b4f6-d29401b95039 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:36.715173 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494d12f-75e1-4c59-ac62-dec0b532f92d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:36.715760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d12f-75e1-4c59-ac62-dec0b532f92d admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.716037 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d12f-75e1-4c59-ac62-dec0b532f92d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.716334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c494d12f-75e1-4c59-ac62-dec0b532f92d admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.716952 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494d12f-75e1-4c59-ac62-dec0b532f92d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:36.718836 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c494d12f-75e1-4c59-ac62-dec0b532f92d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:36.730699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:36.748194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1223/2451] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:36 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:36.752443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baac47-8b7f-42b1-a1d6-e8663133ee94 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:36.763851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54baac47-8b7f-42b1-a1d6-e8663133ee94 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:36.818876 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271754b-934f-470e-b895-39056c5509bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:36.819465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271754b-934f-470e-b895-39056c5509bd admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.819741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271754b-934f-470e-b895-39056c5509bd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.820010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271754b-934f-470e-b895-39056c5509bd admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.820655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271754b-934f-470e-b895-39056c5509bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:36.822537 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271754b-934f-470e-b895-39056c5509bd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:36.845276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1229/2452] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:36 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:36.850382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494d12f-75e1-4c59-ac62-dec0b532f92d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:36.860731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c494d12f-75e1-4c59-ac62-dec0b532f92d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:36.865366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409e5e5-a9ec-4314-927f-e2070afdf35a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:36.865968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409e5e5-a9ec-4314-927f-e2070afdf35a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.866306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409e5e5-a9ec-4314-927f-e2070afdf35a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.866522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2409e5e5-a9ec-4314-927f-e2070afdf35a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.867161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409e5e5-a9ec-4314-927f-e2070afdf35a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:36.868809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2409e5e5-a9ec-4314-927f-e2070afdf35a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:36.878683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1224/2453] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:36.883019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271754b-934f-470e-b895-39056c5509bd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:36.897563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271754b-934f-470e-b895-39056c5509bd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:36.902634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b455d0-50da-4579-a50d-eb3d1d7740db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:36.903230 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b455d0-50da-4579-a50d-eb3d1d7740db admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.903504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b455d0-50da-4579-a50d-eb3d1d7740db admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.903773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b455d0-50da-4579-a50d-eb3d1d7740db admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.904441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b455d0-50da-4579-a50d-eb3d1d7740db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:36.906044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b455d0-50da-4579-a50d-eb3d1d7740db admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:36.917005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1230/2454] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:36.921327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409e5e5-a9ec-4314-927f-e2070afdf35a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:36.931189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2409e5e5-a9ec-4314-927f-e2070afdf35a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:36.935763 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0bf83-1214-4205-bb9c-475cba89d78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:36.936440 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0bf83-1214-4205-bb9c-475cba89d78d admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.936723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0bf83-1214-4205-bb9c-475cba89d78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.937000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e0bf83-1214-4205-bb9c-475cba89d78d admin admin] PATH_INFO: `/v3/projects/76fb9464c91a4c24a6a072c56debe2bb/users/9192bcd9ef814746a6d161bf6b84ee93/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:36.952825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0bf83-1214-4205-bb9c-475cba89d78d admin admin] RBAC: Authorizing `identity:create_grant(project_id=76fb9464c91a4c24a6a072c56debe2bb, user_id=9192bcd9ef814746a6d161bf6b84ee93, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:36.955723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e0bf83-1214-4205-bb9c-475cba89d78d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:36.971302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1225/2455] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:36 2022] PUT /identity/v3/projects/76fb9464c91a4c24a6a072c56debe2bb/users/9192bcd9ef814746a6d161bf6b84ee93/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:36.981544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff2772-5386-4e65-aec6-064bba715802 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:36.981831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff2772-5386-4e65-aec6-064bba715802 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:36.982111 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff2772-5386-4e65-aec6-064bba715802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.010300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-beff2772-5386-4e65-aec6-064bba715802 None None] MFA Rules not processed for user `9192bcd9ef814746a6d161bf6b84ee93`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:37.011503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-beff2772-5386-4e65-aec6-064bba715802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:37.080336 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1231/2456] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:36 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:37.085608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0bf83-1214-4205-bb9c-475cba89d78d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:37.149412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e0bf83-1214-4205-bb9c-475cba89d78d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:37.154060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdfc31-b039-4ce8-9fc9-ad48b61dfe42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:37.154657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdfc31-b039-4ce8-9fc9-ad48b61dfe42 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.154934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdfc31-b039-4ce8-9fc9-ad48b61dfe42 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.155205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cdfc31-b039-4ce8-9fc9-ad48b61dfe42 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.155826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdfc31-b039-4ce8-9fc9-ad48b61dfe42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:37.157761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cdfc31-b039-4ce8-9fc9-ad48b61dfe42 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:37.187561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1226/2457] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:37 2022] POST /identity/v3/projects => generated 387 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:32:37.188893 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff2772-5386-4e65-aec6-064bba715802 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:37.200606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff2772-5386-4e65-aec6-064bba715802 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:37.259822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8dce9-f169-4d88-954a-00d68b2428df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:37.260457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8dce9-f169-4d88-954a-00d68b2428df admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.260734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8dce9-f169-4d88-954a-00d68b2428df admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.261005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d8dce9-f169-4d88-954a-00d68b2428df admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.261635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8dce9-f169-4d88-954a-00d68b2428df admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:37.263559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d8dce9-f169-4d88-954a-00d68b2428df admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:37.275464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:37.284544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdfc31-b039-4ce8-9fc9-ad48b61dfe42 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:37.287206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f0cdfc31-b039-4ce8-9fc9-ad48b61dfe42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:37.292623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1232/2458] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:37 2022] POST /identity/v3/users => generated 300 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:37.296873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8dce9-f169-4d88-954a-00d68b2428df admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:37.307988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d8dce9-f169-4d88-954a-00d68b2428df admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:37.313480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58cf24-22c4-4a72-8201-80233f509b47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:37.314078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58cf24-22c4-4a72-8201-80233f509b47 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.314355 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58cf24-22c4-4a72-8201-80233f509b47 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.314625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f58cf24-22c4-4a72-8201-80233f509b47 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.315290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58cf24-22c4-4a72-8201-80233f509b47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:37.317089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f58cf24-22c4-4a72-8201-80233f509b47 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:37.329082 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1233/2459] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:32:37.333549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58cf24-22c4-4a72-8201-80233f509b47 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:37.343147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f58cf24-22c4-4a72-8201-80233f509b47 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:37.348574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873f49-6a6a-4494-9de9-6b6d80a811d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:37.349419 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873f49-6a6a-4494-9de9-6b6d80a811d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.349840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873f49-6a6a-4494-9de9-6b6d80a811d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.350300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76873f49-6a6a-4494-9de9-6b6d80a811d6 admin admin] PATH_INFO: `/v3/projects/79003e0ea55c4627b1e9536a3dd27447/users/3ab9cab0da5b4e5c875b78cb6b341c06/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.356836 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cdfc31-b039-4ce8-9fc9-ad48b61dfe42 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:37.362617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd233443-3f62-4fb2-8d7d-163c56b07f81 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:37.363563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd233443-3f62-4fb2-8d7d-163c56b07f81 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.364019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd233443-3f62-4fb2-8d7d-163c56b07f81 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.364524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd233443-3f62-4fb2-8d7d-163c56b07f81 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.367795 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dd233443-3f62-4fb2-8d7d-163c56b07f81 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:37.373886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873f49-6a6a-4494-9de9-6b6d80a811d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79003e0ea55c4627b1e9536a3dd27447, user_id=3ab9cab0da5b4e5c875b78cb6b341c06, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:37.376673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76873f49-6a6a-4494-9de9-6b6d80a811d6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:37.382485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd233443-3f62-4fb2-8d7d-163c56b07f81 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:37.383918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd233443-3f62-4fb2-8d7d-163c56b07f81 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:37.390538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1234/2460] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:37 2022] PUT /identity/v3/projects/79003e0ea55c4627b1e9536a3dd27447/users/3ab9cab0da5b4e5c875b78cb6b341c06/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:37.394557 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873f49-6a6a-4494-9de9-6b6d80a811d6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:37.395181 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1227/2461] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:37.462607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76873f49-6a6a-4494-9de9-6b6d80a811d6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:37.467488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-073c1abd-133e-48dd-8b34-abf0830b72d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:37.468129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c1abd-133e-48dd-8b34-abf0830b72d3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.468395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c1abd-133e-48dd-8b34-abf0830b72d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.468669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-073c1abd-133e-48dd-8b34-abf0830b72d3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.469318 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c1abd-133e-48dd-8b34-abf0830b72d3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:37.470914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-073c1abd-133e-48dd-8b34-abf0830b72d3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:37.487181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1235/2462] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:37 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:32:37.491397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd233443-3f62-4fb2-8d7d-163c56b07f81 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:37.501294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd233443-3f62-4fb2-8d7d-163c56b07f81 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:37.506796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bbb3a-48e7-4e27-87b2-eb1e9a9eab25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:37.507458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bbb3a-48e7-4e27-87b2-eb1e9a9eab25 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.508229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bbb3a-48e7-4e27-87b2-eb1e9a9eab25 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.508229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317bbb3a-48e7-4e27-87b2-eb1e9a9eab25 admin admin] PATH_INFO: `/v3/projects/79003e0ea55c4627b1e9536a3dd27447/users/3ab9cab0da5b4e5c875b78cb6b341c06/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.510064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bbb3a-48e7-4e27-87b2-eb1e9a9eab25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79003e0ea55c4627b1e9536a3dd27447, user_id=3ab9cab0da5b4e5c875b78cb6b341c06, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:37.512754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-317bbb3a-48e7-4e27-87b2-eb1e9a9eab25 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:37.525884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1228/2463] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:37 2022] PUT /identity/v3/projects/79003e0ea55c4627b1e9536a3dd27447/users/3ab9cab0da5b4e5c875b78cb6b341c06/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:37.535528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3c0a7-6d82-4a04-9b74-24c5fc575e85 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.535816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3c0a7-6d82-4a04-9b74-24c5fc575e85 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.536104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f3c0a7-6d82-4a04-9b74-24c5fc575e85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.565727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-51f3c0a7-6d82-4a04-9b74-24c5fc575e85 None None] MFA Rules not processed for user `3ab9cab0da5b4e5c875b78cb6b341c06`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:37.566949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-51f3c0a7-6d82-4a04-9b74-24c5fc575e85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:37.637091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1236/2464] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:37.649853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bbb3a-48e7-4e27-87b2-eb1e9a9eab25 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:37.651650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-317bbb3a-48e7-4e27-87b2-eb1e9a9eab25 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:37.688096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:37.713895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317bbb3a-48e7-4e27-87b2-eb1e9a9eab25 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:37.717657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948154a-b373-4ecb-a517-68d3d56a5479 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:37.718267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948154a-b373-4ecb-a517-68d3d56a5479 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.718547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948154a-b373-4ecb-a517-68d3d56a5479 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.718823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948154a-b373-4ecb-a517-68d3d56a5479 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.730332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948154a-b373-4ecb-a517-68d3d56a5479 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:37.731765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948154a-b373-4ecb-a517-68d3d56a5479 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:37.741981 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1229/2465] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:37 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:37.771837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3c0a7-6d82-4a04-9b74-24c5fc575e85 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:37.815723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:37.838942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f3c0a7-6d82-4a04-9b74-24c5fc575e85 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:37.843657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:37.844432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.844709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.844989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] PATH_INFO: `/v3/users/9192bcd9ef814746a6d161bf6b84ee93` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.846174 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=9192bcd9ef814746a6d161bf6b84ee93)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:37.848080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:37.907848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9192bcd9ef814746a6d161bf6b84ee93'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:37.909099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9192bcd9ef814746a6d161bf6b84ee93'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:37.910132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9192bcd9ef814746a6d161bf6b84ee93'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:37.922632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9192bcd9ef814746a6d161bf6b84ee93'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:37.940619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9192bcd9ef814746a6d161bf6b84ee93'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:37.961407 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1237/2466] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:37 2022] DELETE /identity/v3/users/9192bcd9ef814746a6d161bf6b84ee93 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:37.968198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd8fa-e4bd-48b0-9423-b93884707437 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:37.968698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd8fa-e4bd-48b0-9423-b93884707437 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:37.969085 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fedd8fa-e4bd-48b0-9423-b93884707437 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:37.999557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9fedd8fa-e4bd-48b0-9423-b93884707437 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:38.001579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9fedd8fa-e4bd-48b0-9423-b93884707437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:38.087037 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1230/2467] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:38.097635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:38.099517 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:38.161569 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35da945b-45d8-499c-9c66-5c310af3a6dc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:38.165625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a16158-1df5-4c0c-a6f8-0032d7925743 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:38.166445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a16158-1df5-4c0c-a6f8-0032d7925743 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:38.166850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a16158-1df5-4c0c-a6f8-0032d7925743 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:38.167185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a16158-1df5-4c0c-a6f8-0032d7925743 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:38.177522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a16158-1df5-4c0c-a6f8-0032d7925743 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:38.179477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a16158-1df5-4c0c-a6f8-0032d7925743 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:38.197694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1238/2468] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:32:38.509778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedd8fa-e4bd-48b0-9423-b93884707437 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:38.515275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9fedd8fa-e4bd-48b0-9423-b93884707437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:38.549265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fedd8fa-e4bd-48b0-9423-b93884707437 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:38.558631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:38.559843 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:38.560475 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:38.560970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] PATH_INFO: `/v3/projects/76fb9464c91a4c24a6a072c56debe2bb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:38.563006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] RBAC: Authorizing `identity:delete_project(project_id=76fb9464c91a4c24a6a072c56debe2bb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:38.566365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:38.659968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '76fb9464c91a4c24a6a072c56debe2bb', 'request_id': 'req-0d4622d7-72ee-4812-a388-7e396fecfa00'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:38.669405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '76fb9464c91a4c24a6a072c56debe2bb', 'request_id': 'req-0d4622d7-72ee-4812-a388-7e396fecfa00'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:38.679876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '76fb9464c91a4c24a6a072c56debe2bb', 'request_id': 'req-0d4622d7-72ee-4812-a388-7e396fecfa00'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:38.723909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] The token cache is being invalidate because project 76fb9464c91a4c24a6a072c56debe2bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:38.724527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:38.727517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:38.736524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a16158-1df5-4c0c-a6f8-0032d7925743 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:38.744965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1231/2469] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:38 2022] DELETE /identity/v3/projects/76fb9464c91a4c24a6a072c56debe2bb => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:38.754625 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a16158-1df5-4c0c-a6f8-0032d7925743 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:38.848730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:38.849825 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:38.850323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:38.850812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] PATH_INFO: `/v3/users/3ab9cab0da5b4e5c875b78cb6b341c06` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:38.852790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3ab9cab0da5b4e5c875b78cb6b341c06)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:38.856478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:38.859405 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:38.928927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3ab9cab0da5b4e5c875b78cb6b341c06'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:38.929829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3ab9cab0da5b4e5c875b78cb6b341c06'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:38.930869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3ab9cab0da5b4e5c875b78cb6b341c06'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:38.944276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3ab9cab0da5b4e5c875b78cb6b341c06'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:38.964743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-04676f2f-b828-4754-a306-5f1e09ac73a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3ab9cab0da5b4e5c875b78cb6b341c06'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:38.979975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1239/2470] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:38 2022] DELETE /identity/v3/users/3ab9cab0da5b4e5c875b78cb6b341c06 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:39.274480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:39.276130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:39.304433 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4622d7-72ee-4812-a388-7e396fecfa00 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:39.379600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:39.387569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:39.388250 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:39.388678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:39.388966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] PATH_INFO: `/v3/projects/79003e0ea55c4627b1e9536a3dd27447` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:39.390463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=79003e0ea55c4627b1e9536a3dd27447)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:39.393183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:39.450421 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79003e0ea55c4627b1e9536a3dd27447', 'request_id': 'req-d9136e14-21a9-43c9-90d1-8f3406d06f72'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:39.456813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79003e0ea55c4627b1e9536a3dd27447', 'request_id': 'req-d9136e14-21a9-43c9-90d1-8f3406d06f72'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:39.467201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79003e0ea55c4627b1e9536a3dd27447', 'request_id': 'req-d9136e14-21a9-43c9-90d1-8f3406d06f72'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:39.485550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] The token cache is being invalidate because project 79003e0ea55c4627b1e9536a3dd27447 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:39.485550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:39.485550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d9136e14-21a9-43c9-90d1-8f3406d06f72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:39.489591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1232/2471] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:39 2022] DELETE /identity/v3/projects/79003e0ea55c4627b1e9536a3dd27447 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:39.491685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baa502-edd7-4f41-aeaa-ebc6e93323f6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:39.492139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baa502-edd7-4f41-aeaa-ebc6e93323f6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:39.492285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9baa502-edd7-4f41-aeaa-ebc6e93323f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:39.519423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e9baa502-edd7-4f41-aeaa-ebc6e93323f6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:39.519617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e9baa502-edd7-4f41-aeaa-ebc6e93323f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:39.621750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1240/2472] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:32:39.629246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd178430-8e4d-4573-b8ab-84d0e9540c81 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:39.629464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd178430-8e4d-4573-b8ab-84d0e9540c81 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:39.629737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd178430-8e4d-4573-b8ab-84d0e9540c81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:39.650092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-fd178430-8e4d-4573-b8ab-84d0e9540c81 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:39.651326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-fd178430-8e4d-4573-b8ab-84d0e9540c81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:39.659385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1233/2473] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:39.663835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9baa502-edd7-4f41-aeaa-ebc6e93323f6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:39.676274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9baa502-edd7-4f41-aeaa-ebc6e93323f6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:39.683047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b1ee-1e65-4d93-8cb5-6f98f1338377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:39.684070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b1ee-1e65-4d93-8cb5-6f98f1338377 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:39.684449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b1ee-1e65-4d93-8cb5-6f98f1338377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:39.684802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc97b1ee-1e65-4d93-8cb5-6f98f1338377 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:39.685539 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b1ee-1e65-4d93-8cb5-6f98f1338377 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:32:39.686280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b1ee-1e65-4d93-8cb5-6f98f1338377 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:39.689035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc97b1ee-1e65-4d93-8cb5-6f98f1338377 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:39.705934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1241/2474] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:32:39.711842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd178430-8e4d-4573-b8ab-84d0e9540c81 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:39.721984 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd178430-8e4d-4573-b8ab-84d0e9540c81 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:39.731084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d0cf6-a831-4fe2-bf77-071b35608694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:39.732419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d0cf6-a831-4fe2-bf77-071b35608694 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:39.732954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d0cf6-a831-4fe2-bf77-071b35608694 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:39.733537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9d0cf6-a831-4fe2-bf77-071b35608694 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:39.734351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d0cf6-a831-4fe2-bf77-071b35608694 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:39.737914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b9d0cf6-a831-4fe2-bf77-071b35608694 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:39.778721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1234/2475] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:39 2022] POST /identity/v3/projects => generated 409 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:39.779943 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b1ee-1e65-4d93-8cb5-6f98f1338377 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:39.791779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc97b1ee-1e65-4d93-8cb5-6f98f1338377 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:39.854760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5290a2-f6f6-4808-986d-0905fedcb8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:39.855938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5290a2-f6f6-4808-986d-0905fedcb8dd admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:39.856251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5290a2-f6f6-4808-986d-0905fedcb8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:39.856560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5290a2-f6f6-4808-986d-0905fedcb8dd admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:39.863850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5290a2-f6f6-4808-986d-0905fedcb8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:39.865959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5290a2-f6f6-4808-986d-0905fedcb8dd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:39.878195 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:39.895338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1242/2476] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:39 2022] POST /identity/v3/users => generated 305 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:39.898194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d0cf6-a831-4fe2-bf77-071b35608694 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:39.916514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9d0cf6-a831-4fe2-bf77-071b35608694 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:39.922197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80d82d-95ec-406a-9fba-52f4f040fb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:39.922999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d82d-95ec-406a-9fba-52f4f040fb65 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:39.923333 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d82d-95ec-406a-9fba-52f4f040fb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:39.923657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d80d82d-95ec-406a-9fba-52f4f040fb65 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:39.924511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80d82d-95ec-406a-9fba-52f4f040fb65 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:39.926131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d80d82d-95ec-406a-9fba-52f4f040fb65 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:39.946496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1235/2477] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:39.947852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5290a2-f6f6-4808-986d-0905fedcb8dd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:39.958888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5290a2-f6f6-4808-986d-0905fedcb8dd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:39.967245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec83337e-b38d-46ba-86c0-65fe2446a2e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:39.967245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83337e-b38d-46ba-86c0-65fe2446a2e3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:39.967245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83337e-b38d-46ba-86c0-65fe2446a2e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:39.967245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec83337e-b38d-46ba-86c0-65fe2446a2e3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:39.967793 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83337e-b38d-46ba-86c0-65fe2446a2e3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:39.969034 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec83337e-b38d-46ba-86c0-65fe2446a2e3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:39.979780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1243/2478] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:39.983881 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80d82d-95ec-406a-9fba-52f4f040fb65 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:39.995328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d80d82d-95ec-406a-9fba-52f4f040fb65 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:39.999987 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f8a42-397e-4378-9bf7-1dc1568ca887 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:40.000674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f8a42-397e-4378-9bf7-1dc1568ca887 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:40.000955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f8a42-397e-4378-9bf7-1dc1568ca887 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:40.001229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8f8a42-397e-4378-9bf7-1dc1568ca887 admin admin] PATH_INFO: `/v3/projects/120b5652e2b144918699e0b3a697c609/users/fadf22ce35d04609af223756e13500b3/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:40.017351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f8a42-397e-4378-9bf7-1dc1568ca887 admin admin] RBAC: Authorizing `identity:create_grant(project_id=120b5652e2b144918699e0b3a697c609, user_id=fadf22ce35d04609af223756e13500b3, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:40.020011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd8f8a42-397e-4378-9bf7-1dc1568ca887 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:40.033794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1236/2479] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:39 2022] PUT /identity/v3/projects/120b5652e2b144918699e0b3a697c609/users/fadf22ce35d04609af223756e13500b3/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:40.044284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937c15-2cca-4587-9410-d0f426565b74 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:40.044626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937c15-2cca-4587-9410-d0f426565b74 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:40.044940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6937c15-2cca-4587-9410-d0f426565b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:40.075954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d6937c15-2cca-4587-9410-d0f426565b74 None None] MFA Rules not processed for user `fadf22ce35d04609af223756e13500b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:40.077209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d6937c15-2cca-4587-9410-d0f426565b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:40.145328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1244/2480] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:40 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:40.150424 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f8a42-397e-4378-9bf7-1dc1568ca887 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:40.220251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8f8a42-397e-4378-9bf7-1dc1568ca887 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:40.225511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09a607-8120-46d7-9f82-c301ddab5a01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:40.226198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09a607-8120-46d7-9f82-c301ddab5a01 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:40.227119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09a607-8120-46d7-9f82-c301ddab5a01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:40.227399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff09a607-8120-46d7-9f82-c301ddab5a01 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:40.228099 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09a607-8120-46d7-9f82-c301ddab5a01 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:40.230504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff09a607-8120-46d7-9f82-c301ddab5a01 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:40.259314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1237/2481] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:40 2022] POST /identity/v3/projects => generated 407 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:40.263452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6937c15-2cca-4587-9410-d0f426565b74 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:40.275127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6937c15-2cca-4587-9410-d0f426565b74 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:40.346850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950587-1b59-4ffc-99c3-59ac64e8c2d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:40.347735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950587-1b59-4ffc-99c3-59ac64e8c2d2 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:40.348170 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950587-1b59-4ffc-99c3-59ac64e8c2d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:40.348512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8950587-1b59-4ffc-99c3-59ac64e8c2d2 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:40.349229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8950587-1b59-4ffc-99c3-59ac64e8c2d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:40.351772 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8950587-1b59-4ffc-99c3-59ac64e8c2d2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:40.379560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1245/2482] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:40 2022] POST /identity/v3/users => generated 310 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:32:40.381548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09a607-8120-46d7-9f82-c301ddab5a01 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:40.395870 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff09a607-8120-46d7-9f82-c301ddab5a01 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:40.406834 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba1ae1-7315-444e-94df-a5a91f6b5831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:40.407486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba1ae1-7315-444e-94df-a5a91f6b5831 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:40.407766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba1ae1-7315-444e-94df-a5a91f6b5831 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:40.408040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ba1ae1-7315-444e-94df-a5a91f6b5831 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:40.408773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba1ae1-7315-444e-94df-a5a91f6b5831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:40.410450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74ba1ae1-7315-444e-94df-a5a91f6b5831 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:40.414023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:40.425034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1238/2483] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:32:40.429084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950587-1b59-4ffc-99c3-59ac64e8c2d2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:40.439717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8950587-1b59-4ffc-99c3-59ac64e8c2d2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:40.445946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b5fb8-fe54-4bed-845e-eb7a3bd20419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:40.446735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b5fb8-fe54-4bed-845e-eb7a3bd20419 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:40.447019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b5fb8-fe54-4bed-845e-eb7a3bd20419 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:40.447293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8b5fb8-fe54-4bed-845e-eb7a3bd20419 admin admin] PATH_INFO: `/v3/projects/223b2821fe6a4436814d1ee55932742f/users/eef7d8042b7e46d18926e411860f1a0e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:40.464143 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b5fb8-fe54-4bed-845e-eb7a3bd20419 admin admin] RBAC: Authorizing `identity:create_grant(project_id=223b2821fe6a4436814d1ee55932742f, user_id=eef7d8042b7e46d18926e411860f1a0e, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:40.467024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8b5fb8-fe54-4bed-845e-eb7a3bd20419 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:40.488732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1246/2484] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:40 2022] PUT /identity/v3/projects/223b2821fe6a4436814d1ee55932742f/users/eef7d8042b7e46d18926e411860f1a0e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:40.492913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba1ae1-7315-444e-94df-a5a91f6b5831 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:40.503410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ba1ae1-7315-444e-94df-a5a91f6b5831 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:40.571772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b4618f-4347-4733-84ca-ab3f3f456a7e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:40.572794 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4618f-4347-4733-84ca-ab3f3f456a7e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:40.573075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4618f-4347-4733-84ca-ab3f3f456a7e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:40.573381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b4618f-4347-4733-84ca-ab3f3f456a7e admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:40.574025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4618f-4347-4733-84ca-ab3f3f456a7e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:40.575624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b4618f-4347-4733-84ca-ab3f3f456a7e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:40.586719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1239/2485] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:40 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:32:40.590957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b5fb8-fe54-4bed-845e-eb7a3bd20419 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:40.601249 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8b5fb8-fe54-4bed-845e-eb7a3bd20419 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:40.606299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bfce2-17f4-4db2-b034-16af864c01db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:40.606709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bfce2-17f4-4db2-b034-16af864c01db admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:40.606988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bfce2-17f4-4db2-b034-16af864c01db admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:40.607264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647bfce2-17f4-4db2-b034-16af864c01db admin admin] PATH_INFO: `/v3/projects/223b2821fe6a4436814d1ee55932742f/users/eef7d8042b7e46d18926e411860f1a0e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:40.609182 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bfce2-17f4-4db2-b034-16af864c01db admin admin] RBAC: Authorizing `identity:create_grant(project_id=223b2821fe6a4436814d1ee55932742f, user_id=eef7d8042b7e46d18926e411860f1a0e, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:40.611802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647bfce2-17f4-4db2-b034-16af864c01db admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:40.622165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1247/2486] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:40 2022] PUT /identity/v3/projects/223b2821fe6a4436814d1ee55932742f/users/eef7d8042b7e46d18926e411860f1a0e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:40.634339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4c929-7904-4efe-a505-82021c88c8da None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:40.634620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4c929-7904-4efe-a505-82021c88c8da None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:40.634895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f4c929-7904-4efe-a505-82021c88c8da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:40.663060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-c0f4c929-7904-4efe-a505-82021c88c8da None None] MFA Rules not processed for user `eef7d8042b7e46d18926e411860f1a0e`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:40.664297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c0f4c929-7904-4efe-a505-82021c88c8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:40.769715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1240/2487] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:40 2022] POST /identity/v3/auth/tokens => generated 3351 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:40.784678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bfce2-17f4-4db2-b034-16af864c01db admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:40.787878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-647bfce2-17f4-4db2-b034-16af864c01db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:40.822830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:40.852144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647bfce2-17f4-4db2-b034-16af864c01db admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:40.856686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427c95f-c2c8-4ff5-a035-8dd8b190a6d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:40.857327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427c95f-c2c8-4ff5-a035-8dd8b190a6d1 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:40.857636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427c95f-c2c8-4ff5-a035-8dd8b190a6d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:40.857955 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3427c95f-c2c8-4ff5-a035-8dd8b190a6d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:40.869267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427c95f-c2c8-4ff5-a035-8dd8b190a6d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:40.870706 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3427c95f-c2c8-4ff5-a035-8dd8b190a6d1 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:40.881993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1248/2488] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:40 2022] GET /identity/v3/auth/tokens => generated 3351 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:40.951521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4c929-7904-4efe-a505-82021c88c8da None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:40.953122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-c0f4c929-7904-4efe-a505-82021c88c8da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:41.036630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f4c929-7904-4efe-a505-82021c88c8da None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:41.042528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:41.043188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.043517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.043802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] PATH_INFO: `/v3/users/e1fcaec552f7441f941b6c1bd6b5bdac` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.045526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1fcaec552f7441f941b6c1bd6b5bdac)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:41.047496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:41.081242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:41.089433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427c95f-c2c8-4ff5-a035-8dd8b190a6d1 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:41.100961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3427c95f-c2c8-4ff5-a035-8dd8b190a6d1 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:41.111797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da06e9cc-2674-46cb-b2d3-b9551b632c23 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:41.112579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06e9cc-2674-46cb-b2d3-b9551b632c23 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.112857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06e9cc-2674-46cb-b2d3-b9551b632c23 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.113160 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da06e9cc-2674-46cb-b2d3-b9551b632c23 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.116210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1fcaec552f7441f941b6c1bd6b5bdac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:41.116944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1fcaec552f7441f941b6c1bd6b5bdac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:41.130234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1fcaec552f7441f941b6c1bd6b5bdac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:41.131066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1fcaec552f7441f941b6c1bd6b5bdac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:41.140382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1fcaec552f7441f941b6c1bd6b5bdac'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:41.154005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1241/2489] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:40 2022] DELETE /identity/v3/users/e1fcaec552f7441f941b6c1bd6b5bdac => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:41.176976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06e9cc-2674-46cb-b2d3-b9551b632c23 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:41.178512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da06e9cc-2674-46cb-b2d3-b9551b632c23 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:41.188482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1249/2490] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:41 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:32:41.337306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:41.339126 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:41.420117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc77060d-1862-47b7-9daf-8f8f1ea309da admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:41.425565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:41.426297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.426941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.427347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] PATH_INFO: `/v3/projects/5f26cb8267d84f15ae98eead0657aea4` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.429369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f26cb8267d84f15ae98eead0657aea4)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:41.431724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:41.497162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f26cb8267d84f15ae98eead0657aea4', 'request_id': 'req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:41.503340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f26cb8267d84f15ae98eead0657aea4', 'request_id': 'req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:41.528819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f26cb8267d84f15ae98eead0657aea4', 'request_id': 'req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:41.542691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] The token cache is being invalidate because project 5f26cb8267d84f15ae98eead0657aea4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:41.542691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:41.542691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-cf112c50-d5ad-44ce-a306-7b3cb1b6a146 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:41.545648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1242/2491] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:41 2022] DELETE /identity/v3/projects/5f26cb8267d84f15ae98eead0657aea4 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:41.553390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8395-c642-4c86-891a-6cfd234f93f2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.553820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8395-c642-4c86-891a-6cfd234f93f2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.554207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e0f8395-c642-4c86-891a-6cfd234f93f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.579985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4e0f8395-c642-4c86-891a-6cfd234f93f2 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:41.581200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4e0f8395-c642-4c86-891a-6cfd234f93f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:41.644485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1250/2492] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:41.653234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c419-6189-4e45-9b2e-f1de6a9e171f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.653636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c419-6189-4e45-9b2e-f1de6a9e171f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.653973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c419-6189-4e45-9b2e-f1de6a9e171f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.674449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a2e9c419-6189-4e45-9b2e-f1de6a9e171f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:41.675641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a2e9c419-6189-4e45-9b2e-f1de6a9e171f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:41.683924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1243/2493] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:41.688285 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f8395-c642-4c86-891a-6cfd234f93f2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:41.698527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e0f8395-c642-4c86-891a-6cfd234f93f2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:41.703178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42d060-2071-445d-b38b-a04fb265ef71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:41.703777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42d060-2071-445d-b38b-a04fb265ef71 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.704348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42d060-2071-445d-b38b-a04fb265ef71 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.704628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d42d060-2071-445d-b38b-a04fb265ef71 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.705273 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42d060-2071-445d-b38b-a04fb265ef71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:32:41.705580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42d060-2071-445d-b38b-a04fb265ef71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:41.707214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d42d060-2071-445d-b38b-a04fb265ef71 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:41.718986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1251/2494] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:32:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:32:41.723514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9c419-6189-4e45-9b2e-f1de6a9e171f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:41.732815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9c419-6189-4e45-9b2e-f1de6a9e171f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:41.737724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0cd24-8125-4d16-ac2f-dcea976dd0cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:41.738319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0cd24-8125-4d16-ac2f-dcea976dd0cd admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.738617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0cd24-8125-4d16-ac2f-dcea976dd0cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.738869 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73d0cd24-8125-4d16-ac2f-dcea976dd0cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.739549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0cd24-8125-4d16-ac2f-dcea976dd0cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:41.742003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73d0cd24-8125-4d16-ac2f-dcea976dd0cd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:41.763688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:41.771980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1244/2495] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:41 2022] POST /identity/v3/projects => generated 381 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:32:41.776091 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42d060-2071-445d-b38b-a04fb265ef71 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:41.786428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d42d060-2071-445d-b38b-a04fb265ef71 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:41.842586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:41.853105 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1621475-d821-44fd-a2c8-cabce4e6b7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:41.853734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1621475-d821-44fd-a2c8-cabce4e6b7ee admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.854015 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1621475-d821-44fd-a2c8-cabce4e6b7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.854288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1621475-d821-44fd-a2c8-cabce4e6b7ee admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.854964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1621475-d821-44fd-a2c8-cabce4e6b7ee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:41.856942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1621475-d821-44fd-a2c8-cabce4e6b7ee admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:41.879205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1252/2496] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:41 2022] POST /identity/v3/users => generated 291 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:41.883140 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0cd24-8125-4d16-ac2f-dcea976dd0cd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:41.893646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73d0cd24-8125-4d16-ac2f-dcea976dd0cd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:41.898804 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e317c-5f75-4cbf-8b66-398e747a6131 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:41.899399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e317c-5f75-4cbf-8b66-398e747a6131 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.899682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e317c-5f75-4cbf-8b66-398e747a6131 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.899958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19e317c-5f75-4cbf-8b66-398e747a6131 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.900641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e317c-5f75-4cbf-8b66-398e747a6131 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:41.902324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19e317c-5f75-4cbf-8b66-398e747a6131 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:41.913504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1245/2497] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:41.917586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1621475-d821-44fd-a2c8-cabce4e6b7ee admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:41.928094 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1621475-d821-44fd-a2c8-cabce4e6b7ee admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:41.932866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43418300-3f91-41bd-8236-5e865a0fd6ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:41.933465 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43418300-3f91-41bd-8236-5e865a0fd6ae admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.933746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43418300-3f91-41bd-8236-5e865a0fd6ae admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.934072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43418300-3f91-41bd-8236-5e865a0fd6ae admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.934657 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43418300-3f91-41bd-8236-5e865a0fd6ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:41.936294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43418300-3f91-41bd-8236-5e865a0fd6ae admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:41.946829 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1253/2498] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:41.951879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e317c-5f75-4cbf-8b66-398e747a6131 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:41.963814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19e317c-5f75-4cbf-8b66-398e747a6131 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:41.968756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634e2c5-2149-427f-b420-4f02d5113b8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:41.969438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634e2c5-2149-427f-b420-4f02d5113b8a admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:41.969736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634e2c5-2149-427f-b420-4f02d5113b8a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:41.970030 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8634e2c5-2149-427f-b420-4f02d5113b8a admin admin] PATH_INFO: `/v3/projects/98430dcaaa174590a6a71a5b15ba432a/users/cdb5a935388147d397082a314f3e5bc1/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:41.987078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634e2c5-2149-427f-b420-4f02d5113b8a admin admin] RBAC: Authorizing `identity:create_grant(project_id=98430dcaaa174590a6a71a5b15ba432a, user_id=cdb5a935388147d397082a314f3e5bc1, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:41.989765 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8634e2c5-2149-427f-b420-4f02d5113b8a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:42.003958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1246/2499] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:41 2022] PUT /identity/v3/projects/98430dcaaa174590a6a71a5b15ba432a/users/cdb5a935388147d397082a314f3e5bc1/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:42.018030 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634620d-233a-4de4-86b3-2d8f6befffed None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:42.018321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634620d-233a-4de4-86b3-2d8f6befffed None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:42.018601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6634620d-233a-4de4-86b3-2d8f6befffed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:42.046128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6634620d-233a-4de4-86b3-2d8f6befffed None None] MFA Rules not processed for user `cdb5a935388147d397082a314f3e5bc1`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:42.047335 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6634620d-233a-4de4-86b3-2d8f6befffed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:42.110452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1254/2500] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:42 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:42.115270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634e2c5-2149-427f-b420-4f02d5113b8a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:42.185913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8634e2c5-2149-427f-b420-4f02d5113b8a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:42.190628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f01682-b66e-408a-9535-41fbaa82c98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:42.191259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01682-b66e-408a-9535-41fbaa82c98c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:42.191540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01682-b66e-408a-9535-41fbaa82c98c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:42.191817 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f01682-b66e-408a-9535-41fbaa82c98c admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:42.192527 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f01682-b66e-408a-9535-41fbaa82c98c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:42.194974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f01682-b66e-408a-9535-41fbaa82c98c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:42.233311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1247/2501] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:42 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:42.237447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634620d-233a-4de4-86b3-2d8f6befffed None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:42.249127 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6634620d-233a-4de4-86b3-2d8f6befffed None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:42.304934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b4b86-11d2-4da2-bf18-b081b36e0da6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:42.305529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b4b86-11d2-4da2-bf18-b081b36e0da6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:42.305808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b4b86-11d2-4da2-bf18-b081b36e0da6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:42.306080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58b4b86-11d2-4da2-bf18-b081b36e0da6 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:42.306713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b4b86-11d2-4da2-bf18-b081b36e0da6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:42.308643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58b4b86-11d2-4da2-bf18-b081b36e0da6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:42.329380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1255/2502] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:42 2022] POST /identity/v3/users => generated 296 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:42.333399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f01682-b66e-408a-9535-41fbaa82c98c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:42.344089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f01682-b66e-408a-9535-41fbaa82c98c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:42.348785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2e7f-b760-4d12-b6c2-ea8c484edfde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:42.349400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2e7f-b760-4d12-b6c2-ea8c484edfde admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:42.349676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2e7f-b760-4d12-b6c2-ea8c484edfde admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:42.349942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95d2e7f-b760-4d12-b6c2-ea8c484edfde admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:42.350569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d2e7f-b760-4d12-b6c2-ea8c484edfde admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:42.352171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95d2e7f-b760-4d12-b6c2-ea8c484edfde admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:42.362355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1248/2503] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:42.366965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b4b86-11d2-4da2-bf18-b081b36e0da6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:42.376916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58b4b86-11d2-4da2-bf18-b081b36e0da6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:42.382079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd659a-4d32-40c2-a196-eb9c8bc6d3fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:42.382714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd659a-4d32-40c2-a196-eb9c8bc6d3fd admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:42.382991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd659a-4d32-40c2-a196-eb9c8bc6d3fd admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:42.383266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abd659a-4d32-40c2-a196-eb9c8bc6d3fd admin admin] PATH_INFO: `/v3/projects/29f298cb5b194add8ab1b56b47120d94/users/aff1a22204604ff99a1a2e310790d750/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:42.397545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd659a-4d32-40c2-a196-eb9c8bc6d3fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f298cb5b194add8ab1b56b47120d94, user_id=aff1a22204604ff99a1a2e310790d750, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:42.400200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abd659a-4d32-40c2-a196-eb9c8bc6d3fd admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:42.412669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1256/2504] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:42 2022] PUT /identity/v3/projects/29f298cb5b194add8ab1b56b47120d94/users/aff1a22204604ff99a1a2e310790d750/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:42.416578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2e7f-b760-4d12-b6c2-ea8c484edfde admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:42.428915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95d2e7f-b760-4d12-b6c2-ea8c484edfde admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:42.484816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41151be-494b-423a-bae3-ed1b4140aa6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:42.485445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41151be-494b-423a-bae3-ed1b4140aa6e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:42.485748 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41151be-494b-423a-bae3-ed1b4140aa6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:42.486005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41151be-494b-423a-bae3-ed1b4140aa6e admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:42.486643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41151be-494b-423a-bae3-ed1b4140aa6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:42.488272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41151be-494b-423a-bae3-ed1b4140aa6e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:42.498683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1249/2505] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:42 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:42.503168 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd659a-4d32-40c2-a196-eb9c8bc6d3fd admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:42.515720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abd659a-4d32-40c2-a196-eb9c8bc6d3fd admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:42.520394 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2827d-9e75-48ec-be51-7e9603d93c9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:42.521035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2827d-9e75-48ec-be51-7e9603d93c9e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:42.521351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2827d-9e75-48ec-be51-7e9603d93c9e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:42.521616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c2827d-9e75-48ec-be51-7e9603d93c9e admin admin] PATH_INFO: `/v3/projects/29f298cb5b194add8ab1b56b47120d94/users/aff1a22204604ff99a1a2e310790d750/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:42.523531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2827d-9e75-48ec-be51-7e9603d93c9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f298cb5b194add8ab1b56b47120d94, user_id=aff1a22204604ff99a1a2e310790d750, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:42.526171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c2827d-9e75-48ec-be51-7e9603d93c9e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:42.536643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1257/2506] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:42 2022] PUT /identity/v3/projects/29f298cb5b194add8ab1b56b47120d94/users/aff1a22204604ff99a1a2e310790d750/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:42.546913 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd834a28-9908-4dcc-b4b7-2f95452d3c47 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:42.547455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd834a28-9908-4dcc-b4b7-2f95452d3c47 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:42.547737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd834a28-9908-4dcc-b4b7-2f95452d3c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:42.576265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dd834a28-9908-4dcc-b4b7-2f95452d3c47 None None] MFA Rules not processed for user `aff1a22204604ff99a1a2e310790d750`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:42.577469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dd834a28-9908-4dcc-b4b7-2f95452d3c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:42.601367 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:42.648405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1250/2507] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:42 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:42.661640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2827d-9e75-48ec-be51-7e9603d93c9e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:42.664296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-24c2827d-9e75-48ec-be51-7e9603d93c9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:42.686400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:42.729742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c2827d-9e75-48ec-be51-7e9603d93c9e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:42.737583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76bded-ad37-4963-a05f-6be29e1387b9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:42.738135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76bded-ad37-4963-a05f-6be29e1387b9 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:42.738412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76bded-ad37-4963-a05f-6be29e1387b9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:42.738678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b76bded-ad37-4963-a05f-6be29e1387b9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:42.749570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76bded-ad37-4963-a05f-6be29e1387b9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:42.750911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b76bded-ad37-4963-a05f-6be29e1387b9 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:42.766397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1258/2508] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:42 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:32:43.076230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd834a28-9908-4dcc-b4b7-2f95452d3c47 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:43.086005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd834a28-9908-4dcc-b4b7-2f95452d3c47 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:43.090523 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53084a5-2595-48db-a39f-5f35067685c3 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff1a22204604ff99a1a2e310790d750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f298cb5b194add8ab1b56b47120d94', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:43.091121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53084a5-2595-48db-a39f-5f35067685c3 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:43.091428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53084a5-2595-48db-a39f-5f35067685c3 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:43.091707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53084a5-2595-48db-a39f-5f35067685c3 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:43.092383 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53084a5-2595-48db-a39f-5f35067685c3 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:32:43.092690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53084a5-2595-48db-a39f-5f35067685c3 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:43.094286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53084a5-2595-48db-a39f-5f35067685c3 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:43.106002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1251/2509] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:32:43.109999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76bded-ad37-4963-a05f-6be29e1387b9 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:43.119522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b76bded-ad37-4963-a05f-6be29e1387b9 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:43.124040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9b622-df15-4bd7-a460-c03aeea9c8aa tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff1a22204604ff99a1a2e310790d750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f298cb5b194add8ab1b56b47120d94', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:43.124668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b622-df15-4bd7-a460-c03aeea9c8aa tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:43.124949 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b622-df15-4bd7-a460-c03aeea9c8aa tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:43.125218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c9b622-df15-4bd7-a460-c03aeea9c8aa tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:43.125843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9b622-df15-4bd7-a460-c03aeea9c8aa tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:43.127694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75c9b622-df15-4bd7-a460-c03aeea9c8aa tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:43.155310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1259/2510] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:43 2022] POST /identity/v3/projects => generated 355 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:43.159192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53084a5-2595-48db-a39f-5f35067685c3 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:43.169610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53084a5-2595-48db-a39f-5f35067685c3 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:43.225581 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e53d5-7fcc-4acc-9ebf-af373cf395b6 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff1a22204604ff99a1a2e310790d750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f298cb5b194add8ab1b56b47120d94', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:43.226178 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e53d5-7fcc-4acc-9ebf-af373cf395b6 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:43.226462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e53d5-7fcc-4acc-9ebf-af373cf395b6 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:43.226736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6e53d5-7fcc-4acc-9ebf-af373cf395b6 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:43.227384 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e53d5-7fcc-4acc-9ebf-af373cf395b6 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:32:43.227676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e53d5-7fcc-4acc-9ebf-af373cf395b6 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:43.229292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6e53d5-7fcc-4acc-9ebf-af373cf395b6 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:43.241040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1252/2511] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:32:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:32:43.277798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9b622-df15-4bd7-a460-c03aeea9c8aa tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:43.289035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75c9b622-df15-4bd7-a460-c03aeea9c8aa tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:43.293593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'aff1a22204604ff99a1a2e310790d750', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '29f298cb5b194add8ab1b56b47120d94', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:43.294206 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:43.294484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:43.294756 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] PATH_INFO: `/v3/projects/4cab54fbf20741ceab7e00cfff4d8652` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:43.295864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: Authorizing `identity:delete_project(project_id=4cab54fbf20741ceab7e00cfff4d8652)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:43.297776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:43.344012 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4cab54fbf20741ceab7e00cfff4d8652', 'request_id': 'req-8554ec43-274c-4bab-a29f-6ba5a4977db0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:43.351086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4cab54fbf20741ceab7e00cfff4d8652', 'request_id': 'req-8554ec43-274c-4bab-a29f-6ba5a4977db0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:43.356644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4cab54fbf20741ceab7e00cfff4d8652', 'request_id': 'req-8554ec43-274c-4bab-a29f-6ba5a4977db0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:43.368552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] The token cache is being invalidate because project 4cab54fbf20741ceab7e00cfff4d8652 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:43.368867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:43.369487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8554ec43-274c-4bab-a29f-6ba5a4977db0 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:43.370971 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1260/2512] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:43 2022] DELETE /identity/v3/projects/4cab54fbf20741ceab7e00cfff4d8652 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:43.559734 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e53d5-7fcc-4acc-9ebf-af373cf395b6 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:43.561700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6d6e53d5-7fcc-4acc-9ebf-af373cf395b6 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:43.628761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6e53d5-7fcc-4acc-9ebf-af373cf395b6 tempest-VolumeQuotaClassesTest-395543337 tempest-VolumeQuotaClassesTest-395543337-project-admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:43.671554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:43.684013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:43.684664 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:43.684940 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:43.685210 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] PATH_INFO: `/v3/users/cdb5a935388147d397082a314f3e5bc1` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:43.686325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdb5a935388147d397082a314f3e5bc1)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:43.688251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:43.733024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdb5a935388147d397082a314f3e5bc1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:43.733701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdb5a935388147d397082a314f3e5bc1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:43.745501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdb5a935388147d397082a314f3e5bc1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:43.746123 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdb5a935388147d397082a314f3e5bc1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:43.752783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdb5a935388147d397082a314f3e5bc1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:43.765721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1253/2513] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:43 2022] DELETE /identity/v3/users/cdb5a935388147d397082a314f3e5bc1 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:43.770374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d65b69-2298-490d-82f5-f36c911dfb27 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:43.770760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d65b69-2298-490d-82f5-f36c911dfb27 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:43.770919 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d65b69-2298-490d-82f5-f36c911dfb27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:43.793952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b9d65b69-2298-490d-82f5-f36c911dfb27 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:43.793952 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b9d65b69-2298-490d-82f5-f36c911dfb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:43.858922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1261/2514] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:43.871238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:43.873212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:43.939469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a9d4e1-1a5c-4ed9-878a-ffd81dba57ad admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:43.943268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f1de7-eac1-4ad0-92b3-80fa36086c43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:43.944013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f1de7-eac1-4ad0-92b3-80fa36086c43 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:43.944382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f1de7-eac1-4ad0-92b3-80fa36086c43 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:43.944740 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5f1de7-eac1-4ad0-92b3-80fa36086c43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:43.954155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f1de7-eac1-4ad0-92b3-80fa36086c43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:43.955585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5f1de7-eac1-4ad0-92b3-80fa36086c43 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:43.965575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1254/2515] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:44.252483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d65b69-2298-490d-82f5-f36c911dfb27 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:44.253994 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b9d65b69-2298-490d-82f5-f36c911dfb27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:44.266728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d65b69-2298-490d-82f5-f36c911dfb27 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:44.272005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:44.272675 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:44.272954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:44.273228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] PATH_INFO: `/v3/projects/98430dcaaa174590a6a71a5b15ba432a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:44.275726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98430dcaaa174590a6a71a5b15ba432a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:44.280571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:44.299303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:44.337133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98430dcaaa174590a6a71a5b15ba432a', 'request_id': 'req-0a67c825-8c6e-4fab-8950-12435ea96266'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.343806 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98430dcaaa174590a6a71a5b15ba432a', 'request_id': 'req-0a67c825-8c6e-4fab-8950-12435ea96266'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.349941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98430dcaaa174590a6a71a5b15ba432a', 'request_id': 'req-0a67c825-8c6e-4fab-8950-12435ea96266'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.363396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] The token cache is being invalidate because project 98430dcaaa174590a6a71a5b15ba432a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:44.363847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.364534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.366193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1262/2516] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:44 2022] DELETE /identity/v3/projects/98430dcaaa174590a6a71a5b15ba432a => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:44.370587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f1de7-eac1-4ad0-92b3-80fa36086c43 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:44.381317 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5f1de7-eac1-4ad0-92b3-80fa36086c43 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:44.444862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:44.445736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:44.446025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:44.446304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] PATH_INFO: `/v3/users/aff1a22204604ff99a1a2e310790d750` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:44.447446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] RBAC: Authorizing `identity:delete_user(user_id=aff1a22204604ff99a1a2e310790d750)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:44.449440 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:44.463096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:44.503129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aff1a22204604ff99a1a2e310790d750'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.503787 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aff1a22204604ff99a1a2e310790d750'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.517410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aff1a22204604ff99a1a2e310790d750'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.518061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aff1a22204604ff99a1a2e310790d750'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.525598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-a072053b-1a1a-42a3-8a30-21feb004089a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aff1a22204604ff99a1a2e310790d750'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.538219 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1255/2517] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:44 2022] DELETE /identity/v3/users/aff1a22204604ff99a1a2e310790d750 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:44.810326 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:44.811785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:44.825417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67c825-8c6e-4fab-8950-12435ea96266 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:44.883964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:44.884530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:44.884957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:44.885265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] PATH_INFO: `/v3/projects/29f298cb5b194add8ab1b56b47120d94` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:44.886721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f298cb5b194add8ab1b56b47120d94)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:44.888731 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:44.935053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f298cb5b194add8ab1b56b47120d94', 'request_id': 'req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.941257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f298cb5b194add8ab1b56b47120d94', 'request_id': 'req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.947340 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f298cb5b194add8ab1b56b47120d94', 'request_id': 'req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.960632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] The token cache is being invalidate because project 29f298cb5b194add8ab1b56b47120d94 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:44.960965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.961599 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-90d9a2fc-ae60-4106-a0ff-f83ea4f60b74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:44.963150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1263/2518] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:44 2022] DELETE /identity/v3/projects/29f298cb5b194add8ab1b56b47120d94 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:44.967949 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730dc46-3fff-4fef-af94-4aa7f3da4372 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:44.968444 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730dc46-3fff-4fef-af94-4aa7f3da4372 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:44.968553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6730dc46-3fff-4fef-af94-4aa7f3da4372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:44.988466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6730dc46-3fff-4fef-af94-4aa7f3da4372 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:44.989693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6730dc46-3fff-4fef-af94-4aa7f3da4372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:45.048297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1256/2519] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:45.056518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba0811-305d-49bf-9310-adb027d6614b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.056796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba0811-305d-49bf-9310-adb027d6614b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.057072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ba0811-305d-49bf-9310-adb027d6614b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.078492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c5ba0811-305d-49bf-9310-adb027d6614b None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:45.079977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5ba0811-305d-49bf-9310-adb027d6614b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:45.088672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1264/2520] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:45.093712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730dc46-3fff-4fef-af94-4aa7f3da4372 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.114307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6730dc46-3fff-4fef-af94-4aa7f3da4372 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.114307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27891-19f4-4bae-aec8-81699a7f750a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.114307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27891-19f4-4bae-aec8-81699a7f750a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.114307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27891-19f4-4bae-aec8-81699a7f750a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.114856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b27891-19f4-4bae-aec8-81699a7f750a admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.114856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b27891-19f4-4bae-aec8-81699a7f750a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:32:45.114856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b27891-19f4-4bae-aec8-81699a7f750a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.116624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b27891-19f4-4bae-aec8-81699a7f750a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.128924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1257/2521] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:32:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:32:45.134083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba0811-305d-49bf-9310-adb027d6614b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.143643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ba0811-305d-49bf-9310-adb027d6614b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.148958 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b08c7-49c6-4369-9f66-2c4430891a6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.149559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b08c7-49c6-4369-9f66-2c4430891a6e admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.149836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b08c7-49c6-4369-9f66-2c4430891a6e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.150130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225b08c7-49c6-4369-9f66-2c4430891a6e admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.150752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b08c7-49c6-4369-9f66-2c4430891a6e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.152681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225b08c7-49c6-4369-9f66-2c4430891a6e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.179079 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1265/2522] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:45 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:45.183415 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27891-19f4-4bae-aec8-81699a7f750a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.193676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b27891-19f4-4bae-aec8-81699a7f750a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.249682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9181b-733c-4215-9063-11452f996dc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.250293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9181b-733c-4215-9063-11452f996dc0 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.250572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9181b-733c-4215-9063-11452f996dc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.250844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f9181b-733c-4215-9063-11452f996dc0 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.251504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9181b-733c-4215-9063-11452f996dc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.253451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f9181b-733c-4215-9063-11452f996dc0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.275676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1258/2523] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:45 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:45.279529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b08c7-49c6-4369-9f66-2c4430891a6e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.287437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:45.291472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225b08c7-49c6-4369-9f66-2c4430891a6e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.298184 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cc9c7-7465-4d57-a0b8-060f029812a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.298902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc9c7-7465-4d57-a0b8-060f029812a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.299257 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc9c7-7465-4d57-a0b8-060f029812a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.299700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1cc9c7-7465-4d57-a0b8-060f029812a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.300523 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cc9c7-7465-4d57-a0b8-060f029812a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.303437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1cc9c7-7465-4d57-a0b8-060f029812a7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.315649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1266/2524] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:32:45.322613 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9181b-733c-4215-9063-11452f996dc0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.333022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f9181b-733c-4215-9063-11452f996dc0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.337699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83d24fea-33d7-4e11-b520-68357916c5a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.338298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d24fea-33d7-4e11-b520-68357916c5a7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.338576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d24fea-33d7-4e11-b520-68357916c5a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.338849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83d24fea-33d7-4e11-b520-68357916c5a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.339490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d24fea-33d7-4e11-b520-68357916c5a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.341118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83d24fea-33d7-4e11-b520-68357916c5a7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.342577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=9,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:45.355679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1259/2525] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:45.359774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cc9c7-7465-4d57-a0b8-060f029812a7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.371153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1cc9c7-7465-4d57-a0b8-060f029812a7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.375862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098fd99-8b05-4f21-877a-608655850388 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.376551 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098fd99-8b05-4f21-877a-608655850388 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.376896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098fd99-8b05-4f21-877a-608655850388 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.377179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a098fd99-8b05-4f21-877a-608655850388 admin admin] PATH_INFO: `/v3/projects/e8bae713b3484e73b2a9d60ab08393de/users/44188b25a0a34c61a8c2b2f635faedeb/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.392100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098fd99-8b05-4f21-877a-608655850388 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8bae713b3484e73b2a9d60ab08393de, user_id=44188b25a0a34c61a8c2b2f635faedeb, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.394699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a098fd99-8b05-4f21-877a-608655850388 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.410718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1267/2526] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:45 2022] PUT /identity/v3/projects/e8bae713b3484e73b2a9d60ab08393de/users/44188b25a0a34c61a8c2b2f635faedeb/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:45.421973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b799-1420-4366-85df-46ebc05152d0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.422257 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b799-1420-4366-85df-46ebc05152d0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.422533 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167b799-1420-4366-85df-46ebc05152d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.451061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9167b799-1420-4366-85df-46ebc05152d0 None None] MFA Rules not processed for user `44188b25a0a34c61a8c2b2f635faedeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:45.452299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9167b799-1420-4366-85df-46ebc05152d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:45.519311 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1260/2527] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:45.523345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098fd99-8b05-4f21-877a-608655850388 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.586434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a098fd99-8b05-4f21-877a-608655850388 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.591129 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c63edb-577f-4d69-ae4b-a7e326787944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.591730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c63edb-577f-4d69-ae4b-a7e326787944 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.592013 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c63edb-577f-4d69-ae4b-a7e326787944 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.592320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c63edb-577f-4d69-ae4b-a7e326787944 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.592951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c63edb-577f-4d69-ae4b-a7e326787944 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.594848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1c63edb-577f-4d69-ae4b-a7e326787944 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.621914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1268/2528] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:45 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:45.626053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b799-1420-4366-85df-46ebc05152d0 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.638467 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167b799-1420-4366-85df-46ebc05152d0 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.695473 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5209032-3380-47e2-804f-b00084236bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.695977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209032-3380-47e2-804f-b00084236bac admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.696289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209032-3380-47e2-804f-b00084236bac admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.696561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5209032-3380-47e2-804f-b00084236bac admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.697188 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5209032-3380-47e2-804f-b00084236bac admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.699086 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5209032-3380-47e2-804f-b00084236bac admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.720417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1261/2529] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:45 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:45.724446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c63edb-577f-4d69-ae4b-a7e326787944 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.734704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c63edb-577f-4d69-ae4b-a7e326787944 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.739332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3625c3b-908e-4d5d-a6a1-437f693d608f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.739961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3625c3b-908e-4d5d-a6a1-437f693d608f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.740274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3625c3b-908e-4d5d-a6a1-437f693d608f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.740552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3625c3b-908e-4d5d-a6a1-437f693d608f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.741187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3625c3b-908e-4d5d-a6a1-437f693d608f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.742767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3625c3b-908e-4d5d-a6a1-437f693d608f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.753090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1269/2530] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:45.757426 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5209032-3380-47e2-804f-b00084236bac admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.767517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5209032-3380-47e2-804f-b00084236bac admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.772723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a09cf98-7c29-4904-8d40-0976e1e630d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.773344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cf98-7c29-4904-8d40-0976e1e630d7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.773620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cf98-7c29-4904-8d40-0976e1e630d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.773894 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a09cf98-7c29-4904-8d40-0976e1e630d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.774531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09cf98-7c29-4904-8d40-0976e1e630d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.776125 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a09cf98-7c29-4904-8d40-0976e1e630d7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.785948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1262/2531] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:32:45.789965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3625c3b-908e-4d5d-a6a1-437f693d608f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:45.799586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3625c3b-908e-4d5d-a6a1-437f693d608f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:45.804061 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c992734-a905-4051-bab0-f4771133a9d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:45.804821 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c992734-a905-4051-bab0-f4771133a9d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.805105 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c992734-a905-4051-bab0-f4771133a9d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.805378 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c992734-a905-4051-bab0-f4771133a9d6 admin admin] PATH_INFO: `/v3/projects/57966f16a9a74c4dbf7535f9028ef1d7/users/e8a4ab77b3d9430ebb56c7e96f333830/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.820736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c992734-a905-4051-bab0-f4771133a9d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=57966f16a9a74c4dbf7535f9028ef1d7, user_id=e8a4ab77b3d9430ebb56c7e96f333830, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:45.823819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c992734-a905-4051-bab0-f4771133a9d6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:45.837477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1270/2532] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:45 2022] PUT /identity/v3/projects/57966f16a9a74c4dbf7535f9028ef1d7/users/e8a4ab77b3d9430ebb56c7e96f333830/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:45.848198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217954aa-512e-44c7-9a8a-272b9b400463 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:45.848493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217954aa-512e-44c7-9a8a-272b9b400463 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:45.848802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217954aa-512e-44c7-9a8a-272b9b400463 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:45.876463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-217954aa-512e-44c7-9a8a-272b9b400463 None None] MFA Rules not processed for user `e8a4ab77b3d9430ebb56c7e96f333830`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:45.877660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-217954aa-512e-44c7-9a8a-272b9b400463 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:45.933679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:45.945825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1263/2533] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:45 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:45.950247 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c992734-a905-4051-bab0-f4771133a9d6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:46.010841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c992734-a905-4051-bab0-f4771133a9d6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:46.015593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4608ee4-3c88-4ffc-b14a-697dcc23694a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:46.016211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4608ee4-3c88-4ffc-b14a-697dcc23694a admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.016493 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4608ee4-3c88-4ffc-b14a-697dcc23694a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.016764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4608ee4-3c88-4ffc-b14a-697dcc23694a admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.017395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4608ee4-3c88-4ffc-b14a-697dcc23694a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:46.019312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4608ee4-3c88-4ffc-b14a-697dcc23694a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:46.046604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1271/2534] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:45 2022] POST /identity/v3/projects => generated 387 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:32:46.050689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217954aa-512e-44c7-9a8a-272b9b400463 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:46.061222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217954aa-512e-44c7-9a8a-272b9b400463 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:46.117259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fcefc-539b-4862-a97e-3ff8a6d7d1c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:46.117849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fcefc-539b-4862-a97e-3ff8a6d7d1c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.118130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fcefc-539b-4862-a97e-3ff8a6d7d1c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.118406 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e61fcefc-539b-4862-a97e-3ff8a6d7d1c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.119040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fcefc-539b-4862-a97e-3ff8a6d7d1c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:46.120983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e61fcefc-539b-4862-a97e-3ff8a6d7d1c9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:46.141501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1264/2535] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:46 2022] POST /identity/v3/users => generated 300 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:46.145556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4608ee4-3c88-4ffc-b14a-697dcc23694a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:46.152064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:46.156064 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4608ee4-3c88-4ffc-b14a-697dcc23694a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:46.161822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924d05c-5a0b-4226-8834-34a8c9471f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:46.162449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924d05c-5a0b-4226-8834-34a8c9471f72 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.162727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924d05c-5a0b-4226-8834-34a8c9471f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.162999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2924d05c-5a0b-4226-8834-34a8c9471f72 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.163659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924d05c-5a0b-4226-8834-34a8c9471f72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:46.165349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2924d05c-5a0b-4226-8834-34a8c9471f72 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:46.176050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1272/2536] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:46.181020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fcefc-539b-4862-a97e-3ff8a6d7d1c9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:46.191411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e61fcefc-539b-4862-a97e-3ff8a6d7d1c9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:46.196658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa071a27-2c98-489b-8564-3bc7ad7ec703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:46.197244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa071a27-2c98-489b-8564-3bc7ad7ec703 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.197524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa071a27-2c98-489b-8564-3bc7ad7ec703 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.197797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa071a27-2c98-489b-8564-3bc7ad7ec703 admin admin] PATH_INFO: `/v3/projects/3426ceed2bf94f169e9aa7402de9264d/users/570a5812340949c78df3649f23fb7400/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.213532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa071a27-2c98-489b-8564-3bc7ad7ec703 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3426ceed2bf94f169e9aa7402de9264d, user_id=570a5812340949c78df3649f23fb7400, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:46.216212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa071a27-2c98-489b-8564-3bc7ad7ec703 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:46.229557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1265/2537] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:46 2022] PUT /identity/v3/projects/3426ceed2bf94f169e9aa7402de9264d/users/570a5812340949c78df3649f23fb7400/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:46.233458 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924d05c-5a0b-4226-8834-34a8c9471f72 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:46.243967 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2924d05c-5a0b-4226-8834-34a8c9471f72 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:46.302671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b163ec-e393-413f-a293-7a3507a4b1e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:46.303510 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b163ec-e393-413f-a293-7a3507a4b1e2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.304008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b163ec-e393-413f-a293-7a3507a4b1e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.304547 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b163ec-e393-413f-a293-7a3507a4b1e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.305666 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b163ec-e393-413f-a293-7a3507a4b1e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:46.307640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b163ec-e393-413f-a293-7a3507a4b1e2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:46.319235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1273/2538] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:46 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:46.323723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa071a27-2c98-489b-8564-3bc7ad7ec703 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:46.334283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa071a27-2c98-489b-8564-3bc7ad7ec703 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:46.338921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dac0f-8416-4d4c-9840-916ae290dca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:46.339568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dac0f-8416-4d4c-9840-916ae290dca4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.339849 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dac0f-8416-4d4c-9840-916ae290dca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.340123 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc8dac0f-8416-4d4c-9840-916ae290dca4 admin admin] PATH_INFO: `/v3/projects/3426ceed2bf94f169e9aa7402de9264d/users/570a5812340949c78df3649f23fb7400/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.342061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dac0f-8416-4d4c-9840-916ae290dca4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3426ceed2bf94f169e9aa7402de9264d, user_id=570a5812340949c78df3649f23fb7400, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:46.344726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc8dac0f-8416-4d4c-9840-916ae290dca4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:46.354650 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1266/2539] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:46 2022] PUT /identity/v3/projects/3426ceed2bf94f169e9aa7402de9264d/users/570a5812340949c78df3649f23fb7400/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:46.365214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d6ad-dc29-4f08-8f6a-74f6f0547c48 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.365508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d6ad-dc29-4f08-8f6a-74f6f0547c48 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.365790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a69d6ad-dc29-4f08-8f6a-74f6f0547c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.394534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-8a69d6ad-dc29-4f08-8f6a-74f6f0547c48 None None] MFA Rules not processed for user `570a5812340949c78df3649f23fb7400`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:46.395746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a69d6ad-dc29-4f08-8f6a-74f6f0547c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:46.470010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1274/2540] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:46 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:46.482154 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dac0f-8416-4d4c-9840-916ae290dca4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:46.483815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc8dac0f-8416-4d4c-9840-916ae290dca4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:46.543476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc8dac0f-8416-4d4c-9840-916ae290dca4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:46.547117 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd96a84b-ca04-4015-9206-faa4af72bbc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:46.547713 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96a84b-ca04-4015-9206-faa4af72bbc3 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.547987 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96a84b-ca04-4015-9206-faa4af72bbc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.548288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd96a84b-ca04-4015-9206-faa4af72bbc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.557615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96a84b-ca04-4015-9206-faa4af72bbc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:46.560456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd96a84b-ca04-4015-9206-faa4af72bbc3 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:46.565776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69d6ad-dc29-4f08-8f6a-74f6f0547c48 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:46.567150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8a69d6ad-dc29-4f08-8f6a-74f6f0547c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:46.570171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1267/2541] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:46 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:46.640914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a69d6ad-dc29-4f08-8f6a-74f6f0547c48 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:46.646002 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:46.646646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.646927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.647202 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] PATH_INFO: `/v3/users/fadf22ce35d04609af223756e13500b3` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.648464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=fadf22ce35d04609af223756e13500b3)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:46.650379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:46.668260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:46.702688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fadf22ce35d04609af223756e13500b3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:46.703345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fadf22ce35d04609af223756e13500b3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:46.704245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fadf22ce35d04609af223756e13500b3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:46.711780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fadf22ce35d04609af223756e13500b3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:46.727723 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fadf22ce35d04609af223756e13500b3'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:46.743792 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1275/2542] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:46 2022] DELETE /identity/v3/users/fadf22ce35d04609af223756e13500b3 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:46.749215 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614b56a-40b4-4f32-aa96-ea0ac14158de None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.749677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614b56a-40b4-4f32-aa96-ea0ac14158de None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.750087 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4614b56a-40b4-4f32-aa96-ea0ac14158de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.770490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4614b56a-40b4-4f32-aa96-ea0ac14158de None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:46.771743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4614b56a-40b4-4f32-aa96-ea0ac14158de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:46.818528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:46.836465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1268/2543] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:46.846076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:46.847634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:46.906189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5e126d-c63c-4613-933c-e5cb3373ae3e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:46.910937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a10bd5-ac12-45d3-8864-def21fb6d333 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:46.911717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a10bd5-ac12-45d3-8864-def21fb6d333 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:46.912060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a10bd5-ac12-45d3-8864-def21fb6d333 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:46.912389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a10bd5-ac12-45d3-8864-def21fb6d333 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:46.921496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a10bd5-ac12-45d3-8864-def21fb6d333 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:46.922916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a10bd5-ac12-45d3-8864-def21fb6d333 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:46.933049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1276/2544] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:47.089466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614b56a-40b4-4f32-aa96-ea0ac14158de None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:47.090889 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4614b56a-40b4-4f32-aa96-ea0ac14158de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:47.147495 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4614b56a-40b4-4f32-aa96-ea0ac14158de None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:47.151081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ff6ef-cb63-4752-93af-e65936680793 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:47.151684 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ff6ef-cb63-4752-93af-e65936680793 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:47.151957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ff6ef-cb63-4752-93af-e65936680793 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:47.152263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7ff6ef-cb63-4752-93af-e65936680793 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:47.153980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0f7ff6ef-cb63-4752-93af-e65936680793 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:47.205677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a10bd5-ac12-45d3-8864-def21fb6d333 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:47.212021 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-50a10bd5-ac12-45d3-8864-def21fb6d333 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:47.220574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ff6ef-cb63-4752-93af-e65936680793 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:47.222668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7ff6ef-cb63-4752-93af-e65936680793 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:47.225492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a10bd5-ac12-45d3-8864-def21fb6d333 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:47.230290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:47.230915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:47.231203 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:47.231481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] PATH_INFO: `/v3/projects/120b5652e2b144918699e0b3a697c609` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:47.232647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] RBAC: Authorizing `identity:delete_project(project_id=120b5652e2b144918699e0b3a697c609)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:47.233531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1269/2545] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:47 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:47.236439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:47.287656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '120b5652e2b144918699e0b3a697c609', 'request_id': 'req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.295366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '120b5652e2b144918699e0b3a697c609', 'request_id': 'req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.301556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '120b5652e2b144918699e0b3a697c609', 'request_id': 'req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.316104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] The token cache is being invalidate because project 120b5652e2b144918699e0b3a697c609 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:47.316423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.317086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.319204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1277/2546] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:47 2022] DELETE /identity/v3/projects/120b5652e2b144918699e0b3a697c609 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:47.323516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ff6ef-cb63-4752-93af-e65936680793 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:47.335272 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7ff6ef-cb63-4752-93af-e65936680793 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:47.395293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:47.395959 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:47.396270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:47.396547 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] PATH_INFO: `/v3/users/eef7d8042b7e46d18926e411860f1a0e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:47.397696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eef7d8042b7e46d18926e411860f1a0e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:47.399738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:47.446019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:47.447932 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eef7d8042b7e46d18926e411860f1a0e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.448904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eef7d8042b7e46d18926e411860f1a0e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.462020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eef7d8042b7e46d18926e411860f1a0e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.462796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eef7d8042b7e46d18926e411860f1a0e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.470139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-74d2da24-0d80-43d2-b499-2818ede675f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eef7d8042b7e46d18926e411860f1a0e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.485303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1270/2547] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:47 2022] DELETE /identity/v3/users/eef7d8042b7e46d18926e411860f1a0e => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:47.772856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:47.774290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:47.788507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb9af68-f9fc-459a-bd67-c81c1dd09e8c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:47.809327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:47.851220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:47.851868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:47.852120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:47.852428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] PATH_INFO: `/v3/projects/223b2821fe6a4436814d1ee55932742f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:47.853545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] RBAC: Authorizing `identity:delete_project(project_id=223b2821fe6a4436814d1ee55932742f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:47.855454 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:47.901705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '223b2821fe6a4436814d1ee55932742f', 'request_id': 'req-3b8a73a1-592f-4af8-ab6e-2efcb48be176'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.907777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '223b2821fe6a4436814d1ee55932742f', 'request_id': 'req-3b8a73a1-592f-4af8-ab6e-2efcb48be176'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.913645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '223b2821fe6a4436814d1ee55932742f', 'request_id': 'req-3b8a73a1-592f-4af8-ab6e-2efcb48be176'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.925866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] The token cache is being invalidate because project 223b2821fe6a4436814d1ee55932742f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:47.926152 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.926761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3b8a73a1-592f-4af8-ab6e-2efcb48be176 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:47.928794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1278/2548] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:47 2022] DELETE /identity/v3/projects/223b2821fe6a4436814d1ee55932742f => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:47.933649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a83f9-600d-4046-b2e1-5a81e39faa5c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:47.933941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a83f9-600d-4046-b2e1-5a81e39faa5c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:47.934223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876a83f9-600d-4046-b2e1-5a81e39faa5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:47.955354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-876a83f9-600d-4046-b2e1-5a81e39faa5c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:47.956610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-876a83f9-600d-4046-b2e1-5a81e39faa5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:48.015229 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1271/2549] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:48.022853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cef9-a849-4dde-897b-3a87490c481f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.023139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cef9-a849-4dde-897b-3a87490c481f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.023418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b14cef9-a849-4dde-897b-3a87490c481f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.043176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-6b14cef9-a849-4dde-897b-3a87490c481f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:48.044412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-6b14cef9-a849-4dde-897b-3a87490c481f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:48.053341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1279/2550] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:48.057288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a83f9-600d-4046-b2e1-5a81e39faa5c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.067151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876a83f9-600d-4046-b2e1-5a81e39faa5c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.071709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a8cc4-6c2a-49c7-9578-c21e6ca5cee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.072335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a8cc4-6c2a-49c7-9578-c21e6ca5cee0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.072612 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a8cc4-6c2a-49c7-9578-c21e6ca5cee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.072884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-988a8cc4-6c2a-49c7-9578-c21e6ca5cee0 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.073554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a8cc4-6c2a-49c7-9578-c21e6ca5cee0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:32:48.073857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a8cc4-6c2a-49c7-9578-c21e6ca5cee0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.075478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-988a8cc4-6c2a-49c7-9578-c21e6ca5cee0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.087115 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1272/2551] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:32:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:32:48.091363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cef9-a849-4dde-897b-3a87490c481f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.101156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b14cef9-a849-4dde-897b-3a87490c481f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.105853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f17bc5-0426-4016-b825-05f3ce32ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.106446 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f17bc5-0426-4016-b825-05f3ce32ea1d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.106753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f17bc5-0426-4016-b825-05f3ce32ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.107027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55f17bc5-0426-4016-b825-05f3ce32ea1d admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.107652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f17bc5-0426-4016-b825-05f3ce32ea1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.109583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55f17bc5-0426-4016-b825-05f3ce32ea1d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.138086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1280/2552] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:48 2022] POST /identity/v3/projects => generated 379 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:48.142225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a8cc4-6c2a-49c7-9578-c21e6ca5cee0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.153233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-988a8cc4-6c2a-49c7-9578-c21e6ca5cee0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.209504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d541-55e4-4fa1-a452-506309fd2465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.210139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d541-55e4-4fa1-a452-506309fd2465 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.210419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d541-55e4-4fa1-a452-506309fd2465 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.210695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a1d541-55e4-4fa1-a452-506309fd2465 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.211325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1d541-55e4-4fa1-a452-506309fd2465 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.213303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54a1d541-55e4-4fa1-a452-506309fd2465 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.234505 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1273/2553] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:48 2022] POST /identity/v3/users => generated 290 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:32:48.238586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f17bc5-0426-4016-b825-05f3ce32ea1d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.251026 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55f17bc5-0426-4016-b825-05f3ce32ea1d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.256687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88630a-1f97-4024-a3d9-2ef6118c6021 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.257288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88630a-1f97-4024-a3d9-2ef6118c6021 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.257570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88630a-1f97-4024-a3d9-2ef6118c6021 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.257844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e88630a-1f97-4024-a3d9-2ef6118c6021 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.258482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88630a-1f97-4024-a3d9-2ef6118c6021 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.260451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e88630a-1f97-4024-a3d9-2ef6118c6021 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.273527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1281/2554] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:48.277497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d541-55e4-4fa1-a452-506309fd2465 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.288987 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a1d541-55e4-4fa1-a452-506309fd2465 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.293658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b53550-c9ea-4503-9c8b-b6ee463d02f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.294283 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53550-c9ea-4503-9c8b-b6ee463d02f0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.294565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53550-c9ea-4503-9c8b-b6ee463d02f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.294848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b53550-c9ea-4503-9c8b-b6ee463d02f0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.295491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b53550-c9ea-4503-9c8b-b6ee463d02f0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.297133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b53550-c9ea-4503-9c8b-b6ee463d02f0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.308997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1274/2555] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:48.313180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88630a-1f97-4024-a3d9-2ef6118c6021 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.326708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e88630a-1f97-4024-a3d9-2ef6118c6021 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.331777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640ad84-98ec-4c7a-9af6-dc4419972276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.332462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640ad84-98ec-4c7a-9af6-dc4419972276 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.332743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640ad84-98ec-4c7a-9af6-dc4419972276 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.333023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4640ad84-98ec-4c7a-9af6-dc4419972276 admin admin] PATH_INFO: `/v3/projects/2cd002d5f2e64dde860679aadd470f06/users/1c1fb3c688834483b73b1defa1e904d9/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.348770 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640ad84-98ec-4c7a-9af6-dc4419972276 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2cd002d5f2e64dde860679aadd470f06, user_id=1c1fb3c688834483b73b1defa1e904d9, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.351438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4640ad84-98ec-4c7a-9af6-dc4419972276 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.365545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1282/2556] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:48 2022] PUT /identity/v3/projects/2cd002d5f2e64dde860679aadd470f06/users/1c1fb3c688834483b73b1defa1e904d9/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:48.376038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c8884-a9c8-450c-a431-ef5ced80649d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.376347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c8884-a9c8-450c-a431-ef5ced80649d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.376620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2c8884-a9c8-450c-a431-ef5ced80649d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.403942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1f2c8884-a9c8-450c-a431-ef5ced80649d None None] MFA Rules not processed for user `1c1fb3c688834483b73b1defa1e904d9`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:48.405207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1f2c8884-a9c8-450c-a431-ef5ced80649d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:48.421591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:48.471790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1275/2557] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:48.476790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640ad84-98ec-4c7a-9af6-dc4419972276 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.523809 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:48.540341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4640ad84-98ec-4c7a-9af6-dc4419972276 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.544991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb57612-3a68-4959-b0fd-415e568cd0cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.545587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb57612-3a68-4959-b0fd-415e568cd0cc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.545869 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb57612-3a68-4959-b0fd-415e568cd0cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.546141 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb57612-3a68-4959-b0fd-415e568cd0cc admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.546779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb57612-3a68-4959-b0fd-415e568cd0cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.548738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb57612-3a68-4959-b0fd-415e568cd0cc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.574139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1283/2558] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:48 2022] POST /identity/v3/projects => generated 375 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:48.578234 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c8884-a9c8-450c-a431-ef5ced80649d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.589553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2c8884-a9c8-450c-a431-ef5ced80649d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.644810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5779-22f3-4740-9a1f-5c9ccee33b39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.645413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5779-22f3-4740-9a1f-5c9ccee33b39 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.645689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5779-22f3-4740-9a1f-5c9ccee33b39 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.646472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81a5779-22f3-4740-9a1f-5c9ccee33b39 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.647363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5779-22f3-4740-9a1f-5c9ccee33b39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.649364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81a5779-22f3-4740-9a1f-5c9ccee33b39 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.670277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1276/2559] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:48 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:48.674283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb57612-3a68-4959-b0fd-415e568cd0cc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.684635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb57612-3a68-4959-b0fd-415e568cd0cc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.689237 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19216250-5455-4816-a911-7745b31f2db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.689828 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19216250-5455-4816-a911-7745b31f2db1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.690104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19216250-5455-4816-a911-7745b31f2db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.690376 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19216250-5455-4816-a911-7745b31f2db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.691033 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19216250-5455-4816-a911-7745b31f2db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.692659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19216250-5455-4816-a911-7745b31f2db1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.703241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1284/2560] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:48.707364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5779-22f3-4740-9a1f-5c9ccee33b39 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.718153 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81a5779-22f3-4740-9a1f-5c9ccee33b39 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.722819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442a5f35-c69c-4fe5-a185-af8cbf3fb334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.723417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a5f35-c69c-4fe5-a185-af8cbf3fb334 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.723691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a5f35-c69c-4fe5-a185-af8cbf3fb334 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.724590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442a5f35-c69c-4fe5-a185-af8cbf3fb334 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.725171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a5f35-c69c-4fe5-a185-af8cbf3fb334 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.726769 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-442a5f35-c69c-4fe5-a185-af8cbf3fb334 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.739738 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1277/2561] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:48.740944 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19216250-5455-4816-a911-7745b31f2db1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.750708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19216250-5455-4816-a911-7745b31f2db1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.755983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f3be-363c-4821-86b6-87b13a0885b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.756705 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f3be-363c-4821-86b6-87b13a0885b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.756931 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f3be-363c-4821-86b6-87b13a0885b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.757200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da99f3be-363c-4821-86b6-87b13a0885b4 admin admin] PATH_INFO: `/v3/projects/e1a8dd5f6e92469ca2f614676dd4857b/users/d9d9f9d1e50440e79aacfa94d3c21973/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.772776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f3be-363c-4821-86b6-87b13a0885b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1a8dd5f6e92469ca2f614676dd4857b, user_id=d9d9f9d1e50440e79aacfa94d3c21973, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.775478 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da99f3be-363c-4821-86b6-87b13a0885b4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:48.789221 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1285/2562] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:48 2022] PUT /identity/v3/projects/e1a8dd5f6e92469ca2f614676dd4857b/users/d9d9f9d1e50440e79aacfa94d3c21973/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:48.800783 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7ca6-5c41-4e64-bed3-c6bad06d0390 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.801057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7ca6-5c41-4e64-bed3-c6bad06d0390 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.801336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e63b7ca6-5c41-4e64-bed3-c6bad06d0390 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.831190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e63b7ca6-5c41-4e64-bed3-c6bad06d0390 None None] MFA Rules not processed for user `d9d9f9d1e50440e79aacfa94d3c21973`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:48.832464 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e63b7ca6-5c41-4e64-bed3-c6bad06d0390 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:48.898202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1278/2563] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:32:48.904788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f3be-363c-4821-86b6-87b13a0885b4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:48.968334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da99f3be-363c-4821-86b6-87b13a0885b4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:48.973003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2ea8-236b-415d-87ff-f1a9e931c7d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:48.973601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2ea8-236b-415d-87ff-f1a9e931c7d6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:48.974440 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2ea8-236b-415d-87ff-f1a9e931c7d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:48.974699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac4e2ea8-236b-415d-87ff-f1a9e931c7d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:48.975323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e2ea8-236b-415d-87ff-f1a9e931c7d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:48.977250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac4e2ea8-236b-415d-87ff-f1a9e931c7d6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:49.003275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1286/2564] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:48 2022] POST /identity/v3/projects => generated 379 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:49.007815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7ca6-5c41-4e64-bed3-c6bad06d0390 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:49.019102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e63b7ca6-5c41-4e64-bed3-c6bad06d0390 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:49.044624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:49.080989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700236-0727-4e18-8e86-2d8926ea3539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:49.081663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700236-0727-4e18-8e86-2d8926ea3539 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:49.081939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700236-0727-4e18-8e86-2d8926ea3539 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:49.082233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d700236-0727-4e18-8e86-2d8926ea3539 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:49.082931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d700236-0727-4e18-8e86-2d8926ea3539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:49.085572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d700236-0727-4e18-8e86-2d8926ea3539 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:49.111451 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1279/2565] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:49 2022] POST /identity/v3/users => generated 296 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:49.113388 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2ea8-236b-415d-87ff-f1a9e931c7d6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:49.124511 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac4e2ea8-236b-415d-87ff-f1a9e931c7d6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:49.129261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4bb86-a8ed-47a8-a112-961f54914837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:49.129862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4bb86-a8ed-47a8-a112-961f54914837 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:49.130713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4bb86-a8ed-47a8-a112-961f54914837 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:49.131007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee4bb86-a8ed-47a8-a112-961f54914837 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:49.131656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4bb86-a8ed-47a8-a112-961f54914837 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:49.133301 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee4bb86-a8ed-47a8-a112-961f54914837 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:49.145302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1287/2566] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:49.149514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700236-0727-4e18-8e86-2d8926ea3539 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:49.160682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d700236-0727-4e18-8e86-2d8926ea3539 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:49.165083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f75ca1-73a9-40ce-8465-b3a0338ad253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:49.165800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f75ca1-73a9-40ce-8465-b3a0338ad253 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:49.166075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f75ca1-73a9-40ce-8465-b3a0338ad253 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:49.166349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f75ca1-73a9-40ce-8465-b3a0338ad253 admin admin] PATH_INFO: `/v3/projects/8d8f79f4ed5e4822afb3f42fddb93c47/users/0c49561891ad46bcaedf14630c3e5f9c/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:49.183640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f75ca1-73a9-40ce-8465-b3a0338ad253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8f79f4ed5e4822afb3f42fddb93c47, user_id=0c49561891ad46bcaedf14630c3e5f9c, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:49.186379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f75ca1-73a9-40ce-8465-b3a0338ad253 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:49.203608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1280/2567] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:49 2022] PUT /identity/v3/projects/8d8f79f4ed5e4822afb3f42fddb93c47/users/0c49561891ad46bcaedf14630c3e5f9c/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:49.208393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4bb86-a8ed-47a8-a112-961f54914837 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:49.218784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee4bb86-a8ed-47a8-a112-961f54914837 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:49.276311 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b296f-b921-414e-b462-62ea422494a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:49.277035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b296f-b921-414e-b462-62ea422494a6 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:49.277338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b296f-b921-414e-b462-62ea422494a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:49.277614 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b296f-b921-414e-b462-62ea422494a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:49.278248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b296f-b921-414e-b462-62ea422494a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:49.279866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b296f-b921-414e-b462-62ea422494a6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:49.289759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1288/2568] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:49 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:49.294151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f75ca1-73a9-40ce-8465-b3a0338ad253 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:49.305060 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f75ca1-73a9-40ce-8465-b3a0338ad253 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:49.309577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cdfae-1e55-4e82-b3bc-00abf54f5818 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:49.310220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cdfae-1e55-4e82-b3bc-00abf54f5818 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:49.310498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cdfae-1e55-4e82-b3bc-00abf54f5818 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:49.310775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a2cdfae-1e55-4e82-b3bc-00abf54f5818 admin admin] PATH_INFO: `/v3/projects/8d8f79f4ed5e4822afb3f42fddb93c47/users/0c49561891ad46bcaedf14630c3e5f9c/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:49.312743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cdfae-1e55-4e82-b3bc-00abf54f5818 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d8f79f4ed5e4822afb3f42fddb93c47, user_id=0c49561891ad46bcaedf14630c3e5f9c, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:49.315363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a2cdfae-1e55-4e82-b3bc-00abf54f5818 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:49.326094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1281/2569] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:49 2022] PUT /identity/v3/projects/8d8f79f4ed5e4822afb3f42fddb93c47/users/0c49561891ad46bcaedf14630c3e5f9c/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:49.336552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3c301-18c7-4581-b571-91554f98d41b None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:49.336835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3c301-18c7-4581-b571-91554f98d41b None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:49.337109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0be3c301-18c7-4581-b571-91554f98d41b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:49.350838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:49.365554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0be3c301-18c7-4581-b571-91554f98d41b None None] MFA Rules not processed for user `0c49561891ad46bcaedf14630c3e5f9c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:49.366755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0be3c301-18c7-4581-b571-91554f98d41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:49.433020 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1289/2570] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:49 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:49.444379 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cdfae-1e55-4e82-b3bc-00abf54f5818 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:49.446137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7a2cdfae-1e55-4e82-b3bc-00abf54f5818 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:49.503792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a2cdfae-1e55-4e82-b3bc-00abf54f5818 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:49.507924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf19a55-4537-4170-8d80-226c949cc8eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:49.508554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf19a55-4537-4170-8d80-226c949cc8eb service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:49.508829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf19a55-4537-4170-8d80-226c949cc8eb service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:49.509098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf19a55-4537-4170-8d80-226c949cc8eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:49.518313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf19a55-4537-4170-8d80-226c949cc8eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:49.519468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf19a55-4537-4170-8d80-226c949cc8eb service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:49.529012 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1282/2571] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:49 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:49.570452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3c301-18c7-4581-b571-91554f98d41b None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:49.571873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0be3c301-18c7-4581-b571-91554f98d41b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:49.584122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0be3c301-18c7-4581-b571-91554f98d41b None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:49.587690 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f4d9f-055c-4d85-b374-053869920978 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:49.588315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4d9f-055c-4d85-b374-053869920978 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:49.588593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4d9f-055c-4d85-b374-053869920978 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:49.588861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1f4d9f-055c-4d85-b374-053869920978 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:49.645628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f4d9f-055c-4d85-b374-053869920978 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:49.647080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1f4d9f-055c-4d85-b374-053869920978 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:49.655793 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1290/2572] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:49 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:51.444741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf19a55-4537-4170-8d80-226c949cc8eb service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:51.454364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf19a55-4537-4170-8d80-226c949cc8eb service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:51.457951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11401d77-ab37-41da-9078-423a415e16ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:51.459043 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11401d77-ab37-41da-9078-423a415e16ea service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:51.459318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11401d77-ab37-41da-9078-423a415e16ea service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:51.459589 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11401d77-ab37-41da-9078-423a415e16ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:51.461325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-11401d77-ab37-41da-9078-423a415e16ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:51.520709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11401d77-ab37-41da-9078-423a415e16ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:51.522299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11401d77-ab37-41da-9078-423a415e16ea service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:51.531705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1283/2573] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:51 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:52.546449 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f4d9f-055c-4d85-b374-053869920978 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:52.607763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1f4d9f-055c-4d85-b374-053869920978 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:52.612201 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:52.612819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:52.613121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:52.613389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] PATH_INFO: `/v3/users/1c1fb3c688834483b73b1defa1e904d9` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:52.614481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c1fb3c688834483b73b1defa1e904d9)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:52.616395 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:52.649470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:52.662153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c1fb3c688834483b73b1defa1e904d9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:52.662804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c1fb3c688834483b73b1defa1e904d9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:52.663401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c1fb3c688834483b73b1defa1e904d9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:52.670056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c1fb3c688834483b73b1defa1e904d9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:52.682035 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c1fb3c688834483b73b1defa1e904d9'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:52.694274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1291/2574] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:52 2022] DELETE /identity/v3/users/1c1fb3c688834483b73b1defa1e904d9 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:52.698798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548fd0-b9ac-4096-9d2e-56f8bcd0eb12 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:52.699257 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548fd0-b9ac-4096-9d2e-56f8bcd0eb12 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:52.699381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21548fd0-b9ac-4096-9d2e-56f8bcd0eb12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:52.718199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-21548fd0-b9ac-4096-9d2e-56f8bcd0eb12 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:52.719422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-21548fd0-b9ac-4096-9d2e-56f8bcd0eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:52.732244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:52.778835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1284/2575] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:52.789538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:52.790990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:52.847561 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6909f1-518a-496e-a60b-61f8da87c2ac admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:52.851765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bdd2-e4c8-44cb-9bad-7b342119ecb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:52.852406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bdd2-e4c8-44cb-9bad-7b342119ecb8 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:52.852686 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bdd2-e4c8-44cb-9bad-7b342119ecb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:52.852962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8674bdd2-e4c8-44cb-9bad-7b342119ecb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:52.862217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674bdd2-e4c8-44cb-9bad-7b342119ecb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:52.863670 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8674bdd2-e4c8-44cb-9bad-7b342119ecb8 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:52.873851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1292/2576] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:53.146584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548fd0-b9ac-4096-9d2e-56f8bcd0eb12 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:53.148129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-21548fd0-b9ac-4096-9d2e-56f8bcd0eb12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:53.162130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21548fd0-b9ac-4096-9d2e-56f8bcd0eb12 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:53.166808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:53.167452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:53.167731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:53.167998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] PATH_INFO: `/v3/projects/2cd002d5f2e64dde860679aadd470f06` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:53.169153 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] RBAC: Authorizing `identity:delete_project(project_id=2cd002d5f2e64dde860679aadd470f06)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:53.171050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:53.222207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2cd002d5f2e64dde860679aadd470f06', 'request_id': 'req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.241549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2cd002d5f2e64dde860679aadd470f06', 'request_id': 'req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.249774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2cd002d5f2e64dde860679aadd470f06', 'request_id': 'req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.261607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] The token cache is being invalidate because project 2cd002d5f2e64dde860679aadd470f06 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:53.261928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.262567 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.264271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1285/2577] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:53 2022] DELETE /identity/v3/projects/2cd002d5f2e64dde860679aadd470f06 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:53.268330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bdd2-e4c8-44cb-9bad-7b342119ecb8 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:53.293142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8674bdd2-e4c8-44cb-9bad-7b342119ecb8 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:53.370264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:53.371071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:53.371369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:53.371683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] PATH_INFO: `/v3/users/d9d9f9d1e50440e79aacfa94d3c21973` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:53.373063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9d9f9d1e50440e79aacfa94d3c21973)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:53.375351 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:53.427103 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9d9f9d1e50440e79aacfa94d3c21973'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.427910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9d9f9d1e50440e79aacfa94d3c21973'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.428553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9d9f9d1e50440e79aacfa94d3c21973'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.434314 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:53.436578 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9d9f9d1e50440e79aacfa94d3c21973'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.453267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9d9f9d1e50440e79aacfa94d3c21973'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.477573 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1293/2578] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:53 2022] DELETE /identity/v3/users/d9d9f9d1e50440e79aacfa94d3c21973 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:53.662447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:53.663936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:53.680799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfad9e4-8d6a-44bd-a426-5397e50d4d9f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:53.745463 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:53.746118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:53.746369 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:53.746642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] PATH_INFO: `/v3/users/44188b25a0a34c61a8c2b2f635faedeb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:53.747806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] RBAC: Authorizing `identity:delete_user(user_id=44188b25a0a34c61a8c2b2f635faedeb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:53.749816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:53.774192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:53.775656 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:53.790651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00cdb9e8-428c-49b7-9534-00415942fe74 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:53.795776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:53.796455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:53.796734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:53.797011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] PATH_INFO: `/v3/projects/e1a8dd5f6e92469ca2f614676dd4857b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:53.798292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1a8dd5f6e92469ca2f614676dd4857b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:53.800118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:53.807688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:53.809816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '44188b25a0a34c61a8c2b2f635faedeb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.810630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '44188b25a0a34c61a8c2b2f635faedeb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.825621 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '44188b25a0a34c61a8c2b2f635faedeb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.826356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '44188b25a0a34c61a8c2b2f635faedeb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.834586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-031efb76-601e-400d-8baf-05009855a878 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '44188b25a0a34c61a8c2b2f635faedeb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.847690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1286/2579] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:53 2022] DELETE /identity/v3/users/44188b25a0a34c61a8c2b2f635faedeb => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:53.852122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a3149-06c8-4c74-8da8-88f54261b731 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:53.852441 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a3149-06c8-4c74-8da8-88f54261b731 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:53.852723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-340a3149-06c8-4c74-8da8-88f54261b731 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:53.855073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1a8dd5f6e92469ca2f614676dd4857b', 'request_id': 'req-853bc254-acf8-49d7-b817-24ad82b3ea59'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.862582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1a8dd5f6e92469ca2f614676dd4857b', 'request_id': 'req-853bc254-acf8-49d7-b817-24ad82b3ea59'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.869922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1a8dd5f6e92469ca2f614676dd4857b', 'request_id': 'req-853bc254-acf8-49d7-b817-24ad82b3ea59'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.872810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-340a3149-06c8-4c74-8da8-88f54261b731 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:53.874055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-340a3149-06c8-4c74-8da8-88f54261b731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:53.884304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] The token cache is being invalidate because project e1a8dd5f6e92469ca2f614676dd4857b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:53.884602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.885233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:53.886726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1294/2580] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:53 2022] DELETE /identity/v3/projects/e1a8dd5f6e92469ca2f614676dd4857b => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:53.890579 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:53.891903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:53.934876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1287/2581] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:32:53.945050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a3149-06c8-4c74-8da8-88f54261b731 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:53.946587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-340a3149-06c8-4c74-8da8-88f54261b731 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:53.963614 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853bc254-acf8-49d7-b817-24ad82b3ea59 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:53.968358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:53.968990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:53.969268 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:53.969536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] PATH_INFO: `/v3/users/0c49561891ad46bcaedf14630c3e5f9c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:53.970663 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c49561891ad46bcaedf14630c3e5f9c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:53.972601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:54.005943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-340a3149-06c8-4c74-8da8-88f54261b731 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:54.010279 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f79b-9d78-438d-a3ac-edbaaf093f95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:54.010891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f79b-9d78-438d-a3ac-edbaaf093f95 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:54.011169 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f79b-9d78-438d-a3ac-edbaaf093f95 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:54.011438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a316f79b-9d78-438d-a3ac-edbaaf093f95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:54.022717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316f79b-9d78-438d-a3ac-edbaaf093f95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:54.024279 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a316f79b-9d78-438d-a3ac-edbaaf093f95 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:54.026811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c49561891ad46bcaedf14630c3e5f9c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.027506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c49561891ad46bcaedf14630c3e5f9c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.028282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c49561891ad46bcaedf14630c3e5f9c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.034885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1288/2582] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:32:54.037969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c49561891ad46bcaedf14630c3e5f9c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.039172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:54.052866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c49561891ad46bcaedf14630c3e5f9c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.066611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1295/2583] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:53 2022] DELETE /identity/v3/users/0c49561891ad46bcaedf14630c3e5f9c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:54.328586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f79b-9d78-438d-a3ac-edbaaf093f95 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:54.330292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a316f79b-9d78-438d-a3ac-edbaaf093f95 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:54.348039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a316f79b-9d78-438d-a3ac-edbaaf093f95 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:54.365089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:54.366562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:54.417016 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:54.417615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:54.418042 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:54.418435 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] PATH_INFO: `/v3/projects/e8bae713b3484e73b2a9d60ab08393de` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:54.419923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8bae713b3484e73b2a9d60ab08393de)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:54.421971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:54.430938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:54.449289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a95eba8e-c2f3-4a6b-b652-d43bdb167f90 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:54.454655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:54.455309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:54.455677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:54.455989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] PATH_INFO: `/v3/projects/8d8f79f4ed5e4822afb3f42fddb93c47` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:54.457187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d8f79f4ed5e4822afb3f42fddb93c47)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:54.459941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:54.475299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8bae713b3484e73b2a9d60ab08393de', 'request_id': 'req-1f4e7fd9-46da-4629-9d97-720b9fc63949'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.481542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8bae713b3484e73b2a9d60ab08393de', 'request_id': 'req-1f4e7fd9-46da-4629-9d97-720b9fc63949'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.490055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8bae713b3484e73b2a9d60ab08393de', 'request_id': 'req-1f4e7fd9-46da-4629-9d97-720b9fc63949'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.501893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] The token cache is being invalidate because project e8bae713b3484e73b2a9d60ab08393de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:54.502186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.502828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.504339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1289/2584] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:54 2022] DELETE /identity/v3/projects/e8bae713b3484e73b2a9d60ab08393de => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:54.510416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:54.510416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:54.520899 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d8f79f4ed5e4822afb3f42fddb93c47', 'request_id': 'req-da6e06e8-1c1d-4879-8657-db697f656996'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.528698 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d8f79f4ed5e4822afb3f42fddb93c47', 'request_id': 'req-da6e06e8-1c1d-4879-8657-db697f656996'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.537645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d8f79f4ed5e4822afb3f42fddb93c47', 'request_id': 'req-da6e06e8-1c1d-4879-8657-db697f656996'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.550593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] The token cache is being invalidate because project 8d8f79f4ed5e4822afb3f42fddb93c47 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:54.550895 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.551566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-da6e06e8-1c1d-4879-8657-db697f656996 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.553628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1296/2585] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:54 2022] DELETE /identity/v3/projects/8d8f79f4ed5e4822afb3f42fddb93c47 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:54.559322 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782d19-874b-4a26-831c-7427418a0666 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:54.559611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782d19-874b-4a26-831c-7427418a0666 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:54.559892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83782d19-874b-4a26-831c-7427418a0666 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:54.580541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-83782d19-874b-4a26-831c-7427418a0666 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:54.581765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-83782d19-874b-4a26-831c-7427418a0666 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:54.582163 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4e7fd9-46da-4629-9d97-720b9fc63949 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:54.640172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:54.640815 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:54.641095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:54.641363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] PATH_INFO: `/v3/users/e8a4ab77b3d9430ebb56c7e96f333830` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:54.642494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e8a4ab77b3d9430ebb56c7e96f333830)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:54.642685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1297/2586] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:32:54.644544 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:54.652781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd37a3-3e08-4bba-a5c4-cfca3f6aefbc None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:54.653126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd37a3-3e08-4bba-a5c4-cfca3f6aefbc None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:54.653348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbdd37a3-3e08-4bba-a5c4-cfca3f6aefbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:54.662655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:54.675795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dbdd37a3-3e08-4bba-a5c4-cfca3f6aefbc None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:54.677855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dbdd37a3-3e08-4bba-a5c4-cfca3f6aefbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:54.687888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1298/2587] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:32:54.691801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd37a3-3e08-4bba-a5c4-cfca3f6aefbc None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:54.693929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:54.695997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e8a4ab77b3d9430ebb56c7e96f333830'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.696879 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e8a4ab77b3d9430ebb56c7e96f333830'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.702178 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbdd37a3-3e08-4bba-a5c4-cfca3f6aefbc None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:54.707421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa925-6058-4576-8d46-24aedf624300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:54.708560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa925-6058-4576-8d46-24aedf624300 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:54.708840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa925-6058-4576-8d46-24aedf624300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:54.709104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8aa925-6058-4576-8d46-24aedf624300 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:54.709752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aa925-6058-4576-8d46-24aedf624300 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:32:54.710136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aa925-6058-4576-8d46-24aedf624300 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:54.711638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8aa925-6058-4576-8d46-24aedf624300 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:54.712012 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e8a4ab77b3d9430ebb56c7e96f333830'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.712725 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e8a4ab77b3d9430ebb56c7e96f333830'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.720425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e8a4ab77b3d9430ebb56c7e96f333830'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:54.723464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1299/2588] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:32:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:32:54.729037 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa925-6058-4576-8d46-24aedf624300 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:54.731144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4a8aa925-6058-4576-8d46-24aedf624300 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:54.734596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1290/2589] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:54 2022] DELETE /identity/v3/users/e8a4ab77b3d9430ebb56c7e96f333830 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:54.744042 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8aa925-6058-4576-8d46-24aedf624300 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:54.810131 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe3a4c-3bdc-4616-80d7-3f7cf1a68f85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:54.810814 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe3a4c-3bdc-4616-80d7-3f7cf1a68f85 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:54.810931 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe3a4c-3bdc-4616-80d7-3f7cf1a68f85 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:54.811151 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe3a4c-3bdc-4616-80d7-3f7cf1a68f85 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:54.812240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe3a4c-3bdc-4616-80d7-3f7cf1a68f85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:54.814256 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfbe3a4c-3bdc-4616-80d7-3f7cf1a68f85 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:54.844337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1300/2590] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:54 2022] POST /identity/v3/projects => generated 377 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:32:54.849141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:54.859336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c2f5ae-607f-4edb-8edd-bce87dfbb636 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:54.949046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5823f-37ce-4615-8a00-7b72398e7f1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:54.949662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5823f-37ce-4615-8a00-7b72398e7f1c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:54.949944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5823f-37ce-4615-8a00-7b72398e7f1c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:54.950218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea5823f-37ce-4615-8a00-7b72398e7f1c admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:54.950853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5823f-37ce-4615-8a00-7b72398e7f1c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:54.952978 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea5823f-37ce-4615-8a00-7b72398e7f1c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:54.978867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1291/2591] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:54 2022] POST /identity/v3/users => generated 289 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:54.983069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe3a4c-3bdc-4616-80d7-3f7cf1a68f85 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.001482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe3a4c-3bdc-4616-80d7-3f7cf1a68f85 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.007620 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab12ad3-c127-4cbc-91be-f0c19d20d6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.008354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab12ad3-c127-4cbc-91be-f0c19d20d6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.008638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab12ad3-c127-4cbc-91be-f0c19d20d6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.008916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab12ad3-c127-4cbc-91be-f0c19d20d6e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.009562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab12ad3-c127-4cbc-91be-f0c19d20d6e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.011162 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab12ad3-c127-4cbc-91be-f0c19d20d6e8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.022343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1301/2592] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:54 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:55.026980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5823f-37ce-4615-8a00-7b72398e7f1c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.039114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea5823f-37ce-4615-8a00-7b72398e7f1c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.043519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab12ad3-c127-4cbc-91be-f0c19d20d6e8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.044888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afeb06-4ec7-42c7-8ea7-111be0ddf341 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.045545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afeb06-4ec7-42c7-8ea7-111be0ddf341 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.046015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afeb06-4ec7-42c7-8ea7-111be0ddf341 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.046292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56afeb06-4ec7-42c7-8ea7-111be0ddf341 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.046494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2ab12ad3-c127-4cbc-91be-f0c19d20d6e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:55.046969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afeb06-4ec7-42c7-8ea7-111be0ddf341 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.048610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56afeb06-4ec7-42c7-8ea7-111be0ddf341 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.059310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1292/2593] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:32:55.065425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afeb06-4ec7-42c7-8ea7-111be0ddf341 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.075726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab12ad3-c127-4cbc-91be-f0c19d20d6e8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.077864 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56afeb06-4ec7-42c7-8ea7-111be0ddf341 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.081276 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.083690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2ec03d-22d8-4840-b348-4a999d5170a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.084382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ec03d-22d8-4840-b348-4a999d5170a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.084661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ec03d-22d8-4840-b348-4a999d5170a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.085081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2ec03d-22d8-4840-b348-4a999d5170a8 admin admin] PATH_INFO: `/v3/projects/fc2715fcb30c494b83259f8e32dd6b8a/users/d63057bd107a4e659f13e25e9376ebf0/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.092541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.092881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.093171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] PATH_INFO: `/v3/projects/57966f16a9a74c4dbf7535f9028ef1d7` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.094964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] RBAC: Authorizing `identity:delete_project(project_id=57966f16a9a74c4dbf7535f9028ef1d7)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.098218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.103292 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ec03d-22d8-4840-b348-4a999d5170a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc2715fcb30c494b83259f8e32dd6b8a, user_id=d63057bd107a4e659f13e25e9376ebf0, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.106118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2ec03d-22d8-4840-b348-4a999d5170a8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.122674 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1293/2594] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:55 2022] PUT /identity/v3/projects/fc2715fcb30c494b83259f8e32dd6b8a/users/d63057bd107a4e659f13e25e9376ebf0/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:55.134974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8aa1-6b64-4d9e-a885-9fcbcbce7d35 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.135266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8aa1-6b64-4d9e-a885-9fcbcbce7d35 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.135626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bc8aa1-6b64-4d9e-a885-9fcbcbce7d35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.159281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '57966f16a9a74c4dbf7535f9028ef1d7', 'request_id': 'req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.165832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-07bc8aa1-6b64-4d9e-a885-9fcbcbce7d35 None None] MFA Rules not processed for user `d63057bd107a4e659f13e25e9376ebf0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:55.167150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-07bc8aa1-6b64-4d9e-a885-9fcbcbce7d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:55.167918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '57966f16a9a74c4dbf7535f9028ef1d7', 'request_id': 'req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.174369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '57966f16a9a74c4dbf7535f9028ef1d7', 'request_id': 'req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.192480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] The token cache is being invalidate because project 57966f16a9a74c4dbf7535f9028ef1d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:55.192838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.193453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.196189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1302/2595] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:55 2022] DELETE /identity/v3/projects/57966f16a9a74c4dbf7535f9028ef1d7 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:55.200100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.204753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:55.251788 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1294/2596] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:55.256264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc8aa1-6b64-4d9e-a885-9fcbcbce7d35 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.257773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-07bc8aa1-6b64-4d9e-a885-9fcbcbce7d35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:55.268097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:55.268630 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=3,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:55.294528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce7068c0-bb62-4fa0-97b4-e96dc19adc6b admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.299766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.300441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.300721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.300993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] PATH_INFO: `/v3/users/570a5812340949c78df3649f23fb7400` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.302207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=570a5812340949c78df3649f23fb7400)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.304990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.337973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bc8aa1-6b64-4d9e-a885-9fcbcbce7d35 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.343721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0717bf-1100-414a-a19e-f2f2ebac3b08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.344378 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0717bf-1100-414a-a19e-f2f2ebac3b08 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.344651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0717bf-1100-414a-a19e-f2f2ebac3b08 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.344923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0717bf-1100-414a-a19e-f2f2ebac3b08 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.345579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0717bf-1100-414a-a19e-f2f2ebac3b08 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.347642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e0717bf-1100-414a-a19e-f2f2ebac3b08 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.368382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '570a5812340949c78df3649f23fb7400'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.369081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '570a5812340949c78df3649f23fb7400'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.369775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '570a5812340949c78df3649f23fb7400'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.381164 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1295/2597] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:55 2022] POST /identity/v3/projects => generated 377 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:32:55.385238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0717bf-1100-414a-a19e-f2f2ebac3b08 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.385396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '570a5812340949c78df3649f23fb7400'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.387227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9e0717bf-1100-414a-a19e-f2f2ebac3b08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:55.400173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '570a5812340949c78df3649f23fb7400'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.423861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1303/2598] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:55 2022] DELETE /identity/v3/users/570a5812340949c78df3649f23fb7400 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:55.460275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0717bf-1100-414a-a19e-f2f2ebac3b08 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.529756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d97969-588c-4f38-b650-69a3a8759464 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.530460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d97969-588c-4f38-b650-69a3a8759464 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.530827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d97969-588c-4f38-b650-69a3a8759464 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.531177 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d97969-588c-4f38-b650-69a3a8759464 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.531821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d97969-588c-4f38-b650-69a3a8759464 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.533937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d97969-588c-4f38-b650-69a3a8759464 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.555722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1296/2599] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:55 2022] POST /identity/v3/users => generated 289 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:55.560347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.570948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcb7b94-62fe-42f1-99a4-1487460040dc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.575528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ba801-27d2-482b-9cfe-c704155f8222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.576134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ba801-27d2-482b-9cfe-c704155f8222 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.576447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ba801-27d2-482b-9cfe-c704155f8222 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.576722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0ba801-27d2-482b-9cfe-c704155f8222 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.577368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ba801-27d2-482b-9cfe-c704155f8222 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.579287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0ba801-27d2-482b-9cfe-c704155f8222 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.590447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1304/2600] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:55.594545 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d97969-588c-4f38-b650-69a3a8759464 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.604886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d97969-588c-4f38-b650-69a3a8759464 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.609610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aefa085-421a-4514-8098-b7735d457d14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.610235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefa085-421a-4514-8098-b7735d457d14 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.610510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefa085-421a-4514-8098-b7735d457d14 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.610778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aefa085-421a-4514-8098-b7735d457d14 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.611413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefa085-421a-4514-8098-b7735d457d14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.613037 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aefa085-421a-4514-8098-b7735d457d14 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.626535 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1297/2601] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:55.628031 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ba801-27d2-482b-9cfe-c704155f8222 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.638623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0ba801-27d2-482b-9cfe-c704155f8222 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.643468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c11f1-47aa-4603-adf9-59c6519b6ef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.644132 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c11f1-47aa-4603-adf9-59c6519b6ef7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.644526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c11f1-47aa-4603-adf9-59c6519b6ef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.644803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-804c11f1-47aa-4603-adf9-59c6519b6ef7 admin admin] PATH_INFO: `/v3/projects/af85e6ed6f61436880491a88c4da4d4a/users/a6c625f0e28b4a4a89f6709d25c944e6/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.662574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c11f1-47aa-4603-adf9-59c6519b6ef7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af85e6ed6f61436880491a88c4da4d4a, user_id=a6c625f0e28b4a4a89f6709d25c944e6, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.665507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-804c11f1-47aa-4603-adf9-59c6519b6ef7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.682197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1305/2602] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:55 2022] PUT /identity/v3/projects/af85e6ed6f61436880491a88c4da4d4a/users/a6c625f0e28b4a4a89f6709d25c944e6/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:55.692721 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed6a48-b237-44ca-be36-ac01ef4dd4a2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.693611 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed6a48-b237-44ca-be36-ac01ef4dd4a2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.693997 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ed6a48-b237-44ca-be36-ac01ef4dd4a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.726396 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c11f1-47aa-4603-adf9-59c6519b6ef7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.730975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-804c11f1-47aa-4603-adf9-59c6519b6ef7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:55.734119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-61ed6a48-b237-44ca-be36-ac01ef4dd4a2 None None] MFA Rules not processed for user `a6c625f0e28b4a4a89f6709d25c944e6`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:55.736582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-61ed6a48-b237-44ca-be36-ac01ef4dd4a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:55.743139 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:55.807423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-804c11f1-47aa-4603-adf9-59c6519b6ef7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.808322 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1298/2603] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:55.812252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.812816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed6a48-b237-44ca-be36-ac01ef4dd4a2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.812905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.813157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.813428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] PATH_INFO: `/v3/projects/3426ceed2bf94f169e9aa7402de9264d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.814570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3426ceed2bf94f169e9aa7402de9264d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.816501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.823492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ed6a48-b237-44ca-be36-ac01ef4dd4a2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.828351 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e50fb-ddd8-4aa2-99e0-0fd95b848570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.829096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e50fb-ddd8-4aa2-99e0-0fd95b848570 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.829520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e50fb-ddd8-4aa2-99e0-0fd95b848570 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.829655 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15e50fb-ddd8-4aa2-99e0-0fd95b848570 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.830400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e50fb-ddd8-4aa2-99e0-0fd95b848570 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.832376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15e50fb-ddd8-4aa2-99e0-0fd95b848570 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.849084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:55.861371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1299/2604] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:55 2022] POST /identity/v3/projects => generated 377 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:55.866237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e50fb-ddd8-4aa2-99e0-0fd95b848570 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.867990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3426ceed2bf94f169e9aa7402de9264d', 'request_id': 'req-2031d9b2-bfd9-4472-92a0-384f09ca0268'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.874572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3426ceed2bf94f169e9aa7402de9264d', 'request_id': 'req-2031d9b2-bfd9-4472-92a0-384f09ca0268'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.880769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3426ceed2bf94f169e9aa7402de9264d', 'request_id': 'req-2031d9b2-bfd9-4472-92a0-384f09ca0268'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.893644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] The token cache is being invalidate because project 3426ceed2bf94f169e9aa7402de9264d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:55.893937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.894593 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2031d9b2-bfd9-4472-92a0-384f09ca0268 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:55.896682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1306/2605] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:55 2022] DELETE /identity/v3/projects/3426ceed2bf94f169e9aa7402de9264d => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:55.902729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ddf49-710c-461e-84f8-5b4ea7e64bd9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.903014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ddf49-710c-461e-84f8-5b4ea7e64bd9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.903287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67ddf49-710c-461e-84f8-5b4ea7e64bd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.922628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c67ddf49-710c-461e-84f8-5b4ea7e64bd9 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:55.923855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c67ddf49-710c-461e-84f8-5b4ea7e64bd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:55.932970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1307/2606] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:55.934658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15e50fb-ddd8-4aa2-99e0-0fd95b848570 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.939376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d431c-f4ec-4fef-84cc-9eb4131c5336 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.940077 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d431c-f4ec-4fef-84cc-9eb4131c5336 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.940387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d431c-f4ec-4fef-84cc-9eb4131c5336 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.940663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-751d431c-f4ec-4fef-84cc-9eb4131c5336 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.941194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c55e2-7b3a-4e44-a9e8-ee7419d2aa04 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.941332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d431c-f4ec-4fef-84cc-9eb4131c5336 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.941483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c55e2-7b3a-4e44-a9e8-ee7419d2aa04 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.941761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9c55e2-7b3a-4e44-a9e8-ee7419d2aa04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.943968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-751d431c-f4ec-4fef-84cc-9eb4131c5336 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.962976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-2b9c55e2-7b3a-4e44-a9e8-ee7419d2aa04 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:55.964222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2b9c55e2-7b3a-4e44-a9e8-ee7419d2aa04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:55.966346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1300/2607] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:55 2022] POST /identity/v3/users => generated 295 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:55.970206 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d431c-f4ec-4fef-84cc-9eb4131c5336 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.971854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-751d431c-f4ec-4fef-84cc-9eb4131c5336 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:55.972941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1308/2608] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:32:55.977287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c55e2-7b3a-4e44-a9e8-ee7419d2aa04 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:55.987630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9c55e2-7b3a-4e44-a9e8-ee7419d2aa04 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.988268 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-751d431c-f4ec-4fef-84cc-9eb4131c5336 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:55.993812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b98cf8-441a-4aae-9a8a-ac6923d08879 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.994737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98cf8-441a-4aae-9a8a-ac6923d08879 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.995024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98cf8-441a-4aae-9a8a-ac6923d08879 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.995129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c72ce-1535-498e-8a17-3ff4321076b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:55.995298 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b98cf8-441a-4aae-9a8a-ac6923d08879 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.995823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c72ce-1535-498e-8a17-3ff4321076b9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:55.995957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b98cf8-441a-4aae-9a8a-ac6923d08879 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:32:55.996141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c72ce-1535-498e-8a17-3ff4321076b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:55.996305 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b98cf8-441a-4aae-9a8a-ac6923d08879 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.996452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107c72ce-1535-498e-8a17-3ff4321076b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:55.997110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c72ce-1535-498e-8a17-3ff4321076b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:55.998611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b98cf8-441a-4aae-9a8a-ac6923d08879 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:55.998719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107c72ce-1535-498e-8a17-3ff4321076b9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.015303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1301/2609] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:32:56.015499 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1309/2610] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:32:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:32:56.016671 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c72ce-1535-498e-8a17-3ff4321076b9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.016987 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b98cf8-441a-4aae-9a8a-ac6923d08879 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.027231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b98cf8-441a-4aae-9a8a-ac6923d08879 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.027634 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107c72ce-1535-498e-8a17-3ff4321076b9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.032218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615079a-b19b-4242-a622-9b40bf9117f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.032371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424c178-f881-4bc4-8ec6-97bc759644ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.032916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424c178-f881-4bc4-8ec6-97bc759644ef admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.033089 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615079a-b19b-4242-a622-9b40bf9117f6 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.033190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424c178-f881-4bc4-8ec6-97bc759644ef admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.033461 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f424c178-f881-4bc4-8ec6-97bc759644ef admin admin] PATH_INFO: `/v3/projects/98bec6e9baf94991b8e8c8ceae52f73c/users/48f866af38164a74a6c1b938921ef071/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.033628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615079a-b19b-4242-a622-9b40bf9117f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.033997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f615079a-b19b-4242-a622-9b40bf9117f6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.034749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615079a-b19b-4242-a622-9b40bf9117f6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.036994 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f615079a-b19b-4242-a622-9b40bf9117f6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.048542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424c178-f881-4bc4-8ec6-97bc759644ef admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bec6e9baf94991b8e8c8ceae52f73c, user_id=48f866af38164a74a6c1b938921ef071, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.051183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f424c178-f881-4bc4-8ec6-97bc759644ef admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.065236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1302/2611] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:56 2022] PUT /identity/v3/projects/98bec6e9baf94991b8e8c8ceae52f73c/users/48f866af38164a74a6c1b938921ef071/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:56.069016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1310/2612] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:56 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:32:56.069735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424c178-f881-4bc4-8ec6-97bc759644ef admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.069932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615079a-b19b-4242-a622-9b40bf9117f6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.113572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:56.134954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f615079a-b19b-4242-a622-9b40bf9117f6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.139034 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f424c178-f881-4bc4-8ec6-97bc759644ef admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.139838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee22fbb-9c88-4a85-bd17-e851de03a150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.140485 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee22fbb-9c88-4a85-bd17-e851de03a150 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.140831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee22fbb-9c88-4a85-bd17-e851de03a150 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.141045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee22fbb-9c88-4a85-bd17-e851de03a150 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.141682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee22fbb-9c88-4a85-bd17-e851de03a150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.143620 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bee22fbb-9c88-4a85-bd17-e851de03a150 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.143824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c091136-299d-45d4-8bd8-8f6a83a9f78d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.144460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091136-299d-45d4-8bd8-8f6a83a9f78d admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.144741 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091136-299d-45d4-8bd8-8f6a83a9f78d admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.145020 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c091136-299d-45d4-8bd8-8f6a83a9f78d admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.145691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c091136-299d-45d4-8bd8-8f6a83a9f78d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.147274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c091136-299d-45d4-8bd8-8f6a83a9f78d admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.157955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1303/2613] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:32:56.162701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c091136-299d-45d4-8bd8-8f6a83a9f78d admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.168004 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1311/2614] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:56 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:32:56.171872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee22fbb-9c88-4a85-bd17-e851de03a150 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.176418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c091136-299d-45d4-8bd8-8f6a83a9f78d admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.181875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde603fc-4e3c-492c-99a7-c80c2fbcd6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.182016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee22fbb-9c88-4a85-bd17-e851de03a150 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.182532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde603fc-4e3c-492c-99a7-c80c2fbcd6b4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.182886 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde603fc-4e3c-492c-99a7-c80c2fbcd6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.183061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dde603fc-4e3c-492c-99a7-c80c2fbcd6b4 admin admin] PATH_INFO: `/v3/projects/98bec6e9baf94991b8e8c8ceae52f73c/users/48f866af38164a74a6c1b938921ef071/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.185025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde603fc-4e3c-492c-99a7-c80c2fbcd6b4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98bec6e9baf94991b8e8c8ceae52f73c, user_id=48f866af38164a74a6c1b938921ef071, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.186951 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c19629-1bbf-4788-8076-75d2ce5a53ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.187560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c19629-1bbf-4788-8076-75d2ce5a53ea admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.187841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c19629-1bbf-4788-8076-75d2ce5a53ea admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.188118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c19629-1bbf-4788-8076-75d2ce5a53ea admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.188343 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dde603fc-4e3c-492c-99a7-c80c2fbcd6b4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.189170 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c19629-1bbf-4788-8076-75d2ce5a53ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.191027 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c19629-1bbf-4788-8076-75d2ce5a53ea admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.199850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1304/2615] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:56 2022] PUT /identity/v3/projects/98bec6e9baf94991b8e8c8ceae52f73c/users/48f866af38164a74a6c1b938921ef071/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:56.205161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1312/2616] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:56.209339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde603fc-4e3c-492c-99a7-c80c2fbcd6b4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.211188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef2a0a-385e-4588-afd1-9fb4233ed56c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.211472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef2a0a-385e-4588-afd1-9fb4233ed56c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.211745 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfef2a0a-385e-4588-afd1-9fb4233ed56c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.242260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-dfef2a0a-385e-4588-afd1-9fb4233ed56c None None] MFA Rules not processed for user `48f866af38164a74a6c1b938921ef071`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:56.243490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dfef2a0a-385e-4588-afd1-9fb4233ed56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:56.276677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dde603fc-4e3c-492c-99a7-c80c2fbcd6b4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.278114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:56.283776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f31e-9a6a-4856-86c7-d3ea5cd0ffc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.284186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f31e-9a6a-4856-86c7-d3ea5cd0ffc1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.284502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f31e-9a6a-4856-86c7-d3ea5cd0ffc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.284772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a88f31e-9a6a-4856-86c7-d3ea5cd0ffc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.285456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88f31e-9a6a-4856-86c7-d3ea5cd0ffc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.287749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a88f31e-9a6a-4856-86c7-d3ea5cd0ffc1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.298551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1305/2617] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:56.303202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f31e-9a6a-4856-86c7-d3ea5cd0ffc1 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.312778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a88f31e-9a6a-4856-86c7-d3ea5cd0ffc1 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.317700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6877e1ae-6083-475e-97e9-71ac7ba720b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.318474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877e1ae-6083-475e-97e9-71ac7ba720b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.318701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1313/2618] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:56 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:32:56.318862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877e1ae-6083-475e-97e9-71ac7ba720b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.319100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6877e1ae-6083-475e-97e9-71ac7ba720b7 admin admin] PATH_INFO: `/v3/projects/b7f166d4b63043708859dcbe1b609efb/users/e1e36eca971042179d0f63849ea6d5f0/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.331260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef2a0a-385e-4588-afd1-9fb4233ed56c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.332816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dfef2a0a-385e-4588-afd1-9fb4233ed56c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:56.335249 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877e1ae-6083-475e-97e9-71ac7ba720b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7f166d4b63043708859dcbe1b609efb, user_id=e1e36eca971042179d0f63849ea6d5f0, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.337934 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6877e1ae-6083-475e-97e9-71ac7ba720b7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.352207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1306/2619] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:56 2022] PUT /identity/v3/projects/b7f166d4b63043708859dcbe1b609efb/users/e1e36eca971042179d0f63849ea6d5f0/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:56.363511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078547c-71cc-4c8e-b28d-3dc551c2da01 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.363850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078547c-71cc-4c8e-b28d-3dc551c2da01 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.364136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4078547c-71cc-4c8e-b28d-3dc551c2da01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.392398 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfef2a0a-385e-4588-afd1-9fb4233ed56c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.392691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-4078547c-71cc-4c8e-b28d-3dc551c2da01 None None] MFA Rules not processed for user `e1e36eca971042179d0f63849ea6d5f0`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:56.393916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-4078547c-71cc-4c8e-b28d-3dc551c2da01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:56.449457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92305b4-85cd-470f-a0de-55b59c0c5e5b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.450083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92305b4-85cd-470f-a0de-55b59c0c5e5b service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.450368 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92305b4-85cd-470f-a0de-55b59c0c5e5b service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.450650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92305b4-85cd-470f-a0de-55b59c0c5e5b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.452475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d92305b4-85cd-470f-a0de-55b59c0c5e5b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:56.472645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1307/2620] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:32:56.474288 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078547c-71cc-4c8e-b28d-3dc551c2da01 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.502782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:56.527161 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92305b4-85cd-470f-a0de-55b59c0c5e5b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.528763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92305b4-85cd-470f-a0de-55b59c0c5e5b service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.541189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1314/2621] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:56 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:32:56.546050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4078547c-71cc-4c8e-b28d-3dc551c2da01 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.551797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641af1-eb4e-4ec0-a0cf-c800ef6887c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.552526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641af1-eb4e-4ec0-a0cf-c800ef6887c7 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.552884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641af1-eb4e-4ec0-a0cf-c800ef6887c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.553223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92641af1-eb4e-4ec0-a0cf-c800ef6887c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.553938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641af1-eb4e-4ec0-a0cf-c800ef6887c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.556179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92641af1-eb4e-4ec0-a0cf-c800ef6887c7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.592169 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1308/2622] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:56 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:56.596853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92305b4-85cd-470f-a0de-55b59c0c5e5b service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.609265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92305b4-85cd-470f-a0de-55b59c0c5e5b service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.656944 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:56.676434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607b98-8b5a-4b67-a4d2-d9ab2c9a2e07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.677615 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607b98-8b5a-4b67-a4d2-d9ab2c9a2e07 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.678017 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607b98-8b5a-4b67-a4d2-d9ab2c9a2e07 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.678304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6607b98-8b5a-4b67-a4d2-d9ab2c9a2e07 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.679083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6607b98-8b5a-4b67-a4d2-d9ab2c9a2e07 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.681080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6607b98-8b5a-4b67-a4d2-d9ab2c9a2e07 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.707133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1315/2623] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:56 2022] POST /identity/v3/users => generated 296 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:56.711594 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641af1-eb4e-4ec0-a0cf-c800ef6887c7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.724680 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92641af1-eb4e-4ec0-a0cf-c800ef6887c7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.731976 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2ab98-6c2a-4d75-a1fa-013e967e217c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.733058 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2ab98-6c2a-4d75-a1fa-013e967e217c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.733356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2ab98-6c2a-4d75-a1fa-013e967e217c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.733642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac2ab98-6c2a-4d75-a1fa-013e967e217c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.734296 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2ab98-6c2a-4d75-a1fa-013e967e217c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.735927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ac2ab98-6c2a-4d75-a1fa-013e967e217c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.748754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1309/2624] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:56.753483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607b98-8b5a-4b67-a4d2-d9ab2c9a2e07 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.764125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6607b98-8b5a-4b67-a4d2-d9ab2c9a2e07 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.769916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e461a2-d9a7-4e93-8d0d-5f2026fc0376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.771337 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e461a2-d9a7-4e93-8d0d-5f2026fc0376 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.771715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e461a2-d9a7-4e93-8d0d-5f2026fc0376 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.772059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e461a2-d9a7-4e93-8d0d-5f2026fc0376 admin admin] PATH_INFO: `/v3/projects/bb3348a22cef4b2c9699be2dd2a1666f/users/804fb6b5ef2b43da83be955d417b92aa/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.789213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e461a2-d9a7-4e93-8d0d-5f2026fc0376 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3348a22cef4b2c9699be2dd2a1666f, user_id=804fb6b5ef2b43da83be955d417b92aa, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.792051 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75e461a2-d9a7-4e93-8d0d-5f2026fc0376 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.805493 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1316/2625] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:56 2022] PUT /identity/v3/projects/bb3348a22cef4b2c9699be2dd2a1666f/users/804fb6b5ef2b43da83be955d417b92aa/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:56.809511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2ab98-6c2a-4d75-a1fa-013e967e217c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.822097 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac2ab98-6c2a-4d75-a1fa-013e967e217c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.899856 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695a8689-f0c1-4fcf-82ca-c67a7f9e99d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.900568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a8689-f0c1-4fcf-82ca-c67a7f9e99d9 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.900801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a8689-f0c1-4fcf-82ca-c67a7f9e99d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.901073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695a8689-f0c1-4fcf-82ca-c67a7f9e99d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.901717 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a8689-f0c1-4fcf-82ca-c67a7f9e99d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.903790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695a8689-f0c1-4fcf-82ca-c67a7f9e99d9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.914092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1310/2626] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:56 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:56.918526 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e461a2-d9a7-4e93-8d0d-5f2026fc0376 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:56.930375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e461a2-d9a7-4e93-8d0d-5f2026fc0376 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:56.935797 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a138f6-d133-477a-bfe7-449c2d69b918 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:56.936637 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a138f6-d133-477a-bfe7-449c2d69b918 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.936988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a138f6-d133-477a-bfe7-449c2d69b918 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.937353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a138f6-d133-477a-bfe7-449c2d69b918 admin admin] PATH_INFO: `/v3/projects/bb3348a22cef4b2c9699be2dd2a1666f/users/804fb6b5ef2b43da83be955d417b92aa/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.939410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a138f6-d133-477a-bfe7-449c2d69b918 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb3348a22cef4b2c9699be2dd2a1666f, user_id=804fb6b5ef2b43da83be955d417b92aa, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:56.942776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a138f6-d133-477a-bfe7-449c2d69b918 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:56.954071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1317/2627] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:56 2022] PUT /identity/v3/projects/bb3348a22cef4b2c9699be2dd2a1666f/users/804fb6b5ef2b43da83be955d417b92aa/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:56.965536 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2450-e3d0-47ea-826e-1ffbd20c519d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:56.965829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2450-e3d0-47ea-826e-1ffbd20c519d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:56.966110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fad2450-e3d0-47ea-826e-1ffbd20c519d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:56.996219 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-7fad2450-e3d0-47ea-826e-1ffbd20c519d None None] MFA Rules not processed for user `804fb6b5ef2b43da83be955d417b92aa`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:56.997458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7fad2450-e3d0-47ea-826e-1ffbd20c519d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:57.067571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1311/2628] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:56 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:57.080010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a138f6-d133-477a-bfe7-449c2d69b918 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:57.140390 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a138f6-d133-477a-bfe7-449c2d69b918 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:57.144382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0496eb-d1cc-4938-947d-5a2b933d639f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:57.144999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0496eb-d1cc-4938-947d-5a2b933d639f service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:57.145279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0496eb-d1cc-4938-947d-5a2b933d639f service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:57.145554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0496eb-d1cc-4938-947d-5a2b933d639f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:57.155812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0496eb-d1cc-4938-947d-5a2b933d639f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:57.157298 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c0496eb-d1cc-4938-947d-5a2b933d639f service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:57.167849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1318/2629] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:57 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:57.247936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad2450-e3d0-47ea-826e-1ffbd20c519d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:57.259910 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fad2450-e3d0-47ea-826e-1ffbd20c519d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:57.263944 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfae8a58-0987-4372-adde-3e8fc67c92f2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:57.264590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8a58-0987-4372-adde-3e8fc67c92f2 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:57.265045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8a58-0987-4372-adde-3e8fc67c92f2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:57.265318 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfae8a58-0987-4372-adde-3e8fc67c92f2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:57.284705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:57.350049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae8a58-0987-4372-adde-3e8fc67c92f2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:57.351990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfae8a58-0987-4372-adde-3e8fc67c92f2 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:57.365458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1312/2630] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:57.677456 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0496eb-d1cc-4938-947d-5a2b933d639f service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:57.752328 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0496eb-d1cc-4938-947d-5a2b933d639f service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:57.755966 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:57.756635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:57.756915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:57.757187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] PATH_INFO: `/v3/users/e1e36eca971042179d0f63849ea6d5f0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:57.758345 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1e36eca971042179d0f63849ea6d5f0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:57.760303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:57.811019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:57.818375 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1e36eca971042179d0f63849ea6d5f0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:57.820635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1e36eca971042179d0f63849ea6d5f0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:57.821640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1e36eca971042179d0f63849ea6d5f0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:57.833917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1e36eca971042179d0f63849ea6d5f0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:57.858864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1e36eca971042179d0f63849ea6d5f0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:57.885535 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1319/2631] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:57 2022] DELETE /identity/v3/users/e1e36eca971042179d0f63849ea6d5f0 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:57.890059 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ec42-b634-49b3-80dd-31d55c53fa9c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:57.890346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ec42-b634-49b3-80dd-31d55c53fa9c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:57.890627 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0257ec42-b634-49b3-80dd-31d55c53fa9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:57.929672 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-0257ec42-b634-49b3-80dd-31d55c53fa9c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:57.930961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0257ec42-b634-49b3-80dd-31d55c53fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:58.036523 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1313/2632] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:58.044117 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:58.047347 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:58.175265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719462fc-5ca4-4371-8255-dbd2f2a0f69d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:58.185104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837abf21-b528-45d5-aebc-651037d1d748 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:58.185727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837abf21-b528-45d5-aebc-651037d1d748 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:58.186005 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837abf21-b528-45d5-aebc-651037d1d748 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:58.186279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837abf21-b528-45d5-aebc-651037d1d748 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:58.191693 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257ec42-b634-49b3-80dd-31d55c53fa9c None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:58.193696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0257ec42-b634-49b3-80dd-31d55c53fa9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:58.200977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837abf21-b528-45d5-aebc-651037d1d748 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:58.202417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837abf21-b528-45d5-aebc-651037d1d748 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:58.216528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1320/2633] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:58.303892 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0257ec42-b634-49b3-80dd-31d55c53fa9c None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:58.307651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fb318-6f1c-4a86-87c5-cb0986de9a86 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:58.308328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fb318-6f1c-4a86-87c5-cb0986de9a86 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:58.308625 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fb318-6f1c-4a86-87c5-cb0986de9a86 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:58.308888 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46fb318-6f1c-4a86-87c5-cb0986de9a86 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:58.310665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e46fb318-6f1c-4a86-87c5-cb0986de9a86 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:58.401320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fb318-6f1c-4a86-87c5-cb0986de9a86 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:58.402854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e46fb318-6f1c-4a86-87c5-cb0986de9a86 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:58.412922 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1314/2634] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:58 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:58.544734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837abf21-b528-45d5-aebc-651037d1d748 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:58.547049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-837abf21-b528-45d5-aebc-651037d1d748 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:58.563909 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837abf21-b528-45d5-aebc-651037d1d748 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:58.570687 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:58.571463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:58.571855 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:58.572267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] PATH_INFO: `/v3/projects/b7f166d4b63043708859dcbe1b609efb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:58.573583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7f166d4b63043708859dcbe1b609efb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:58.575587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:58.638014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7f166d4b63043708859dcbe1b609efb', 'request_id': 'req-8c4f527a-ba9f-4172-bd50-b551d3587b69'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:58.644758 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7f166d4b63043708859dcbe1b609efb', 'request_id': 'req-8c4f527a-ba9f-4172-bd50-b551d3587b69'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:58.652138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7f166d4b63043708859dcbe1b609efb', 'request_id': 'req-8c4f527a-ba9f-4172-bd50-b551d3587b69'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:58.683505 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] The token cache is being invalidate because project b7f166d4b63043708859dcbe1b609efb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:58.684299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:58.684760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:58.686283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1321/2635] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:58 2022] DELETE /identity/v3/projects/b7f166d4b63043708859dcbe1b609efb => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:58.690588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fb318-6f1c-4a86-87c5-cb0986de9a86 service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:58.705307 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46fb318-6f1c-4a86-87c5-cb0986de9a86 service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:58.716434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:58.775642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:58.776340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:58.776604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:58.776880 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] PATH_INFO: `/v3/users/804fb6b5ef2b43da83be955d417b92aa` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:58.778079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] RBAC: Authorizing `identity:delete_user(user_id=804fb6b5ef2b43da83be955d417b92aa)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:58.779999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:58.848098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '804fb6b5ef2b43da83be955d417b92aa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:58.849332 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '804fb6b5ef2b43da83be955d417b92aa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:58.867021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '804fb6b5ef2b43da83be955d417b92aa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:58.867781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '804fb6b5ef2b43da83be955d417b92aa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:58.876340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '804fb6b5ef2b43da83be955d417b92aa'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:58.899619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1315/2636] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:32:58 2022] DELETE /identity/v3/users/804fb6b5ef2b43da83be955d417b92aa => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:32:59.122271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:59.123801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:59.213019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:59.232424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4f527a-ba9f-4172-bd50-b551d3587b69 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:59.290965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed2ecf5-53ee-432b-92c8-f4358c7211b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:59.291553 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2ecf5-53ee-432b-92c8-f4358c7211b3 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:59.291841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2ecf5-53ee-432b-92c8-f4358c7211b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:59.292218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed2ecf5-53ee-432b-92c8-f4358c7211b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:59.294158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fed2ecf5-53ee-432b-92c8-f4358c7211b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:59.303197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:59.305668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:59.379525 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2ecf5-53ee-432b-92c8-f4358c7211b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:59.380764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed2ecf5-53ee-432b-92c8-f4358c7211b3 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:59.391509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1322/2637] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:32:59 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 270 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:32:59.410344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18d443c-3128-43f1-bbb3-b92c3582833f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:59.417364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:59.418017 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:59.418298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:59.418578 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] PATH_INFO: `/v3/projects/bb3348a22cef4b2c9699be2dd2a1666f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:59.419836 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb3348a22cef4b2c9699be2dd2a1666f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:59.422421 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:59.471489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:59.494552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb3348a22cef4b2c9699be2dd2a1666f', 'request_id': 'req-201bdc29-d5da-48fe-9712-c84c63026606'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:59.502236 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb3348a22cef4b2c9699be2dd2a1666f', 'request_id': 'req-201bdc29-d5da-48fe-9712-c84c63026606'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:59.517302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb3348a22cef4b2c9699be2dd2a1666f', 'request_id': 'req-201bdc29-d5da-48fe-9712-c84c63026606'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:59.530777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] The token cache is being invalidate because project bb3348a22cef4b2c9699be2dd2a1666f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:32:59.530972 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:59.531746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-201bdc29-d5da-48fe-9712-c84c63026606 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:32:59.533400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1316/2638] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:32:59 2022] DELETE /identity/v3/projects/bb3348a22cef4b2c9699be2dd2a1666f => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:32:59.540393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783b3f-feec-40a2-b3ac-e8e4c493e280 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:59.541580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783b3f-feec-40a2-b3ac-e8e4c493e280 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:59.541973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b783b3f-feec-40a2-b3ac-e8e4c493e280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:59.568410 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4b783b3f-feec-40a2-b3ac-e8e4c493e280 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:59.569861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4b783b3f-feec-40a2-b3ac-e8e4c493e280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:59.635370 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1323/2639] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:59.643642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e1049-a908-4a81-af31-fadaa881c104 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:59.644006 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e1049-a908-4a81-af31-fadaa881c104 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:59.644329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42e1049-a908-4a81-af31-fadaa881c104 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:59.666430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-f42e1049-a908-4a81-af31-fadaa881c104 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:32:59.667675 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-f42e1049-a908-4a81-af31-fadaa881c104 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:32:59.675977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1317/2640] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:32:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:32:59.680310 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b783b3f-feec-40a2-b3ac-e8e4c493e280 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:59.690041 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b783b3f-feec-40a2-b3ac-e8e4c493e280 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:59.695777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603a721-d994-4cfb-963a-c47ef05dc814 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:59.696438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603a721-d994-4cfb-963a-c47ef05dc814 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:59.696720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603a721-d994-4cfb-963a-c47ef05dc814 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:59.696998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d603a721-d994-4cfb-963a-c47ef05dc814 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:59.697651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603a721-d994-4cfb-963a-c47ef05dc814 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:32:59.697960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603a721-d994-4cfb-963a-c47ef05dc814 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:59.699546 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d603a721-d994-4cfb-963a-c47ef05dc814 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:59.713171 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1324/2641] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:32:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:32:59.718094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e1049-a908-4a81-af31-fadaa881c104 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:59.728651 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42e1049-a908-4a81-af31-fadaa881c104 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:59.733936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e0271-70e7-4157-a8cc-8b1b6dee2db9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:59.734722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e0271-70e7-4157-a8cc-8b1b6dee2db9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:59.735082 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e0271-70e7-4157-a8cc-8b1b6dee2db9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:59.735426 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46e0271-70e7-4157-a8cc-8b1b6dee2db9 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:59.736470 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e0271-70e7-4157-a8cc-8b1b6dee2db9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:59.738279 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46e0271-70e7-4157-a8cc-8b1b6dee2db9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:59.770661 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1318/2642] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:32:59 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:32:59.774722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603a721-d994-4cfb-963a-c47ef05dc814 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:59.784737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d603a721-d994-4cfb-963a-c47ef05dc814 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:59.817773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:32:59.843717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77563f7c-227d-472a-86df-a19806797d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:59.844366 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77563f7c-227d-472a-86df-a19806797d37 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:59.844652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77563f7c-227d-472a-86df-a19806797d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:59.844930 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77563f7c-227d-472a-86df-a19806797d37 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:59.845563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77563f7c-227d-472a-86df-a19806797d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:59.847541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77563f7c-227d-472a-86df-a19806797d37 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:59.868997 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1325/2643] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:32:59 2022] POST /identity/v3/users => generated 292 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:32:59.873186 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e0271-70e7-4157-a8cc-8b1b6dee2db9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:59.883852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46e0271-70e7-4157-a8cc-8b1b6dee2db9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:59.888495 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015748ae-fd71-4c99-8f39-250fd7dbc23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:59.889093 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015748ae-fd71-4c99-8f39-250fd7dbc23a admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:59.889363 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015748ae-fd71-4c99-8f39-250fd7dbc23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:59.889640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015748ae-fd71-4c99-8f39-250fd7dbc23a admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:59.890277 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015748ae-fd71-4c99-8f39-250fd7dbc23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:59.891876 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015748ae-fd71-4c99-8f39-250fd7dbc23a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:59.902347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1319/2644] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:59.906412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77563f7c-227d-472a-86df-a19806797d37 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:59.916670 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77563f7c-227d-472a-86df-a19806797d37 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:59.921434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269cff75-73c0-4685-94b8-2e67248fe3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:59.922028 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cff75-73c0-4685-94b8-2e67248fe3d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:59.922311 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cff75-73c0-4685-94b8-2e67248fe3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:59.922587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269cff75-73c0-4685-94b8-2e67248fe3d8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:59.923251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cff75-73c0-4685-94b8-2e67248fe3d8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:59.924873 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269cff75-73c0-4685-94b8-2e67248fe3d8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:59.936437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1326/2645] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:32:59.940780 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015748ae-fd71-4c99-8f39-250fd7dbc23a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:32:59.952592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015748ae-fd71-4c99-8f39-250fd7dbc23a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:32:59.958610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9bda-f3ec-4b45-8488-3c543359da93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:32:59.959251 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9bda-f3ec-4b45-8488-3c543359da93 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:32:59.959616 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9bda-f3ec-4b45-8488-3c543359da93 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:32:59.959893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029a9bda-f3ec-4b45-8488-3c543359da93 admin admin] PATH_INFO: `/v3/projects/10e5775b74fb4b5fb3f17dd7bdcda7a6/users/e70c12e909704d41a2885b06eda7c64f/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:32:59.977556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a9bda-f3ec-4b45-8488-3c543359da93 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10e5775b74fb4b5fb3f17dd7bdcda7a6, user_id=e70c12e909704d41a2885b06eda7c64f, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:32:59.980316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029a9bda-f3ec-4b45-8488-3c543359da93 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:32:59.992440 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1320/2646] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:32:59 2022] PUT /identity/v3/projects/10e5775b74fb4b5fb3f17dd7bdcda7a6/users/e70c12e909704d41a2885b06eda7c64f/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:00.002901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869e06-e459-44ff-a544-ef07cc778aa2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:00.003186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869e06-e459-44ff-a544-ef07cc778aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:00.003458 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9869e06-e459-44ff-a544-ef07cc778aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:00.031222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c9869e06-e459-44ff-a544-ef07cc778aa2 None None] MFA Rules not processed for user `e70c12e909704d41a2885b06eda7c64f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:00.032587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c9869e06-e459-44ff-a544-ef07cc778aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:00.097698 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1327/2647] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:00.102263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9bda-f3ec-4b45-8488-3c543359da93 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:00.164733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029a9bda-f3ec-4b45-8488-3c543359da93 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:00.169453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0da05d-4152-4223-9d2a-b03e1c5f2ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:00.170054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da05d-4152-4223-9d2a-b03e1c5f2ef4 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:00.170335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da05d-4152-4223-9d2a-b03e1c5f2ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:00.170610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e0da05d-4152-4223-9d2a-b03e1c5f2ef4 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:00.171246 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0da05d-4152-4223-9d2a-b03e1c5f2ef4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:00.173189 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e0da05d-4152-4223-9d2a-b03e1c5f2ef4 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:00.199462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1321/2648] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:00 2022] POST /identity/v3/projects => generated 383 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:00.203831 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9869e06-e459-44ff-a544-ef07cc778aa2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:00.214528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9869e06-e459-44ff-a544-ef07cc778aa2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:00.270850 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f88e1-39c2-40a4-a801-594059451723 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:00.271460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f88e1-39c2-40a4-a801-594059451723 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:00.271744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f88e1-39c2-40a4-a801-594059451723 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:00.272022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12f88e1-39c2-40a4-a801-594059451723 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:00.272708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f88e1-39c2-40a4-a801-594059451723 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:00.274596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12f88e1-39c2-40a4-a801-594059451723 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:00.297445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1328/2649] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:00 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:33:00.302001 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0da05d-4152-4223-9d2a-b03e1c5f2ef4 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:00.312171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e0da05d-4152-4223-9d2a-b03e1c5f2ef4 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:00.316760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910c3a-5c23-4952-a763-6f12db270698 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:00.317390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910c3a-5c23-4952-a763-6f12db270698 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:00.317663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910c3a-5c23-4952-a763-6f12db270698 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:00.317929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee910c3a-5c23-4952-a763-6f12db270698 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:00.318560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee910c3a-5c23-4952-a763-6f12db270698 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:00.320237 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee910c3a-5c23-4952-a763-6f12db270698 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:00.332242 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1322/2650] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:00.336424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f88e1-39c2-40a4-a801-594059451723 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:00.346641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12f88e1-39c2-40a4-a801-594059451723 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:00.352333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913576f-7150-49e6-a187-4863f853070e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:00.352992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913576f-7150-49e6-a187-4863f853070e admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:00.353269 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913576f-7150-49e6-a187-4863f853070e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:00.353538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c913576f-7150-49e6-a187-4863f853070e admin admin] PATH_INFO: `/v3/projects/edd3392281cb4e7aaefe785f0a6d3b87/users/953e91ba53d342b5b040ba428e502162/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:00.369004 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913576f-7150-49e6-a187-4863f853070e admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd3392281cb4e7aaefe785f0a6d3b87, user_id=953e91ba53d342b5b040ba428e502162, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:00.371708 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c913576f-7150-49e6-a187-4863f853070e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:00.384377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1329/2651] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:00 2022] PUT /identity/v3/projects/edd3392281cb4e7aaefe785f0a6d3b87/users/953e91ba53d342b5b040ba428e502162/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:00.388326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910c3a-5c23-4952-a763-6f12db270698 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:00.398970 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee910c3a-5c23-4952-a763-6f12db270698 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:00.428866 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:00.459043 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887b731c-9dba-4d9e-9492-8598f58e09a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:00.459679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b731c-9dba-4d9e-9492-8598f58e09a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:00.459968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b731c-9dba-4d9e-9492-8598f58e09a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:00.460273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887b731c-9dba-4d9e-9492-8598f58e09a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:00.460917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b731c-9dba-4d9e-9492-8598f58e09a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:00.462517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887b731c-9dba-4d9e-9492-8598f58e09a1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:00.472583 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1323/2652] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:00 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:00.477238 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913576f-7150-49e6-a187-4863f853070e admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:00.487944 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c913576f-7150-49e6-a187-4863f853070e admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:00.492600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc087f6-4941-4b5b-ba07-97356b906797 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:00.493245 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc087f6-4941-4b5b-ba07-97356b906797 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:00.493521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc087f6-4941-4b5b-ba07-97356b906797 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:00.493791 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc087f6-4941-4b5b-ba07-97356b906797 admin admin] PATH_INFO: `/v3/projects/edd3392281cb4e7aaefe785f0a6d3b87/users/953e91ba53d342b5b040ba428e502162/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:00.495661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc087f6-4941-4b5b-ba07-97356b906797 admin admin] RBAC: Authorizing `identity:create_grant(project_id=edd3392281cb4e7aaefe785f0a6d3b87, user_id=953e91ba53d342b5b040ba428e502162, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:00.498303 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc087f6-4941-4b5b-ba07-97356b906797 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:00.501427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:00.510205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1330/2653] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:00 2022] PUT /identity/v3/projects/edd3392281cb4e7aaefe785f0a6d3b87/users/953e91ba53d342b5b040ba428e502162/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:33:00.521685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6035d46-17f1-4f03-9be0-8ca033bf81fd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:00.522287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6035d46-17f1-4f03-9be0-8ca033bf81fd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:00.522287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6035d46-17f1-4f03-9be0-8ca033bf81fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:00.552993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b6035d46-17f1-4f03-9be0-8ca033bf81fd None None] MFA Rules not processed for user `953e91ba53d342b5b040ba428e502162`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:00.554203 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b6035d46-17f1-4f03-9be0-8ca033bf81fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:00.624183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1324/2654] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:00 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:00.635560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc087f6-4941-4b5b-ba07-97356b906797 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:00.637302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-cfc087f6-4941-4b5b-ba07-97356b906797 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:00.697917 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc087f6-4941-4b5b-ba07-97356b906797 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:00.701616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829e187-559e-4ba7-b36e-50b65e744118 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:00.702219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e187-559e-4ba7-b36e-50b65e744118 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:00.702500 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e187-559e-4ba7-b36e-50b65e744118 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:00.702776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f829e187-559e-4ba7-b36e-50b65e744118 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:00.774870 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829e187-559e-4ba7-b36e-50b65e744118 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:00.776543 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f829e187-559e-4ba7-b36e-50b65e744118 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:00.788838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1331/2655] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 154 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:02.121166 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6035d46-17f1-4f03-9be0-8ca033bf81fd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:02.122574 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b6035d46-17f1-4f03-9be0-8ca033bf81fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:02.190828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6035d46-17f1-4f03-9be0-8ca033bf81fd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:02.195003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a45a2d-925d-4fbe-9f6a-cf3e218cff5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:02.195619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45a2d-925d-4fbe-9f6a-cf3e218cff5b service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:02.195895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45a2d-925d-4fbe-9f6a-cf3e218cff5b service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:02.196348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a45a2d-925d-4fbe-9f6a-cf3e218cff5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:02.198410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a3a45a2d-925d-4fbe-9f6a-cf3e218cff5b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:02.284827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a45a2d-925d-4fbe-9f6a-cf3e218cff5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:02.287062 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a45a2d-925d-4fbe-9f6a-cf3e218cff5b service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:02.297819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1325/2656] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:03.322635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829e187-559e-4ba7-b36e-50b65e744118 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:03.324176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f829e187-559e-4ba7-b36e-50b65e744118 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:03.341730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f829e187-559e-4ba7-b36e-50b65e744118 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:03.346484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:03.347200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:03.347558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:03.347906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] PATH_INFO: `/v3/users/d63057bd107a4e659f13e25e9376ebf0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:03.349763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d63057bd107a4e659f13e25e9376ebf0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:03.351796 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:03.403795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd63057bd107a4e659f13e25e9376ebf0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:03.404426 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd63057bd107a4e659f13e25e9376ebf0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:03.405043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd63057bd107a4e659f13e25e9376ebf0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:03.412570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd63057bd107a4e659f13e25e9376ebf0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:03.425809 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd63057bd107a4e659f13e25e9376ebf0'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:03.440594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1332/2657] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:03 2022] DELETE /identity/v3/users/d63057bd107a4e659f13e25e9376ebf0 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:03.445575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595956-719f-46c7-b75e-9ef7e227f15f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:03.446109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595956-719f-46c7-b75e-9ef7e227f15f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:03.446487 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9595956-719f-46c7-b75e-9ef7e227f15f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:03.455289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:03.468075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e9595956-719f-46c7-b75e-9ef7e227f15f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:03.469336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e9595956-719f-46c7-b75e-9ef7e227f15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:03.534491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1326/2658] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:03.550017 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:03.552071 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:03.583262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:03.629272 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b75777-08cc-489e-848c-5d267f751e3d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:03.634327 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a535-8af0-4b0e-994a-f601b303210b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:03.635023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a535-8af0-4b0e-994a-f601b303210b service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:03.635308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a535-8af0-4b0e-994a-f601b303210b service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:03.635584 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb7a535-8af0-4b0e-994a-f601b303210b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:03.645462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7a535-8af0-4b0e-994a-f601b303210b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:03.646916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eb7a535-8af0-4b0e-994a-f601b303210b service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:03.657890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1333/2659] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:03.969825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9595956-719f-46c7-b75e-9ef7e227f15f None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:03.971420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e9595956-719f-46c7-b75e-9ef7e227f15f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:04.006931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9595956-719f-46c7-b75e-9ef7e227f15f None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:04.011898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:04.012797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:04.013209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:04.013500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] PATH_INFO: `/v3/projects/fc2715fcb30c494b83259f8e32dd6b8a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:04.014778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc2715fcb30c494b83259f8e32dd6b8a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:04.017427 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:04.106121 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc2715fcb30c494b83259f8e32dd6b8a', 'request_id': 'req-770e0c01-83ea-4843-8ae1-4285af47cfc5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.113456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc2715fcb30c494b83259f8e32dd6b8a', 'request_id': 'req-770e0c01-83ea-4843-8ae1-4285af47cfc5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.125753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc2715fcb30c494b83259f8e32dd6b8a', 'request_id': 'req-770e0c01-83ea-4843-8ae1-4285af47cfc5'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.142138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] The token cache is being invalidate because project fc2715fcb30c494b83259f8e32dd6b8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:04.142449 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.143431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.149817 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a535-8af0-4b0e-994a-f601b303210b service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:04.150327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1327/2660] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:03 2022] DELETE /identity/v3/projects/fc2715fcb30c494b83259f8e32dd6b8a => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:04.160260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb7a535-8af0-4b0e-994a-f601b303210b service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:04.224418 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:04.225086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:04.225688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:04.225688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] PATH_INFO: `/v3/users/a6c625f0e28b4a4a89f6709d25c944e6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:04.226998 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a6c625f0e28b4a4a89f6709d25c944e6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:04.228834 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:04.287484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a6c625f0e28b4a4a89f6709d25c944e6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.288587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a6c625f0e28b4a4a89f6709d25c944e6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.289299 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a6c625f0e28b4a4a89f6709d25c944e6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.299087 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a6c625f0e28b4a4a89f6709d25c944e6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.316800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a6c625f0e28b4a4a89f6709d25c944e6'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.333677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1334/2661] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:04 2022] DELETE /identity/v3/users/a6c625f0e28b4a4a89f6709d25c944e6 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:04.632294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:04.634405 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:04.650673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770e0c01-83ea-4843-8ae1-4285af47cfc5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:04.711499 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:04.712042 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:04.712349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:04.712624 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] PATH_INFO: `/v3/projects/af85e6ed6f61436880491a88c4da4d4a` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:04.713723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] RBAC: Authorizing `identity:delete_project(project_id=af85e6ed6f61436880491a88c4da4d4a)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:04.715658 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:04.751328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:04.767874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af85e6ed6f61436880491a88c4da4d4a', 'request_id': 'req-15cd08d3-608b-43a5-825d-9bca5d30decf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.773398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af85e6ed6f61436880491a88c4da4d4a', 'request_id': 'req-15cd08d3-608b-43a5-825d-9bca5d30decf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.780700 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af85e6ed6f61436880491a88c4da4d4a', 'request_id': 'req-15cd08d3-608b-43a5-825d-9bca5d30decf'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.792407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] The token cache is being invalidate because project af85e6ed6f61436880491a88c4da4d4a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:04.792705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.793402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.794891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1328/2662] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:04 2022] DELETE /identity/v3/projects/af85e6ed6f61436880491a88c4da4d4a => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:04.798968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:04.800496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:04.814334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb51ae7c-ffc6-43d8-beb0-415ca3d1b927 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:04.870969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:04.890612 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:04.891423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:04.891801 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:04.892228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] PATH_INFO: `/v3/users/48f866af38164a74a6c1b938921ef071` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:04.893538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48f866af38164a74a6c1b938921ef071)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:04.896134 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:04.967542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48f866af38164a74a6c1b938921ef071'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.968113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48f866af38164a74a6c1b938921ef071'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.968741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48f866af38164a74a6c1b938921ef071'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.976243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48f866af38164a74a6c1b938921ef071'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:04.988365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48f866af38164a74a6c1b938921ef071'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:05.003090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1335/2663] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:04 2022] DELETE /identity/v3/users/48f866af38164a74a6c1b938921ef071 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:05.211055 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:05.212628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:05.318332 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:05.320065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:05.321023 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cd08d3-608b-43a5-825d-9bca5d30decf admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:05.436086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2790e8df-c3ac-4b02-bfd3-d97295d22159 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:05.437392 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87455b0f-06f3-4633-89ed-fcd68b9a39d8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:05.438800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455b0f-06f3-4633-89ed-fcd68b9a39d8 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:05.439089 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455b0f-06f3-4633-89ed-fcd68b9a39d8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:05.439368 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87455b0f-06f3-4633-89ed-fcd68b9a39d8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:05.442916 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-87455b0f-06f3-4633-89ed-fcd68b9a39d8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:05.443288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:05.444186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:05.444645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:05.445141 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] PATH_INFO: `/v3/projects/98bec6e9baf94991b8e8c8ceae52f73c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:05.446545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98bec6e9baf94991b8e8c8ceae52f73c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:05.448700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:05.517536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98bec6e9baf94991b8e8c8ceae52f73c', 'request_id': 'req-f9e564d8-5410-4c87-9f62-d66018a1db61'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:05.525054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98bec6e9baf94991b8e8c8ceae52f73c', 'request_id': 'req-f9e564d8-5410-4c87-9f62-d66018a1db61'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:05.541501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87455b0f-06f3-4633-89ed-fcd68b9a39d8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:05.544400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87455b0f-06f3-4633-89ed-fcd68b9a39d8 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:05.553924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98bec6e9baf94991b8e8c8ceae52f73c', 'request_id': 'req-f9e564d8-5410-4c87-9f62-d66018a1db61'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:05.559151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1329/2664] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:05 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:05.560486 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=82,keystone:DELETE=16,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:05.589430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] The token cache is being invalidate because project 98bec6e9baf94991b8e8c8ceae52f73c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:05.589737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:05.592296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f9e564d8-5410-4c87-9f62-d66018a1db61 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:05.596217 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1336/2665] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:05 2022] DELETE /identity/v3/projects/98bec6e9baf94991b8e8c8ceae52f73c => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:05.601656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e038-d8d7-44b3-8a6c-2cc9511b1150 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:05.602156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e038-d8d7-44b3-8a6c-2cc9511b1150 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:05.602550 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e62e038-d8d7-44b3-8a6c-2cc9511b1150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:05.637690 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3e62e038-d8d7-44b3-8a6c-2cc9511b1150 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:05.639081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3e62e038-d8d7-44b3-8a6c-2cc9511b1150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:05.698205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:05.765306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1330/2666] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:05.772938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677d6d-4a21-416e-8e76-c59970350ee3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:05.773527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677d6d-4a21-416e-8e76-c59970350ee3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:05.774138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4677d6d-4a21-416e-8e76-c59970350ee3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:05.802881 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a4677d6d-4a21-416e-8e76-c59970350ee3 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:05.804771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a4677d6d-4a21-416e-8e76-c59970350ee3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:05.815697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1337/2667] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:05.820148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e038-d8d7-44b3-8a6c-2cc9511b1150 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:05.831305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e62e038-d8d7-44b3-8a6c-2cc9511b1150 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:05.837125 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b65242-85e6-4148-8b74-a2e80da78e45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:05.838110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b65242-85e6-4148-8b74-a2e80da78e45 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:05.838646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b65242-85e6-4148-8b74-a2e80da78e45 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:05.839119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b65242-85e6-4148-8b74-a2e80da78e45 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:05.840069 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b65242-85e6-4148-8b74-a2e80da78e45 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:33:05.840697 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b65242-85e6-4148-8b74-a2e80da78e45 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:05.845727 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b65242-85e6-4148-8b74-a2e80da78e45 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:05.870744 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1331/2668] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:33:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:33:05.874803 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4677d6d-4a21-416e-8e76-c59970350ee3 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:05.885896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4677d6d-4a21-416e-8e76-c59970350ee3 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:05.891560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589909a-0e11-4566-bca5-e6b3a460153d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:05.892196 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589909a-0e11-4566-bca5-e6b3a460153d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:05.892540 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589909a-0e11-4566-bca5-e6b3a460153d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:05.892822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d589909a-0e11-4566-bca5-e6b3a460153d admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:05.893475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589909a-0e11-4566-bca5-e6b3a460153d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:05.895935 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d589909a-0e11-4566-bca5-e6b3a460153d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:05.938976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1338/2669] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:05 2022] POST /identity/v3/projects => generated 383 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:33:05.945743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b65242-85e6-4148-8b74-a2e80da78e45 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:05.964462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b65242-85e6-4148-8b74-a2e80da78e45 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.085484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71aa5-3687-4e51-beaf-55ce3eb47005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.086642 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71aa5-3687-4e51-beaf-55ce3eb47005 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.087027 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71aa5-3687-4e51-beaf-55ce3eb47005 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.087704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b71aa5-3687-4e51-beaf-55ce3eb47005 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.088512 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b71aa5-3687-4e51-beaf-55ce3eb47005 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.093330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b71aa5-3687-4e51-beaf-55ce3eb47005 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.124635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1332/2670] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:05 2022] POST /identity/v3/users => generated 292 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:06.128981 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589909a-0e11-4566-bca5-e6b3a460153d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.140962 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d589909a-0e11-4566-bca5-e6b3a460153d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.146900 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24063c10-d462-478c-8212-a7e4810fbac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.147647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063c10-d462-478c-8212-a7e4810fbac4 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.148034 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063c10-d462-478c-8212-a7e4810fbac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.148441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24063c10-d462-478c-8212-a7e4810fbac4 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.149320 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24063c10-d462-478c-8212-a7e4810fbac4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.151785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24063c10-d462-478c-8212-a7e4810fbac4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.166457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1339/2671] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:33:06.167816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71aa5-3687-4e51-beaf-55ce3eb47005 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.178209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b71aa5-3687-4e51-beaf-55ce3eb47005 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.184222 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda60b2-ab13-48ac-9267-5bd6662ec5d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.184822 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda60b2-ab13-48ac-9267-5bd6662ec5d0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.185101 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda60b2-ab13-48ac-9267-5bd6662ec5d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.185371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeda60b2-ab13-48ac-9267-5bd6662ec5d0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.186028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda60b2-ab13-48ac-9267-5bd6662ec5d0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.187863 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeda60b2-ab13-48ac-9267-5bd6662ec5d0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.205132 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1333/2672] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:06.210115 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24063c10-d462-478c-8212-a7e4810fbac4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.212025 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-24063c10-d462-478c-8212-a7e4810fbac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:06.212325 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda60b2-ab13-48ac-9267-5bd6662ec5d0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.224013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeda60b2-ab13-48ac-9267-5bd6662ec5d0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.225584 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24063c10-d462-478c-8212-a7e4810fbac4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.229003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29c5281-a365-43c2-9d7d-9ce8703be68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.229689 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5281-a365-43c2-9d7d-9ce8703be68c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.229972 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5281-a365-43c2-9d7d-9ce8703be68c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.230247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29c5281-a365-43c2-9d7d-9ce8703be68c admin admin] PATH_INFO: `/v3/projects/e748432558114816868e4a240b72448e/users/427d44dee1e3498bbe9a2c5dfb339c17/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.230742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.231459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.231816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.232244 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] PATH_INFO: `/v3/users/40f99377b0134e59802907c55b1c6949` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.233457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40f99377b0134e59802907c55b1c6949)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.235412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.245821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c5281-a365-43c2-9d7d-9ce8703be68c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e748432558114816868e4a240b72448e, user_id=427d44dee1e3498bbe9a2c5dfb339c17, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.248504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29c5281-a365-43c2-9d7d-9ce8703be68c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.266554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1334/2673] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:06 2022] PUT /identity/v3/projects/e748432558114816868e4a240b72448e/users/427d44dee1e3498bbe9a2c5dfb339c17/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:33:06.285383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40f99377b0134e59802907c55b1c6949'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:06.287507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40f99377b0134e59802907c55b1c6949'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:06.288422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40f99377b0134e59802907c55b1c6949'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:06.298211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40f99377b0134e59802907c55b1c6949'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:06.313282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40f99377b0134e59802907c55b1c6949'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:06.330462 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1340/2674] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:06 2022] DELETE /identity/v3/users/40f99377b0134e59802907c55b1c6949 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:06.335366 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5008ad-e279-4415-9c83-ed04fa2d64d7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.335654 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5008ad-e279-4415-9c83-ed04fa2d64d7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.335929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5008ad-e279-4415-9c83-ed04fa2d64d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.363813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-da5008ad-e279-4415-9c83-ed04fa2d64d7 None None] MFA Rules not processed for user `427d44dee1e3498bbe9a2c5dfb339c17`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:06.365053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-da5008ad-e279-4415-9c83-ed04fa2d64d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:06.422063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:06.432760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1335/2675] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:06 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:06.437232 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.439101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:06.511035 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5008ad-e279-4415-9c83-ed04fa2d64d7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.512615 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-da5008ad-e279-4415-9c83-ed04fa2d64d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:06.517923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b879ad-09c9-405d-9441-8de9d038bd92 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.525691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd58fdd-974f-4cbf-8731-a75f51a96edc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.526360 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd58fdd-974f-4cbf-8731-a75f51a96edc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.526644 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd58fdd-974f-4cbf-8731-a75f51a96edc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.527060 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd58fdd-974f-4cbf-8731-a75f51a96edc admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.527645 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd58fdd-974f-4cbf-8731-a75f51a96edc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.529564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd58fdd-974f-4cbf-8731-a75f51a96edc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.531254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5008ad-e279-4415-9c83-ed04fa2d64d7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.537299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.537998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.538302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.538525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] PATH_INFO: `/v3/projects/46d40f3eea3b4ffb8b8720ffd6348975` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.539751 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] RBAC: Authorizing `identity:delete_project(project_id=46d40f3eea3b4ffb8b8720ffd6348975)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.541785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.558380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1341/2676] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:06 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:06.562228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd58fdd-974f-4cbf-8731-a75f51a96edc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.574411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=11,keystone:SELECT=86,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:06.592967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46d40f3eea3b4ffb8b8720ffd6348975', 'request_id': 'req-66e968da-ab79-43dc-ad15-d1f2ab65f377'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:06.599151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46d40f3eea3b4ffb8b8720ffd6348975', 'request_id': 'req-66e968da-ab79-43dc-ad15-d1f2ab65f377'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:06.607302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46d40f3eea3b4ffb8b8720ffd6348975', 'request_id': 'req-66e968da-ab79-43dc-ad15-d1f2ab65f377'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:06.619274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] The token cache is being invalidate because project 46d40f3eea3b4ffb8b8720ffd6348975 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:06.619572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:06.620280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-66e968da-ab79-43dc-ad15-d1f2ab65f377 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:06.621808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1336/2677] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:06 2022] DELETE /identity/v3/projects/46d40f3eea3b4ffb8b8720ffd6348975 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:06.626678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a68fb-f304-4302-b494-4c0cb44dd7f0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.626966 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a68fb-f304-4302-b494-4c0cb44dd7f0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.627245 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896a68fb-f304-4302-b494-4c0cb44dd7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.630574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd58fdd-974f-4cbf-8731-a75f51a96edc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.648079 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-896a68fb-f304-4302-b494-4c0cb44dd7f0 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:06.649342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-896a68fb-f304-4302-b494-4c0cb44dd7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:06.690853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0218044-0e35-4baa-8024-0db22b6511cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.691471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0218044-0e35-4baa-8024-0db22b6511cc admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.691782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0218044-0e35-4baa-8024-0db22b6511cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.692057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0218044-0e35-4baa-8024-0db22b6511cc admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.692725 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0218044-0e35-4baa-8024-0db22b6511cc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.694634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0218044-0e35-4baa-8024-0db22b6511cc admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.713032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1337/2678] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:06.720482 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1342/2679] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:06 2022] POST /identity/v3/users => generated 293 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:33:06.721488 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72027645-cc69-421d-850e-3d53d1a1fdf2 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.721784 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72027645-cc69-421d-850e-3d53d1a1fdf2 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.722068 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72027645-cc69-421d-850e-3d53d1a1fdf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.724937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0218044-0e35-4baa-8024-0db22b6511cc admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.726719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c0218044-0e35-4baa-8024-0db22b6511cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:06.738908 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0218044-0e35-4baa-8024-0db22b6511cc admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.743628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b1e29-0827-498b-8bfc-62a6a01a820f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.744409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b1e29-0827-498b-8bfc-62a6a01a820f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.744530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-72027645-cc69-421d-850e-3d53d1a1fdf2 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:06.744689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b1e29-0827-498b-8bfc-62a6a01a820f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.744963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53b1e29-0827-498b-8bfc-62a6a01a820f admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.745634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b1e29-0827-498b-8bfc-62a6a01a820f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.745743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-72027645-cc69-421d-850e-3d53d1a1fdf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:06.747233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53b1e29-0827-498b-8bfc-62a6a01a820f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.753696 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1338/2680] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:06.760820 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1343/2681] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:33:06.760989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72027645-cc69-421d-850e-3d53d1a1fdf2 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.762097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b1e29-0827-498b-8bfc-62a6a01a820f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.768015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72027645-cc69-421d-850e-3d53d1a1fdf2 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.772583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53b1e29-0827-498b-8bfc-62a6a01a820f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.773466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0869-476b-4a57-8c5c-180f73a58d54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.774102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0869-476b-4a57-8c5c-180f73a58d54 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.774404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0869-476b-4a57-8c5c-180f73a58d54 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.774680 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e52f0869-476b-4a57-8c5c-180f73a58d54 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.775386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f0869-476b-4a57-8c5c-180f73a58d54 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:33:06.775695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f0869-476b-4a57-8c5c-180f73a58d54 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.777330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67ae59-f52a-42b4-9989-b2fa52c80940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.777473 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e52f0869-476b-4a57-8c5c-180f73a58d54 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.777913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67ae59-f52a-42b4-9989-b2fa52c80940 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.778194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67ae59-f52a-42b4-9989-b2fa52c80940 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.778467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b67ae59-f52a-42b4-9989-b2fa52c80940 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.779124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67ae59-f52a-42b4-9989-b2fa52c80940 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.780721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b67ae59-f52a-42b4-9989-b2fa52c80940 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.789836 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1339/2682] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:33:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:33:06.794280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0869-476b-4a57-8c5c-180f73a58d54 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.798617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1344/2683] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:33:06.799945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67ae59-f52a-42b4-9989-b2fa52c80940 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.805018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e52f0869-476b-4a57-8c5c-180f73a58d54 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.809956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d1e6e-de93-4c5c-b706-efe449d7715b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.810586 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d1e6e-de93-4c5c-b706-efe449d7715b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.810730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b67ae59-f52a-42b4-9989-b2fa52c80940 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:06.810844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d1e6e-de93-4c5c-b706-efe449d7715b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.811118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721d1e6e-de93-4c5c-b706-efe449d7715b admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.811747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d1e6e-de93-4c5c-b706-efe449d7715b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.813731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-721d1e6e-de93-4c5c-b706-efe449d7715b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.815583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b023535-420b-4b83-8d7b-5fee3c0f5d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:06.816260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023535-420b-4b83-8d7b-5fee3c0f5d32 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.816566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023535-420b-4b83-8d7b-5fee3c0f5d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.816846 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b023535-420b-4b83-8d7b-5fee3c0f5d32 admin admin] PATH_INFO: `/v3/projects/939e5397f6e6426180fefa48009888c0/users/cc411aed47204a2ca363dc9304bfbeeb/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.833955 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b023535-420b-4b83-8d7b-5fee3c0f5d32 admin admin] RBAC: Authorizing `identity:create_grant(project_id=939e5397f6e6426180fefa48009888c0, user_id=cc411aed47204a2ca363dc9304bfbeeb, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:06.836703 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b023535-420b-4b83-8d7b-5fee3c0f5d32 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:06.852774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1345/2684] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:06 2022] PUT /identity/v3/projects/939e5397f6e6426180fefa48009888c0/users/cc411aed47204a2ca363dc9304bfbeeb/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:33:06.864113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06ac75-8117-46f1-ae60-c1a4e3101e30 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:06.864545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06ac75-8117-46f1-ae60-c1a4e3101e30 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:06.864692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a06ac75-8117-46f1-ae60-c1a4e3101e30 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:06.895199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4a06ac75-8117-46f1-ae60-c1a4e3101e30 None None] MFA Rules not processed for user `cc411aed47204a2ca363dc9304bfbeeb`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:06.896495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4a06ac75-8117-46f1-ae60-c1a4e3101e30 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:06.952287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:06.969676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1340/2685] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:06 2022] POST /identity/v3/projects => generated 373 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:33:06.970650 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1346/2686] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:06 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:06.974166 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d1e6e-de93-4c5c-b706-efe449d7715b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:06.976896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06ac75-8117-46f1-ae60-c1a4e3101e30 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.015775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:07.046491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a06ac75-8117-46f1-ae60-c1a4e3101e30 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.051075 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3caca-6557-4a3c-a301-d769f2ccc428 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.051688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3caca-6557-4a3c-a301-d769f2ccc428 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.051969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3caca-6557-4a3c-a301-d769f2ccc428 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.052530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e3caca-6557-4a3c-a301-d769f2ccc428 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.052679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721d1e6e-de93-4c5c-b706-efe449d7715b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.052939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3caca-6557-4a3c-a301-d769f2ccc428 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.054974 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e3caca-6557-4a3c-a301-d769f2ccc428 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.057699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bff10-6df7-4917-a794-6b2ca6c9153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.058312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bff10-6df7-4917-a794-6b2ca6c9153b admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.058590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bff10-6df7-4917-a794-6b2ca6c9153b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.058923 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af1bff10-6df7-4917-a794-6b2ca6c9153b admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.059931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bff10-6df7-4917-a794-6b2ca6c9153b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.062425 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af1bff10-6df7-4917-a794-6b2ca6c9153b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.087524 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1347/2687] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:06 2022] POST /identity/v3/projects => generated 383 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:07.092266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1341/2688] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:06 2022] POST /identity/v3/users => generated 287 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:07.093119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bff10-6df7-4917-a794-6b2ca6c9153b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.093813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3caca-6557-4a3c-a301-d769f2ccc428 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.104825 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af1bff10-6df7-4917-a794-6b2ca6c9153b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.168799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e3caca-6557-4a3c-a301-d769f2ccc428 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.172722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5ab15-66aa-4273-9430-42168643629f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.173453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5ab15-66aa-4273-9430-42168643629f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.173838 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5ab15-66aa-4273-9430-42168643629f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.173960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89359e3-0d4a-45db-8c15-d9b609a2f63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.174302 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5ab15-66aa-4273-9430-42168643629f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.174568 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89359e3-0d4a-45db-8c15-d9b609a2f63c admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.174849 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89359e3-0d4a-45db-8c15-d9b609a2f63c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.175126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89359e3-0d4a-45db-8c15-d9b609a2f63c admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.175322 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5ab15-66aa-4273-9430-42168643629f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.176763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89359e3-0d4a-45db-8c15-d9b609a2f63c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.177695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5ab15-66aa-4273-9430-42168643629f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.178624 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b89359e3-0d4a-45db-8c15-d9b609a2f63c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.192289 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1342/2689] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:07.196868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5ab15-66aa-4273-9430-42168643629f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.208290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5ab15-66aa-4273-9430-42168643629f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.210589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1348/2690] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:07 2022] POST /identity/v3/users => generated 298 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:07.214210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89359e3-0d4a-45db-8c15-d9b609a2f63c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.216538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f9c26-7d91-4942-a7f4-a5964353a3fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.217197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f9c26-7d91-4942-a7f4-a5964353a3fc admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.217439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f9c26-7d91-4942-a7f4-a5964353a3fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.217726 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6f9c26-7d91-4942-a7f4-a5964353a3fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.218339 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f9c26-7d91-4942-a7f4-a5964353a3fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.219939 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6f9c26-7d91-4942-a7f4-a5964353a3fc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.225286 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89359e3-0d4a-45db-8c15-d9b609a2f63c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.230774 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d60b3-7a47-4bd8-866e-9f419130aec7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.231635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d60b3-7a47-4bd8-866e-9f419130aec7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.231890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d60b3-7a47-4bd8-866e-9f419130aec7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.232333 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726d60b3-7a47-4bd8-866e-9f419130aec7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.233058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d60b3-7a47-4bd8-866e-9f419130aec7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.234730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-726d60b3-7a47-4bd8-866e-9f419130aec7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.242921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1343/2691] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:07.243948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f9c26-7d91-4942-a7f4-a5964353a3fc admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.250682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1349/2692] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:33:07.251583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d60b3-7a47-4bd8-866e-9f419130aec7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.256075 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6f9c26-7d91-4942-a7f4-a5964353a3fc admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.261743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f101c491-b36a-4d39-ae9e-cd712df9de8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.261927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726d60b3-7a47-4bd8-866e-9f419130aec7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.262522 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c491-b36a-4d39-ae9e-cd712df9de8c admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.262832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c491-b36a-4d39-ae9e-cd712df9de8c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.263108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f101c491-b36a-4d39-ae9e-cd712df9de8c admin admin] PATH_INFO: `/v3/projects/b337fc5fcd554d759eb7e1e27970caee/users/748e3689300140e39bf4e405f20a1d59/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.267216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548c9f-f750-4d69-95bc-aeef5e5e68e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.267771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548c9f-f750-4d69-95bc-aeef5e5e68e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.268050 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548c9f-f750-4d69-95bc-aeef5e5e68e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.268403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1548c9f-f750-4d69-95bc-aeef5e5e68e7 admin admin] PATH_INFO: `/v3/projects/1650299cba7e49439e61cc5b6e9fad8b/users/e32c685c42cf4a23b5df1eb3dc5ee41e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.286102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101c491-b36a-4d39-ae9e-cd712df9de8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=b337fc5fcd554d759eb7e1e27970caee, user_id=748e3689300140e39bf4e405f20a1d59, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.287628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1548c9f-f750-4d69-95bc-aeef5e5e68e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1650299cba7e49439e61cc5b6e9fad8b, user_id=e32c685c42cf4a23b5df1eb3dc5ee41e, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.290284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1548c9f-f750-4d69-95bc-aeef5e5e68e7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.290652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f101c491-b36a-4d39-ae9e-cd712df9de8c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.308198 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1350/2693] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:07 2022] PUT /identity/v3/projects/1650299cba7e49439e61cc5b6e9fad8b/users/e32c685c42cf4a23b5df1eb3dc5ee41e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:33:07.308665 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1344/2694] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:07 2022] PUT /identity/v3/projects/b337fc5fcd554d759eb7e1e27970caee/users/748e3689300140e39bf4e405f20a1d59/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:33:07.310786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548c9f-f750-4d69-95bc-aeef5e5e68e7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.317401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3b50a-810f-4eb8-aa00-4ffdbb36a3b9 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.317729 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3b50a-810f-4eb8-aa00-4ffdbb36a3b9 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.317964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c3b50a-810f-4eb8-aa00-4ffdbb36a3b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.347442 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-02c3b50a-810f-4eb8-aa00-4ffdbb36a3b9 None None] MFA Rules not processed for user `748e3689300140e39bf4e405f20a1d59`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:07.348867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02c3b50a-810f-4eb8-aa00-4ffdbb36a3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:07.349826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:07.387646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1548c9f-f750-4d69-95bc-aeef5e5e68e7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.418192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1345/2695] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:07 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:07.430373 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3b50a-810f-4eb8-aa00-4ffdbb36a3b9 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.432499 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-02c3b50a-810f-4eb8-aa00-4ffdbb36a3b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:07.446939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beaa7f-bb94-42e4-94c8-bfd2695d44be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.447676 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beaa7f-bb94-42e4-94c8-bfd2695d44be admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.448209 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beaa7f-bb94-42e4-94c8-bfd2695d44be admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.448551 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95beaa7f-bb94-42e4-94c8-bfd2695d44be admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.449214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beaa7f-bb94-42e4-94c8-bfd2695d44be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.451008 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95beaa7f-bb94-42e4-94c8-bfd2695d44be admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.461652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:07.464495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1351/2696] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:07 2022] GET /identity/v3/roles => generated 1420 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:33:07.469487 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beaa7f-bb94-42e4-94c8-bfd2695d44be admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.480568 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95beaa7f-bb94-42e4-94c8-bfd2695d44be admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.489636 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d19219-9e4f-44f8-8bda-b6fc2ecb2fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.490300 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19219-9e4f-44f8-8bda-b6fc2ecb2fb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.490587 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19219-9e4f-44f8-8bda-b6fc2ecb2fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.490867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d19219-9e4f-44f8-8bda-b6fc2ecb2fb1 admin admin] PATH_INFO: `/v3/projects/1650299cba7e49439e61cc5b6e9fad8b/users/e32c685c42cf4a23b5df1eb3dc5ee41e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.492859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d19219-9e4f-44f8-8bda-b6fc2ecb2fb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1650299cba7e49439e61cc5b6e9fad8b, user_id=e32c685c42cf4a23b5df1eb3dc5ee41e, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.495616 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d19219-9e4f-44f8-8bda-b6fc2ecb2fb1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.508282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1352/2697] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:07 2022] PUT /identity/v3/projects/1650299cba7e49439e61cc5b6e9fad8b/users/e32c685c42cf4a23b5df1eb3dc5ee41e/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:07.518945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add492-5eec-4c84-af20-0d17a128d81e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.518945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add492-5eec-4c84-af20-0d17a128d81e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.519239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37add492-5eec-4c84-af20-0d17a128d81e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.530054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02c3b50a-810f-4eb8-aa00-4ffdbb36a3b9 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.553734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-37add492-5eec-4c84-af20-0d17a128d81e None None] MFA Rules not processed for user `e32c685c42cf4a23b5df1eb3dc5ee41e`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:07.554948 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-37add492-5eec-4c84-af20-0d17a128d81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:07.607365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42d70-4247-45a6-87fa-3fccef4ba68d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.608438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42d70-4247-45a6-87fa-3fccef4ba68d service nova] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.608722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42d70-4247-45a6-87fa-3fccef4ba68d service nova] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.608996 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd42d70-4247-45a6-87fa-3fccef4ba68d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.644434 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1353/2698] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:07.656443 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add492-5eec-4c84-af20-0d17a128d81e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.658457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-37add492-5eec-4c84-af20-0d17a128d81e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:07.678228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd42d70-4247-45a6-87fa-3fccef4ba68d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.680517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd42d70-4247-45a6-87fa-3fccef4ba68d service nova] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.693456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1346/2699] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:07 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:33:07.717497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:07.740477 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37add492-5eec-4c84-af20-0d17a128d81e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.744248 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc51eec0-34a1-4166-b18a-9a03f0f487ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.744875 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51eec0-34a1-4166-b18a-9a03f0f487ca service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.745153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51eec0-34a1-4166-b18a-9a03f0f487ca service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.745563 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc51eec0-34a1-4166-b18a-9a03f0f487ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.750237 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dc51eec0-34a1-4166-b18a-9a03f0f487ca service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:07.817838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51eec0-34a1-4166-b18a-9a03f0f487ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.819346 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc51eec0-34a1-4166-b18a-9a03f0f487ca service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:07.829548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1354/2700] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:07 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 174 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:33:07.914816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42d70-4247-45a6-87fa-3fccef4ba68d service nova] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:07.968409 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:07.979792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd42d70-4247-45a6-87fa-3fccef4ba68d service nova] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:07.984855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:07.985671 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:07.985951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:07.986284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] PATH_INFO: `/v3/users/748e3689300140e39bf4e405f20a1d59` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:07.987347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=748e3689300140e39bf4e405f20a1d59)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:07.989821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:08.035853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '748e3689300140e39bf4e405f20a1d59'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:08.036566 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '748e3689300140e39bf4e405f20a1d59'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:08.049931 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '748e3689300140e39bf4e405f20a1d59'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:08.050596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '748e3689300140e39bf4e405f20a1d59'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:08.058095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '748e3689300140e39bf4e405f20a1d59'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:08.075448 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1347/2701] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:07 2022] DELETE /identity/v3/users/748e3689300140e39bf4e405f20a1d59 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:08.077185 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832dd4d-f397-45e6-8ed7-e0db4d04f0bf None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:08.078036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832dd4d-f397-45e6-8ed7-e0db4d04f0bf None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:08.078036 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5832dd4d-f397-45e6-8ed7-e0db4d04f0bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:08.099007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5832dd4d-f397-45e6-8ed7-e0db4d04f0bf None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:08.100282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5832dd4d-f397-45e6-8ed7-e0db4d04f0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:08.173990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1355/2702] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:08.184718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:08.186127 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:08.246098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11f48e70-460f-4155-bc0f-0bd1ccd05f56 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:08.249775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd690001-dbef-4734-87c2-98fd030c5b67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:08.250410 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd690001-dbef-4734-87c2-98fd030c5b67 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:08.250688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd690001-dbef-4734-87c2-98fd030c5b67 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:08.250961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd690001-dbef-4734-87c2-98fd030c5b67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:08.260071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd690001-dbef-4734-87c2-98fd030c5b67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:08.261542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd690001-dbef-4734-87c2-98fd030c5b67 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:08.270955 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1348/2703] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:33:08.571807 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832dd4d-f397-45e6-8ed7-e0db4d04f0bf None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:08.574187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5832dd4d-f397-45e6-8ed7-e0db4d04f0bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:08.592732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5832dd4d-f397-45e6-8ed7-e0db4d04f0bf None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:08.598017 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:08.598720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:08.599003 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:08.599279 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] PATH_INFO: `/v3/projects/b337fc5fcd554d759eb7e1e27970caee` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:08.600459 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] RBAC: Authorizing `identity:delete_project(project_id=b337fc5fcd554d759eb7e1e27970caee)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:08.602374 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:08.658358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b337fc5fcd554d759eb7e1e27970caee', 'request_id': 'req-0427e877-4c3e-4b20-852a-f737d261c23a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:08.665653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b337fc5fcd554d759eb7e1e27970caee', 'request_id': 'req-0427e877-4c3e-4b20-852a-f737d261c23a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:08.672920 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b337fc5fcd554d759eb7e1e27970caee', 'request_id': 'req-0427e877-4c3e-4b20-852a-f737d261c23a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:08.689125 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] The token cache is being invalidate because project b337fc5fcd554d759eb7e1e27970caee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:08.689722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:08.690438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-0427e877-4c3e-4b20-852a-f737d261c23a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:08.692603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1356/2704] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:08 2022] DELETE /identity/v3/projects/b337fc5fcd554d759eb7e1e27970caee => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:08.697757 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5081d6-7b72-47ec-8c8c-28e616799a75 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:08.698256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5081d6-7b72-47ec-8c8c-28e616799a75 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:08.698481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd5081d6-7b72-47ec-8c8c-28e616799a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:08.720603 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-cd5081d6-7b72-47ec-8c8c-28e616799a75 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:08.721868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-cd5081d6-7b72-47ec-8c8c-28e616799a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:08.786542 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1349/2705] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:08.794691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb953e2c-9241-4d03-9f63-54f0264cf01c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:08.794981 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb953e2c-9241-4d03-9f63-54f0264cf01c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:08.795263 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb953e2c-9241-4d03-9f63-54f0264cf01c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:08.815349 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fb953e2c-9241-4d03-9f63-54f0264cf01c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:08.817344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fb953e2c-9241-4d03-9f63-54f0264cf01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:08.826853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1357/2706] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:08.831471 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5081d6-7b72-47ec-8c8c-28e616799a75 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:08.843893 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd5081d6-7b72-47ec-8c8c-28e616799a75 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:08.848719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a547b-25a0-41da-8d5a-d9eb70782e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:08.849420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a547b-25a0-41da-8d5a-d9eb70782e83 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:08.849713 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a547b-25a0-41da-8d5a-d9eb70782e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:08.850064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-039a547b-25a0-41da-8d5a-d9eb70782e83 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:08.850743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a547b-25a0-41da-8d5a-d9eb70782e83 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:33:08.851133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a547b-25a0-41da-8d5a-d9eb70782e83 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:08.852891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-039a547b-25a0-41da-8d5a-d9eb70782e83 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:08.866212 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1350/2707] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:33:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:33:08.870362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb953e2c-9241-4d03-9f63-54f0264cf01c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:08.880679 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb953e2c-9241-4d03-9f63-54f0264cf01c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:08.885534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238b69-884f-49f6-ba97-6bb172cb517d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:08.886137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238b69-884f-49f6-ba97-6bb172cb517d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:08.886411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238b69-884f-49f6-ba97-6bb172cb517d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:08.886685 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2238b69-884f-49f6-ba97-6bb172cb517d admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:08.887323 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238b69-884f-49f6-ba97-6bb172cb517d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:08.889258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2238b69-884f-49f6-ba97-6bb172cb517d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:08.905544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:08.918403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1358/2708] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:08 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:08.922584 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a547b-25a0-41da-8d5a-d9eb70782e83 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:08.928235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:08.934591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-039a547b-25a0-41da-8d5a-d9eb70782e83 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:08.992179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398f8dc-dd6c-48dc-9640-fbcfdeab51d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:08.992827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f8dc-dd6c-48dc-9640-fbcfdeab51d7 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:08.993108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f8dc-dd6c-48dc-9640-fbcfdeab51d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:08.993401 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c398f8dc-dd6c-48dc-9640-fbcfdeab51d7 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:08.994049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398f8dc-dd6c-48dc-9640-fbcfdeab51d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:08.995963 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c398f8dc-dd6c-48dc-9640-fbcfdeab51d7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:09.016061 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1351/2709] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:08 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:09.020780 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238b69-884f-49f6-ba97-6bb172cb517d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:09.035941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2238b69-884f-49f6-ba97-6bb172cb517d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:09.041293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a6a40-cd68-4cde-a1cd-69a936a7c938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:09.041911 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a6a40-cd68-4cde-a1cd-69a936a7c938 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:09.042193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a6a40-cd68-4cde-a1cd-69a936a7c938 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:09.042470 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29a6a40-cd68-4cde-a1cd-69a936a7c938 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:09.043126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a6a40-cd68-4cde-a1cd-69a936a7c938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:09.044830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29a6a40-cd68-4cde-a1cd-69a936a7c938 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:09.058955 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1359/2710] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:09.063137 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398f8dc-dd6c-48dc-9640-fbcfdeab51d7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:09.073562 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c398f8dc-dd6c-48dc-9640-fbcfdeab51d7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:09.079057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d6ac5a-7c00-4082-9978-32340b4b86b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:09.079664 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6ac5a-7c00-4082-9978-32340b4b86b3 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:09.079946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6ac5a-7c00-4082-9978-32340b4b86b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:09.080262 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d6ac5a-7c00-4082-9978-32340b4b86b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:09.080933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6ac5a-7c00-4082-9978-32340b4b86b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:09.082628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d6ac5a-7c00-4082-9978-32340b4b86b3 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:09.095361 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1352/2711] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:09.101197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a6a40-cd68-4cde-a1cd-69a936a7c938 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:09.112268 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29a6a40-cd68-4cde-a1cd-69a936a7c938 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:09.117960 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5e071-b507-4822-8f04-8e75d03b900c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:09.118638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e071-b507-4822-8f04-8e75d03b900c admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:09.118915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e071-b507-4822-8f04-8e75d03b900c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:09.119187 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a5e071-b507-4822-8f04-8e75d03b900c admin admin] PATH_INFO: `/v3/projects/0aca5480482449db8b8545e2d3b1a31d/users/7ce790225060464cbf9f5494acb0840c/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:09.135046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5e071-b507-4822-8f04-8e75d03b900c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0aca5480482449db8b8545e2d3b1a31d, user_id=7ce790225060464cbf9f5494acb0840c, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:09.138108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a5e071-b507-4822-8f04-8e75d03b900c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:09.153177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1360/2712] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:09 2022] PUT /identity/v3/projects/0aca5480482449db8b8545e2d3b1a31d/users/7ce790225060464cbf9f5494acb0840c/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:09.165340 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64df86-cb85-4c8a-b1f6-5dbfeda55405 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:09.165714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64df86-cb85-4c8a-b1f6-5dbfeda55405 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:09.166068 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a64df86-cb85-4c8a-b1f6-5dbfeda55405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:09.206133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-3a64df86-cb85-4c8a-b1f6-5dbfeda55405 None None] MFA Rules not processed for user `7ce790225060464cbf9f5494acb0840c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:09.207462 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3a64df86-cb85-4c8a-b1f6-5dbfeda55405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:09.279501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1353/2713] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:09 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:09.291816 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5e071-b507-4822-8f04-8e75d03b900c admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:09.293763 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c0a5e071-b507-4822-8f04-8e75d03b900c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:09.355010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a5e071-b507-4822-8f04-8e75d03b900c admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:09.358680 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa711d0e-af68-41a3-b5e1-4d632349fadd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:09.359282 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa711d0e-af68-41a3-b5e1-4d632349fadd service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:09.359558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa711d0e-af68-41a3-b5e1-4d632349fadd service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:09.359921 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa711d0e-af68-41a3-b5e1-4d632349fadd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:09.366180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64df86-cb85-4c8a-b1f6-5dbfeda55405 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:09.368346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3a64df86-cb85-4c8a-b1f6-5dbfeda55405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:09.369451 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa711d0e-af68-41a3-b5e1-4d632349fadd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:09.370874 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa711d0e-af68-41a3-b5e1-4d632349fadd service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:09.381104 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a64df86-cb85-4c8a-b1f6-5dbfeda55405 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:09.381508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1361/2714] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:09.386797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43627677-445a-4c89-b54e-7b8083cf9c12 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:09.387400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43627677-445a-4c89-b54e-7b8083cf9c12 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:09.387991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43627677-445a-4c89-b54e-7b8083cf9c12 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:09.387991 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43627677-445a-4c89-b54e-7b8083cf9c12 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:09.389961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-43627677-445a-4c89-b54e-7b8083cf9c12 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:09.412890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa711d0e-af68-41a3-b5e1-4d632349fadd service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:09.468454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43627677-445a-4c89-b54e-7b8083cf9c12 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:09.469961 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43627677-445a-4c89-b54e-7b8083cf9c12 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:09.481681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1354/2715] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:33:09.496747 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa711d0e-af68-41a3-b5e1-4d632349fadd service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:09.501555 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:09.502205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:09.502453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:09.502726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] PATH_INFO: `/v3/users/7ce790225060464cbf9f5494acb0840c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:09.503904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7ce790225060464cbf9f5494acb0840c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:09.506453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:09.576605 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7ce790225060464cbf9f5494acb0840c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:09.577753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7ce790225060464cbf9f5494acb0840c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:09.578800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7ce790225060464cbf9f5494acb0840c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:09.590580 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7ce790225060464cbf9f5494acb0840c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:09.600574 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:09.607782 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7ce790225060464cbf9f5494acb0840c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:09.624072 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1362/2716] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:09 2022] DELETE /identity/v3/users/7ce790225060464cbf9f5494acb0840c => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:09.628532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef94f0-29e4-49c8-884f-5abd73fee5b4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:09.629041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef94f0-29e4-49c8-884f-5abd73fee5b4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:09.629930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ef94f0-29e4-49c8-884f-5abd73fee5b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:09.650792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b3ef94f0-29e4-49c8-884f-5abd73fee5b4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:09.652130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b3ef94f0-29e4-49c8-884f-5abd73fee5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:09.657232 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:09.726862 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1355/2717] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:09.738100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:09.739660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:09.801682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1968443-d781-4e53-a97f-7c5dc61f0b03 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:09.805401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5953fac-7da9-4228-a228-850ee65f52fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:09.806009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5953fac-7da9-4228-a228-850ee65f52fd service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:09.806289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5953fac-7da9-4228-a228-850ee65f52fd service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:09.806562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5953fac-7da9-4228-a228-850ee65f52fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:09.816947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5953fac-7da9-4228-a228-850ee65f52fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:09.818386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5953fac-7da9-4228-a228-850ee65f52fd service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:09.830281 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1363/2718] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:10.092711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef94f0-29e4-49c8-884f-5abd73fee5b4 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.094133 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b3ef94f0-29e4-49c8-884f-5abd73fee5b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.122379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5953fac-7da9-4228-a228-850ee65f52fd service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.123975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c5953fac-7da9-4228-a228-850ee65f52fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.140683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5953fac-7da9-4228-a228-850ee65f52fd service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:10.148275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:10.149057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.149438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.149835 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] PATH_INFO: `/v3/projects/0aca5480482449db8b8545e2d3b1a31d` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.151101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0aca5480482449db8b8545e2d3b1a31d)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:10.154142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:10.173582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ef94f0-29e4-49c8-884f-5abd73fee5b4 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:10.177766 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77731f65-0436-4d7e-a097-5f88e166e53e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:10.178370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731f65-0436-4d7e-a097-5f88e166e53e service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.178647 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731f65-0436-4d7e-a097-5f88e166e53e service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.178920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77731f65-0436-4d7e-a097-5f88e166e53e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.180747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-77731f65-0436-4d7e-a097-5f88e166e53e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.209786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0aca5480482449db8b8545e2d3b1a31d', 'request_id': 'req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:10.216789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0aca5480482449db8b8545e2d3b1a31d', 'request_id': 'req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:10.222942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0aca5480482449db8b8545e2d3b1a31d', 'request_id': 'req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:10.236356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] The token cache is being invalidate because project 0aca5480482449db8b8545e2d3b1a31d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:10.236571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:10.237242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-ac968012-6efa-4fa6-9bc5-e93dd6b8d381 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:10.239252 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1364/2719] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:10 2022] DELETE /identity/v3/projects/0aca5480482449db8b8545e2d3b1a31d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:10.244954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c111271-3ed3-46fb-98cb-0966d066f37c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.245234 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c111271-3ed3-46fb-98cb-0966d066f37c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.245507 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c111271-3ed3-46fb-98cb-0966d066f37c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.253217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77731f65-0436-4d7e-a097-5f88e166e53e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:10.255293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77731f65-0436-4d7e-a097-5f88e166e53e service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:10.265107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1356/2720] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:10 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:10.266287 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4c111271-3ed3-46fb-98cb-0966d066f37c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:10.267572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4c111271-3ed3-46fb-98cb-0966d066f37c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.331048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1365/2721] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:10.339688 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157a62-50fe-4bf2-b19e-59037e276623 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.340083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157a62-50fe-4bf2-b19e-59037e276623 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.340432 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87157a62-50fe-4bf2-b19e-59037e276623 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.360367 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-87157a62-50fe-4bf2-b19e-59037e276623 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:10.361564 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-87157a62-50fe-4bf2-b19e-59037e276623 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.371049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1357/2722] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:10.375828 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c111271-3ed3-46fb-98cb-0966d066f37c None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.386084 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c111271-3ed3-46fb-98cb-0966d066f37c None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:10.390710 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bab47-9c92-4bfc-ad4f-8d87b0110db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:10.391304 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bab47-9c92-4bfc-ad4f-8d87b0110db2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.391583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bab47-9c92-4bfc-ad4f-8d87b0110db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.391853 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-671bab47-9c92-4bfc-ad4f-8d87b0110db2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.392534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bab47-9c92-4bfc-ad4f-8d87b0110db2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:33:10.392838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bab47-9c92-4bfc-ad4f-8d87b0110db2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:10.394623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-671bab47-9c92-4bfc-ad4f-8d87b0110db2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:10.397427 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:10.407546 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1366/2723] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:33:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:33:10.411895 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157a62-50fe-4bf2-b19e-59037e276623 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.421481 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87157a62-50fe-4bf2-b19e-59037e276623 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:10.426743 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3ef4e-d279-4353-8387-28a139e83ea6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:10.427371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3ef4e-d279-4353-8387-28a139e83ea6 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.427649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3ef4e-d279-4353-8387-28a139e83ea6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.427920 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae3ef4e-d279-4353-8387-28a139e83ea6 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.428593 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3ef4e-d279-4353-8387-28a139e83ea6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:10.430476 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae3ef4e-d279-4353-8387-28a139e83ea6 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:10.458342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1358/2724] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:10 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:10.462779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bab47-9c92-4bfc-ad4f-8d87b0110db2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.473787 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-671bab47-9c92-4bfc-ad4f-8d87b0110db2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:10.533826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8faea-25d1-4bcb-aea1-0761af8ffa80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:10.534448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8faea-25d1-4bcb-aea1-0761af8ffa80 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.534728 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8faea-25d1-4bcb-aea1-0761af8ffa80 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.535000 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27d8faea-25d1-4bcb-aea1-0761af8ffa80 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.536190 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8faea-25d1-4bcb-aea1-0761af8ffa80 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:10.538116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27d8faea-25d1-4bcb-aea1-0761af8ffa80 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:10.563239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1367/2725] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:10 2022] POST /identity/v3/users => generated 286 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:10.564472 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3ef4e-d279-4353-8387-28a139e83ea6 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.574660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae3ef4e-d279-4353-8387-28a139e83ea6 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:10.579575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82caac6-6076-4f66-a8f2-a7371e08a0c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:10.580179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82caac6-6076-4f66-a8f2-a7371e08a0c0 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.580477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82caac6-6076-4f66-a8f2-a7371e08a0c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.580747 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82caac6-6076-4f66-a8f2-a7371e08a0c0 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.581389 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82caac6-6076-4f66-a8f2-a7371e08a0c0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:10.583007 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82caac6-6076-4f66-a8f2-a7371e08a0c0 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:10.592753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1359/2726] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:10.596641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8faea-25d1-4bcb-aea1-0761af8ffa80 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.607080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27d8faea-25d1-4bcb-aea1-0761af8ffa80 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:10.611804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ae35f21-7e5c-413e-8665-f27f7603aba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:10.612440 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae35f21-7e5c-413e-8665-f27f7603aba7 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.612722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae35f21-7e5c-413e-8665-f27f7603aba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.612999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ae35f21-7e5c-413e-8665-f27f7603aba7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.614220 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae35f21-7e5c-413e-8665-f27f7603aba7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:10.615808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ae35f21-7e5c-413e-8665-f27f7603aba7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:10.627290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1368/2727] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:10.631636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82caac6-6076-4f66-a8f2-a7371e08a0c0 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.641359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82caac6-6076-4f66-a8f2-a7371e08a0c0 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:10.646225 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c67759-670d-46d7-9de3-09c006e953ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:10.646857 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c67759-670d-46d7-9de3-09c006e953ba admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.647130 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c67759-670d-46d7-9de3-09c006e953ba admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.647399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c67759-670d-46d7-9de3-09c006e953ba admin admin] PATH_INFO: `/v3/projects/47a0d571f687453f9eaa903d529b39b5/users/3bbc12cb9a5b4a0593c5b3e7a46350db/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.663065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c67759-670d-46d7-9de3-09c006e953ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=47a0d571f687453f9eaa903d529b39b5, user_id=3bbc12cb9a5b4a0593c5b3e7a46350db, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:10.665742 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c67759-670d-46d7-9de3-09c006e953ba admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:10.668720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:10.681491 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1360/2728] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:10 2022] PUT /identity/v3/projects/47a0d571f687453f9eaa903d529b39b5/users/3bbc12cb9a5b4a0593c5b3e7a46350db/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:10.693040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9108-c441-4bf5-a9df-3bcbaa1ff228 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.693420 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9108-c441-4bf5-a9df-3bcbaa1ff228 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.693838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4b9108-c441-4bf5-a9df-3bcbaa1ff228 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.698333 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c67759-670d-46d7-9de3-09c006e953ba admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.700036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-50c67759-670d-46d7-9de3-09c006e953ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.725513 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5b4b9108-c441-4bf5-a9df-3bcbaa1ff228 None None] MFA Rules not processed for user `3bbc12cb9a5b4a0593c5b3e7a46350db`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:10.726748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5b4b9108-c441-4bf5-a9df-3bcbaa1ff228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.763676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c67759-670d-46d7-9de3-09c006e953ba admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:10.768412 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:10.769045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.769324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.769619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] PATH_INFO: `/v3/users/e70c12e909704d41a2885b06eda7c64f` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.770778 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70c12e909704d41a2885b06eda7c64f)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:10.773422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:10.792870 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1369/2729] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:10.805886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9108-c441-4bf5-a9df-3bcbaa1ff228 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.807437 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5b4b9108-c441-4bf5-a9df-3bcbaa1ff228 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.823266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70c12e909704d41a2885b06eda7c64f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:10.823937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70c12e909704d41a2885b06eda7c64f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:10.836937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70c12e909704d41a2885b06eda7c64f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:10.837608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70c12e909704d41a2885b06eda7c64f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:10.845407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-76aeb34f-8ab5-4a28-bd33-d7524ac778da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70c12e909704d41a2885b06eda7c64f'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:10.861235 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1361/2730] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:10 2022] DELETE /identity/v3/users/e70c12e909704d41a2885b06eda7c64f => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:33:10.866176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5011e-e950-428a-ae3f-d3bfa8b0af04 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.866460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5011e-e950-428a-ae3f-d3bfa8b0af04 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.866731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5011e-e950-428a-ae3f-d3bfa8b0af04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.870844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4b9108-c441-4bf5-a9df-3bcbaa1ff228 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:10.885854 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-45d5011e-e950-428a-ae3f-d3bfa8b0af04 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:10.887036 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-45d5011e-e950-428a-ae3f-d3bfa8b0af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.889362 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:10.925509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1fc32-4ca1-40a4-8e61-6099886bfdaa service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ece8645e0954e1d81837cdcaa2ef1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:10.926118 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1fc32-4ca1-40a4-8e61-6099886bfdaa service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:10.926401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1fc32-4ca1-40a4-8e61-6099886bfdaa service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:10.926683 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa1fc32-4ca1-40a4-8e61-6099886bfdaa service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:10.928529 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0fa1fc32-4ca1-40a4-8e61-6099886bfdaa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.944790 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1362/2731] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:10.954774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5011e-e950-428a-ae3f-d3bfa8b0af04 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:10.956324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-45d5011e-e950-428a-ae3f-d3bfa8b0af04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:10.975715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:10.993216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1fc32-4ca1-40a4-8e61-6099886bfdaa service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:10.994633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa1fc32-4ca1-40a4-8e61-6099886bfdaa service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:11.003445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1370/2732] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:10 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:33:11.016632 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5011e-e950-428a-ae3f-d3bfa8b0af04 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:11.020927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7914b-8e02-4007-ab28-15270a1b38aa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:11.021609 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7914b-8e02-4007-ab28-15270a1b38aa service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:11.021898 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7914b-8e02-4007-ab28-15270a1b38aa service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:11.022176 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac7914b-8e02-4007-ab28-15270a1b38aa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:11.033973 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7914b-8e02-4007-ab28-15270a1b38aa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:11.035969 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac7914b-8e02-4007-ab28-15270a1b38aa service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:11.047349 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1363/2733] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:33:11.336308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1fc32-4ca1-40a4-8e61-6099886bfdaa service glance] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:11.338044 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0fa1fc32-4ca1-40a4-8e61-6099886bfdaa service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:11.357032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa1fc32-4ca1-40a4-8e61-6099886bfdaa service glance] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:11.370658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:11.371330 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:11.371607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:11.371880 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] PATH_INFO: `/v3/projects/10e5775b74fb4b5fb3f17dd7bdcda7a6` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:11.373040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10e5775b74fb4b5fb3f17dd7bdcda7a6)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:11.374963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:11.439969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10e5775b74fb4b5fb3f17dd7bdcda7a6', 'request_id': 'req-2d80c872-2755-4761-8c44-d510cb613b20'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:11.447779 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10e5775b74fb4b5fb3f17dd7bdcda7a6', 'request_id': 'req-2d80c872-2755-4761-8c44-d510cb613b20'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:11.457941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10e5775b74fb4b5fb3f17dd7bdcda7a6', 'request_id': 'req-2d80c872-2755-4761-8c44-d510cb613b20'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:11.482856 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] The token cache is being invalidate because project 10e5775b74fb4b5fb3f17dd7bdcda7a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:11.483417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:11.484383 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:11.488918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1371/2734] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:11 2022] DELETE /identity/v3/projects/10e5775b74fb4b5fb3f17dd7bdcda7a6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:11.493305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7914b-8e02-4007-ab28-15270a1b38aa service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:11.507925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac7914b-8e02-4007-ab28-15270a1b38aa service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:11.572977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:11.573716 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:11.574027 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:11.574266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] PATH_INFO: `/v3/users/953e91ba53d342b5b040ba428e502162` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:11.575645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=953e91ba53d342b5b040ba428e502162)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:11.577956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:11.628216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '953e91ba53d342b5b040ba428e502162'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:11.628925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '953e91ba53d342b5b040ba428e502162'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:11.641556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '953e91ba53d342b5b040ba428e502162'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:11.642707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '953e91ba53d342b5b040ba428e502162'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:11.650618 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-5d64d3e0-d570-45fc-bd43-45a2b0ef02f5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '953e91ba53d342b5b040ba428e502162'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:11.666919 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1364/2735] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:11 2022] DELETE /identity/v3/users/953e91ba53d342b5b040ba428e502162 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:11.948839 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:11.950400 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:11.964991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d80c872-2755-4761-8c44-d510cb613b20 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:12.016479 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:12.023467 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:12.024136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.024611 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.025237 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] PATH_INFO: `/v3/projects/edd3392281cb4e7aaefe785f0a6d3b87` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.026508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=edd3392281cb4e7aaefe785f0a6d3b87)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:12.029045 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:12.076659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'edd3392281cb4e7aaefe785f0a6d3b87', 'request_id': 'req-589a634d-a0e5-429c-9e08-aab407bf58c8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:12.083755 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'edd3392281cb4e7aaefe785f0a6d3b87', 'request_id': 'req-589a634d-a0e5-429c-9e08-aab407bf58c8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:12.089372 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'edd3392281cb4e7aaefe785f0a6d3b87', 'request_id': 'req-589a634d-a0e5-429c-9e08-aab407bf58c8'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:12.102504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] The token cache is being invalidate because project edd3392281cb4e7aaefe785f0a6d3b87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:12.102806 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:12.103421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-589a634d-a0e5-429c-9e08-aab407bf58c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:12.104944 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1372/2736] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:11 2022] DELETE /identity/v3/projects/edd3392281cb4e7aaefe785f0a6d3b87 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:12.110903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a2c81-3de2-4e04-b5cf-01842c733b38 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.111388 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a2c81-3de2-4e04-b5cf-01842c733b38 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.111490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59a2c81-3de2-4e04-b5cf-01842c733b38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.133552 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a59a2c81-3de2-4e04-b5cf-01842c733b38 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:12.135152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a59a2c81-3de2-4e04-b5cf-01842c733b38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:12.169474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:12.200739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1365/2737] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:12.209571 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f08c85-4b39-47e9-8570-c9d8a0a4f38e None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.209851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f08c85-4b39-47e9-8570-c9d8a0a4f38e None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.210153 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25f08c85-4b39-47e9-8570-c9d8a0a4f38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.231735 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-25f08c85-4b39-47e9-8570-c9d8a0a4f38e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:12.232976 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-25f08c85-4b39-47e9-8570-c9d8a0a4f38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:12.241554 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1373/2738] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:12.245868 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a2c81-3de2-4e04-b5cf-01842c733b38 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:12.256144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59a2c81-3de2-4e04-b5cf-01842c733b38 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:12.260785 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9eaa3-a737-4a04-9632-a4c0065ef066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:12.261383 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9eaa3-a737-4a04-9632-a4c0065ef066 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.261659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9eaa3-a737-4a04-9632-a4c0065ef066 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.261927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9eaa3-a737-4a04-9632-a4c0065ef066 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.262565 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9eaa3-a737-4a04-9632-a4c0065ef066 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:33:12.262865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9eaa3-a737-4a04-9632-a4c0065ef066 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:12.264516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9eaa3-a737-4a04-9632-a4c0065ef066 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:12.277015 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1366/2739] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:33:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:33:12.282502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f08c85-4b39-47e9-8570-c9d8a0a4f38e None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:12.295312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25f08c85-4b39-47e9-8570-c9d8a0a4f38e None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:12.301275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee897710-f6cf-4620-8b58-68b384f5b5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:12.301975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897710-f6cf-4620-8b58-68b384f5b5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.302382 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897710-f6cf-4620-8b58-68b384f5b5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.302742 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee897710-f6cf-4620-8b58-68b384f5b5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.303556 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee897710-f6cf-4620-8b58-68b384f5b5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:12.305661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee897710-f6cf-4620-8b58-68b384f5b5f7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:12.334534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1374/2740] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:12 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:33:12.338639 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9eaa3-a737-4a04-9632-a4c0065ef066 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:12.349639 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9eaa3-a737-4a04-9632-a4c0065ef066 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:12.406041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc08cf6-888d-44aa-a348-8b6c57614632 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:12.406640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08cf6-888d-44aa-a348-8b6c57614632 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.406914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08cf6-888d-44aa-a348-8b6c57614632 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.407182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc08cf6-888d-44aa-a348-8b6c57614632 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.407808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc08cf6-888d-44aa-a348-8b6c57614632 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:12.409733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc08cf6-888d-44aa-a348-8b6c57614632 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:12.430774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1367/2741] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:12 2022] POST /identity/v3/users => generated 293 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:12.435067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee897710-f6cf-4620-8b58-68b384f5b5f7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:12.446081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee897710-f6cf-4620-8b58-68b384f5b5f7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:12.451283 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3385db2-185d-4a2e-8a78-32f5674e80a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:12.451902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3385db2-185d-4a2e-8a78-32f5674e80a1 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.452200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3385db2-185d-4a2e-8a78-32f5674e80a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.452474 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3385db2-185d-4a2e-8a78-32f5674e80a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.453113 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3385db2-185d-4a2e-8a78-32f5674e80a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:12.454947 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3385db2-185d-4a2e-8a78-32f5674e80a1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:12.466265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1375/2742] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:12.472065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc08cf6-888d-44aa-a348-8b6c57614632 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:12.482560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc08cf6-888d-44aa-a348-8b6c57614632 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:12.489279 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1217a2f0-4d64-4305-bb36-6915e330d741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:12.489925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a2f0-4d64-4305-bb36-6915e330d741 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.490220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a2f0-4d64-4305-bb36-6915e330d741 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.490488 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1217a2f0-4d64-4305-bb36-6915e330d741 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.491160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217a2f0-4d64-4305-bb36-6915e330d741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:12.492827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1217a2f0-4d64-4305-bb36-6915e330d741 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:12.504540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1368/2743] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:12.508847 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3385db2-185d-4a2e-8a78-32f5674e80a1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:12.519235 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3385db2-185d-4a2e-8a78-32f5674e80a1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:12.523848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd1805-a014-4f13-a6de-49c4e94c96cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:12.524531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd1805-a014-4f13-a6de-49c4e94c96cb admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.524813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd1805-a014-4f13-a6de-49c4e94c96cb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.525090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dcd1805-a014-4f13-a6de-49c4e94c96cb admin admin] PATH_INFO: `/v3/projects/fec2f21c769d474ba6041c5230741782/users/01f537889e6142eba3b277a903900bbb/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.541448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd1805-a014-4f13-a6de-49c4e94c96cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=fec2f21c769d474ba6041c5230741782, user_id=01f537889e6142eba3b277a903900bbb, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:12.544148 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dcd1805-a014-4f13-a6de-49c4e94c96cb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:12.559785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1376/2744] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:12 2022] PUT /identity/v3/projects/fec2f21c769d474ba6041c5230741782/users/01f537889e6142eba3b277a903900bbb/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:12.572774 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc6caf-1c92-4eca-b633-e758ee86b580 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.573063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc6caf-1c92-4eca-b633-e758ee86b580 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.573335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc6caf-1c92-4eca-b633-e758ee86b580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.605000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-76fc6caf-1c92-4eca-b633-e758ee86b580 None None] MFA Rules not processed for user `01f537889e6142eba3b277a903900bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:12.606209 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-76fc6caf-1c92-4eca-b633-e758ee86b580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:12.670861 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1369/2745] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:12 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:12.683381 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd1805-a014-4f13-a6de-49c4e94c96cb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:12.685204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-3dcd1805-a014-4f13-a6de-49c4e94c96cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:12.744493 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dcd1805-a014-4f13-a6de-49c4e94c96cb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:12.750135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3f08695-0e94-4a2e-9b78-59e2b7d592a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:12.750775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f08695-0e94-4a2e-9b78-59e2b7d592a2 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:12.751054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f08695-0e94-4a2e-9b78-59e2b7d592a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:12.751329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3f08695-0e94-4a2e-9b78-59e2b7d592a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:12.761014 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f08695-0e94-4a2e-9b78-59e2b7d592a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:12.762350 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3f08695-0e94-4a2e-9b78-59e2b7d592a2 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:12.771749 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1377/2746] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:12 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:14.246830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc6caf-1c92-4eca-b633-e758ee86b580 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:14.248465 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-76fc6caf-1c92-4eca-b633-e758ee86b580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:14.289457 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:14.325855 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc6caf-1c92-4eca-b633-e758ee86b580 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:14.341306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:14.341306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:14.341306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:14.341306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] PATH_INFO: `/v3/users/427d44dee1e3498bbe9a2c5dfb339c17` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:14.341723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] RBAC: Authorizing `identity:delete_user(user_id=427d44dee1e3498bbe9a2c5dfb339c17)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:14.341723 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:14.399649 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '427d44dee1e3498bbe9a2c5dfb339c17'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:14.400335 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '427d44dee1e3498bbe9a2c5dfb339c17'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:14.412805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '427d44dee1e3498bbe9a2c5dfb339c17'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:14.413511 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '427d44dee1e3498bbe9a2c5dfb339c17'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:14.420837 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '427d44dee1e3498bbe9a2c5dfb339c17'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:14.435975 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1370/2747] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:14 2022] DELETE /identity/v3/users/427d44dee1e3498bbe9a2c5dfb339c17 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:14.440590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79926-369f-464d-b9c7-d1549413f747 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:14.441055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79926-369f-464d-b9c7-d1549413f747 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:14.441321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d79926-369f-464d-b9c7-d1549413f747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:14.461995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c8d79926-369f-464d-b9c7-d1549413f747 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:14.463211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c8d79926-369f-464d-b9c7-d1549413f747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:14.484798 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:14.531684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1378/2748] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:14.541983 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:14.543423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:14.604431 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e71f3e3f-5203-4834-acbd-d4b09204b480 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:14.608078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3108f-fc11-4e79-8b52-6e7f58ab1440 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:14.608718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3108f-fc11-4e79-8b52-6e7f58ab1440 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:14.609000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3108f-fc11-4e79-8b52-6e7f58ab1440 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:14.609275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef3108f-fc11-4e79-8b52-6e7f58ab1440 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:14.619711 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3108f-fc11-4e79-8b52-6e7f58ab1440 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:14.621114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef3108f-fc11-4e79-8b52-6e7f58ab1440 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:14.630853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1371/2749] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:14.903979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d79926-369f-464d-b9c7-d1549413f747 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:14.906261 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c8d79926-369f-464d-b9c7-d1549413f747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:14.927342 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d79926-369f-464d-b9c7-d1549413f747 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:14.932371 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:14.933018 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:14.933302 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:14.933586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] PATH_INFO: `/v3/projects/e748432558114816868e4a240b72448e` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:14.935867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e748432558114816868e4a240b72448e)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:14.936813 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:14.987722 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e748432558114816868e4a240b72448e', 'request_id': 'req-7246f412-705c-4b8b-bc13-ec76730569b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:14.994761 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e748432558114816868e4a240b72448e', 'request_id': 'req-7246f412-705c-4b8b-bc13-ec76730569b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.001180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e748432558114816868e4a240b72448e', 'request_id': 'req-7246f412-705c-4b8b-bc13-ec76730569b5'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.014225 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] The token cache is being invalidate because project e748432558114816868e4a240b72448e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:15.014518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.015138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.016667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1379/2750] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:14 2022] DELETE /identity/v3/projects/e748432558114816868e4a240b72448e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:15.020732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3108f-fc11-4e79-8b52-6e7f58ab1440 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:15.031217 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef3108f-fc11-4e79-8b52-6e7f58ab1440 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:15.082782 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:15.090704 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:15.091348 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:15.091792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:15.092112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] PATH_INFO: `/v3/users/cc411aed47204a2ca363dc9304bfbeeb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:15.093770 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cc411aed47204a2ca363dc9304bfbeeb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:15.096113 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:15.144906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cc411aed47204a2ca363dc9304bfbeeb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.145607 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cc411aed47204a2ca363dc9304bfbeeb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.157949 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cc411aed47204a2ca363dc9304bfbeeb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.158577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cc411aed47204a2ca363dc9304bfbeeb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.166657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cc411aed47204a2ca363dc9304bfbeeb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.181614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1372/2751] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:15 2022] DELETE /identity/v3/users/cc411aed47204a2ca363dc9304bfbeeb => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:15.474251 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:15.476597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:15.497604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7246f412-705c-4b8b-bc13-ec76730569b5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:15.569260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:15.570108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:15.570635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:15.571019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] PATH_INFO: `/v3/projects/939e5397f6e6426180fefa48009888c0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:15.572604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=939e5397f6e6426180fefa48009888c0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:15.575188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:15.635056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '939e5397f6e6426180fefa48009888c0', 'request_id': 'req-873528d2-c946-466f-afe6-17030227c4e7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.636987 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:15.643530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '939e5397f6e6426180fefa48009888c0', 'request_id': 'req-873528d2-c946-466f-afe6-17030227c4e7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.651214 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '939e5397f6e6426180fefa48009888c0', 'request_id': 'req-873528d2-c946-466f-afe6-17030227c4e7'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.666492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] The token cache is being invalidate because project 939e5397f6e6426180fefa48009888c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:15.666938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.667823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.669994 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1380/2752] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:15 2022] DELETE /identity/v3/projects/939e5397f6e6426180fefa48009888c0 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:15.673827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:15.675355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:15.688640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f89ab3-465e-45ed-99e1-efdbcb834f49 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:15.772263 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:15.772914 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:15.773190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:15.773473 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] PATH_INFO: `/v3/users/e32c685c42cf4a23b5df1eb3dc5ee41e` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:15.775135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e32c685c42cf4a23b5df1eb3dc5ee41e)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:15.777221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:15.834185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e32c685c42cf4a23b5df1eb3dc5ee41e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.834860 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e32c685c42cf4a23b5df1eb3dc5ee41e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.849728 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e32c685c42cf4a23b5df1eb3dc5ee41e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.850573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e32c685c42cf4a23b5df1eb3dc5ee41e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.857938 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-603d1103-e983-46ae-b87b-8ee446ca40f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e32c685c42cf4a23b5df1eb3dc5ee41e'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:15.860707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:15.874731 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1373/2753] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:15 2022] DELETE /identity/v3/users/e32c685c42cf4a23b5df1eb3dc5ee41e => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:16.170289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:16.171836 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:16.186135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873528d2-c946-466f-afe6-17030227c4e7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:16.245888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:16.246531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.246810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.247200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] PATH_INFO: `/v3/projects/1650299cba7e49439e61cc5b6e9fad8b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.248432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] RBAC: Authorizing `identity:delete_project(project_id=1650299cba7e49439e61cc5b6e9fad8b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:16.250334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:16.300606 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1650299cba7e49439e61cc5b6e9fad8b', 'request_id': 'req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:16.306659 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1650299cba7e49439e61cc5b6e9fad8b', 'request_id': 'req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:16.312531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1650299cba7e49439e61cc5b6e9fad8b', 'request_id': 'req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:16.325549 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] The token cache is being invalidate because project 1650299cba7e49439e61cc5b6e9fad8b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:16.326130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:16.326787 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-7c998019-7b9a-4984-b9fd-6e576fc6b1ad admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:16.328634 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1381/2754] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:16 2022] DELETE /identity/v3/projects/1650299cba7e49439e61cc5b6e9fad8b => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:16.334019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841131e4-363c-4b5d-ae57-23eacfe47ec1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.334303 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841131e4-363c-4b5d-ae57-23eacfe47ec1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.334579 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841131e4-363c-4b5d-ae57-23eacfe47ec1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.355848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-841131e4-363c-4b5d-ae57-23eacfe47ec1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:16.357197 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-841131e4-363c-4b5d-ae57-23eacfe47ec1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:16.419100 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1374/2755] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:16.428177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33c57-c1fc-4ce8-aa88-6ec485f104a0 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.428463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33c57-c1fc-4ce8-aa88-6ec485f104a0 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.428736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb33c57-c1fc-4ce8-aa88-6ec485f104a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.452788 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7eb33c57-c1fc-4ce8-aa88-6ec485f104a0 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:16.454380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7eb33c57-c1fc-4ce8-aa88-6ec485f104a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:16.462295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1382/2756] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:16.466532 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841131e4-363c-4b5d-ae57-23eacfe47ec1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:16.476928 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-841131e4-363c-4b5d-ae57-23eacfe47ec1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:16.481459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee5a1f-1d25-43fe-aa2a-659bbe295b48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:16.482051 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee5a1f-1d25-43fe-aa2a-659bbe295b48 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.482326 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee5a1f-1d25-43fe-aa2a-659bbe295b48 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.482590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ee5a1f-1d25-43fe-aa2a-659bbe295b48 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.483226 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee5a1f-1d25-43fe-aa2a-659bbe295b48 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:33:16.483520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee5a1f-1d25-43fe-aa2a-659bbe295b48 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:16.485131 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ee5a1f-1d25-43fe-aa2a-659bbe295b48 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:16.497439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1375/2757] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:33:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:33:16.501824 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb33c57-c1fc-4ce8-aa88-6ec485f104a0 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:16.511386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb33c57-c1fc-4ce8-aa88-6ec485f104a0 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:16.516083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f475ec-6031-4b0f-8795-8a626c873aa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:16.516715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f475ec-6031-4b0f-8795-8a626c873aa7 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.516993 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f475ec-6031-4b0f-8795-8a626c873aa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.517265 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f475ec-6031-4b0f-8795-8a626c873aa7 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.517904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f475ec-6031-4b0f-8795-8a626c873aa7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:16.519804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93f475ec-6031-4b0f-8795-8a626c873aa7 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:16.549439 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1383/2758] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:16 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:16.553827 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee5a1f-1d25-43fe-aa2a-659bbe295b48 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:16.563599 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ee5a1f-1d25-43fe-aa2a-659bbe295b48 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:16.620386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829f44-fb3a-4ac3-8c4c-b2971212e7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:16.620985 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829f44-fb3a-4ac3-8c4c-b2971212e7ca admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.621261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829f44-fb3a-4ac3-8c4c-b2971212e7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.621531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc829f44-fb3a-4ac3-8c4c-b2971212e7ca admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.622161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc829f44-fb3a-4ac3-8c4c-b2971212e7ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:16.624057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc829f44-fb3a-4ac3-8c4c-b2971212e7ca admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:16.646619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1376/2759] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:16 2022] POST /identity/v3/users => generated 286 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:16.651068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f475ec-6031-4b0f-8795-8a626c873aa7 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:16.662088 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f475ec-6031-4b0f-8795-8a626c873aa7 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:16.666941 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a180f-fe36-4483-ba46-152fc1459bc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:16.667677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a180f-fe36-4483-ba46-152fc1459bc3 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.668070 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a180f-fe36-4483-ba46-152fc1459bc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.668406 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a2a180f-fe36-4483-ba46-152fc1459bc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.669308 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a180f-fe36-4483-ba46-152fc1459bc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:16.671266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a2a180f-fe36-4483-ba46-152fc1459bc3 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:16.682200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1384/2760] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:16.686400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829f44-fb3a-4ac3-8c4c-b2971212e7ca admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:16.696400 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc829f44-fb3a-4ac3-8c4c-b2971212e7ca admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:16.701386 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a63ad4-c1a0-462d-84b8-33c0f6448dcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:16.702000 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63ad4-c1a0-462d-84b8-33c0f6448dcd admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.702344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63ad4-c1a0-462d-84b8-33c0f6448dcd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.702582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a63ad4-c1a0-462d-84b8-33c0f6448dcd admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.703501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a63ad4-c1a0-462d-84b8-33c0f6448dcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:16.705160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a63ad4-c1a0-462d-84b8-33c0f6448dcd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:16.716172 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1377/2761] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:16.720483 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a180f-fe36-4483-ba46-152fc1459bc3 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:16.731189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a2a180f-fe36-4483-ba46-152fc1459bc3 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:16.735818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca1c6-c2a5-4a52-9d22-3c775e26cf98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:16.736494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca1c6-c2a5-4a52-9d22-3c775e26cf98 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.736773 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca1c6-c2a5-4a52-9d22-3c775e26cf98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.737048 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b9ca1c6-c2a5-4a52-9d22-3c775e26cf98 admin admin] PATH_INFO: `/v3/projects/a313d094dcf94c539beea9019d76bc73/users/546f44833b13462d8b16275a19620e97/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.751838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ca1c6-c2a5-4a52-9d22-3c775e26cf98 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a313d094dcf94c539beea9019d76bc73, user_id=546f44833b13462d8b16275a19620e97, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:16.755130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b9ca1c6-c2a5-4a52-9d22-3c775e26cf98 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:16.771139 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1385/2762] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:16 2022] PUT /identity/v3/projects/a313d094dcf94c539beea9019d76bc73/users/546f44833b13462d8b16275a19620e97/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:16.776362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fa2be-ca82-4e9e-a8d6-6233a0f232a0 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.776760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fa2be-ca82-4e9e-a8d6-6233a0f232a0 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.777039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-528fa2be-ca82-4e9e-a8d6-6233a0f232a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.795930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-528fa2be-ca82-4e9e-a8d6-6233a0f232a0 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:16.797145 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-528fa2be-ca82-4e9e-a8d6-6233a0f232a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:16.853205 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:16.862694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1378/2763] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:16.872445 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca1c6-c2a5-4a52-9d22-3c775e26cf98 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:16.874159 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9b9ca1c6-c2a5-4a52-9d22-3c775e26cf98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:16.883931 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:16.937811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b9ca1c6-c2a5-4a52-9d22-3c775e26cf98 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:16.941512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5d026-6875-4bcc-aa0c-5d170ec5dae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:16.942288 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5d026-6875-4bcc-aa0c-5d170ec5dae0 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:16.942878 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5d026-6875-4bcc-aa0c-5d170ec5dae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:16.943158 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc5d026-6875-4bcc-aa0c-5d170ec5dae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:16.951923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5d026-6875-4bcc-aa0c-5d170ec5dae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:16.953631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc5d026-6875-4bcc-aa0c-5d170ec5dae0 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:16.967700 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1386/2764] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:17.609382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7daf83-3496-4ba8-87b5-6830d3ec1763 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:17.609848 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7daf83-3496-4ba8-87b5-6830d3ec1763 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:17.610294 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7daf83-3496-4ba8-87b5-6830d3ec1763 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:17.648924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-dc7daf83-3496-4ba8-87b5-6830d3ec1763 None None] MFA Rules not processed for user `546f44833b13462d8b16275a19620e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:17.650261 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc7daf83-3496-4ba8-87b5-6830d3ec1763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:17.721681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1379/2765] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:17 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:17.732514 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5d026-6875-4bcc-aa0c-5d170ec5dae0 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:17.734189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0fc5d026-6875-4bcc-aa0c-5d170ec5dae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:17.799236 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc5d026-6875-4bcc-aa0c-5d170ec5dae0 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:17.803502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5141f294-38cd-4691-84f5-66fbb50a6abc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:17.804223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141f294-38cd-4691-84f5-66fbb50a6abc service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:17.804504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141f294-38cd-4691-84f5-66fbb50a6abc service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:17.804776 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5141f294-38cd-4691-84f5-66fbb50a6abc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:17.813604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141f294-38cd-4691-84f5-66fbb50a6abc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:17.815023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5141f294-38cd-4691-84f5-66fbb50a6abc service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:17.824298 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1387/2766] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:17 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:18.250124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7daf83-3496-4ba8-87b5-6830d3ec1763 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:18.251515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-dc7daf83-3496-4ba8-87b5-6830d3ec1763 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:18.264746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7daf83-3496-4ba8-87b5-6830d3ec1763 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:18.269321 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:18.269946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:18.270220 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:18.270486 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] PATH_INFO: `/v3/users/01f537889e6142eba3b277a903900bbb` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:18.271585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01f537889e6142eba3b277a903900bbb)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:18.273507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:18.320836 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01f537889e6142eba3b277a903900bbb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:18.321497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01f537889e6142eba3b277a903900bbb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:18.333648 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01f537889e6142eba3b277a903900bbb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:18.334275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01f537889e6142eba3b277a903900bbb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:18.341195 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01f537889e6142eba3b277a903900bbb'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:18.356482 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1380/2767] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:18 2022] DELETE /identity/v3/users/01f537889e6142eba3b277a903900bbb => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:33:18.360964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709d10-cc90-4d5e-a7d5-3736b808c1f1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:18.361250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709d10-cc90-4d5e-a7d5-3736b808c1f1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:18.361527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95709d10-cc90-4d5e-a7d5-3736b808c1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:18.381246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-95709d10-cc90-4d5e-a7d5-3736b808c1f1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:18.382453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-95709d10-cc90-4d5e-a7d5-3736b808c1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:18.441541 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1388/2768] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:18.451707 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:18.453411 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:18.513965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf70d6a2-bbb2-46f8-a12f-c334ab39c302 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:18.525819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6875c8c-43c5-4125-b6c6-2f3435c65df1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:18.526477 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875c8c-43c5-4125-b6c6-2f3435c65df1 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:18.526760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875c8c-43c5-4125-b6c6-2f3435c65df1 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:18.527033 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6875c8c-43c5-4125-b6c6-2f3435c65df1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:18.537500 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6875c8c-43c5-4125-b6c6-2f3435c65df1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:18.538942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6875c8c-43c5-4125-b6c6-2f3435c65df1 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:18.548507 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1381/2769] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:18.819712 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95709d10-cc90-4d5e-a7d5-3736b808c1f1 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:18.821189 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-95709d10-cc90-4d5e-a7d5-3736b808c1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:18.834108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95709d10-cc90-4d5e-a7d5-3736b808c1f1 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:18.838730 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:18.839365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:18.839643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:18.839929 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] PATH_INFO: `/v3/projects/fec2f21c769d474ba6041c5230741782` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:18.841056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] RBAC: Authorizing `identity:delete_project(project_id=fec2f21c769d474ba6041c5230741782)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:18.843065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:18.891939 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:18.893267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fec2f21c769d474ba6041c5230741782', 'request_id': 'req-19b1f38c-d1cd-42b5-aee0-704d1dee457a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:18.900665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fec2f21c769d474ba6041c5230741782', 'request_id': 'req-19b1f38c-d1cd-42b5-aee0-704d1dee457a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:18.906425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fec2f21c769d474ba6041c5230741782', 'request_id': 'req-19b1f38c-d1cd-42b5-aee0-704d1dee457a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:18.921130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] The token cache is being invalidate because project fec2f21c769d474ba6041c5230741782 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:18.921424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:18.922085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-19b1f38c-d1cd-42b5-aee0-704d1dee457a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:18.923590 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1389/2770] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:18 2022] DELETE /identity/v3/projects/fec2f21c769d474ba6041c5230741782 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:18.929228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5a699-8892-45b4-867d-1824a53af285 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:18.930256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5a699-8892-45b4-867d-1824a53af285 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:18.930853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ae5a699-8892-45b4-867d-1824a53af285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:18.939792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:18.953590 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-2ae5a699-8892-45b4-867d-1824a53af285 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:18.954800 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2ae5a699-8892-45b4-867d-1824a53af285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:19.015953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1382/2771] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:19.024213 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079f98f-5767-4e85-a160-06cc33953591 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.024505 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079f98f-5767-4e85-a160-06cc33953591 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.024784 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9079f98f-5767-4e85-a160-06cc33953591 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.044573 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-9079f98f-5767-4e85-a160-06cc33953591 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:19.045786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-9079f98f-5767-4e85-a160-06cc33953591 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:19.054106 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1390/2772] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:19.058460 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5a699-8892-45b4-867d-1824a53af285 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:19.068393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ae5a699-8892-45b4-867d-1824a53af285 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:19.073732 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a72f4-f54c-4ca6-958a-687428c2dc4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:19.074430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a72f4-f54c-4ca6-958a-687428c2dc4e admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.074712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a72f4-f54c-4ca6-958a-687428c2dc4e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.075110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0a72f4-f54c-4ca6-958a-687428c2dc4e admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.075818 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a72f4-f54c-4ca6-958a-687428c2dc4e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:33:19.076125 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a72f4-f54c-4ca6-958a-687428c2dc4e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:19.077809 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0a72f4-f54c-4ca6-958a-687428c2dc4e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:19.090633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1383/2773] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:33:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:33:19.095055 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079f98f-5767-4e85-a160-06cc33953591 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:19.104520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9079f98f-5767-4e85-a160-06cc33953591 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:19.109280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-847919fe-5945-4857-af0b-9686c0e45f43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:19.109887 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847919fe-5945-4857-af0b-9686c0e45f43 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.110197 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847919fe-5945-4857-af0b-9686c0e45f43 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.110475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-847919fe-5945-4857-af0b-9686c0e45f43 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.111120 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847919fe-5945-4857-af0b-9686c0e45f43 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:19.113602 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-847919fe-5945-4857-af0b-9686c0e45f43 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:19.142291 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1391/2774] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:19 2022] POST /identity/v3/projects => generated 377 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:19.146762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a72f4-f54c-4ca6-958a-687428c2dc4e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:19.157636 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0a72f4-f54c-4ca6-958a-687428c2dc4e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:19.209068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4813b-7f48-48fc-b933-be9419e7f3d9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.209617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4813b-7f48-48fc-b933-be9419e7f3d9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.209751 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d4813b-7f48-48fc-b933-be9419e7f3d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.225098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425243-de2f-4e3d-a3e4-f4ea17c0b4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:19.225987 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425243-de2f-4e3d-a3e4-f4ea17c0b4c9 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.226264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425243-de2f-4e3d-a3e4-f4ea17c0b4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.226666 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b425243-de2f-4e3d-a3e4-f4ea17c0b4c9 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.227327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b425243-de2f-4e3d-a3e4-f4ea17c0b4c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:19.229270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b425243-de2f-4e3d-a3e4-f4ea17c0b4c9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:19.229380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-d4d4813b-7f48-48fc-b933-be9419e7f3d9 None None] MFA Rules not processed for user `546f44833b13462d8b16275a19620e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:19.230604 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d4d4813b-7f48-48fc-b933-be9419e7f3d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:19.252414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1384/2775] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:19 2022] POST /identity/v3/users => generated 289 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:19.257005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425243-de2f-4e3d-a3e4-f4ea17c0b4c9 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:19.267248 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b425243-de2f-4e3d-a3e4-f4ea17c0b4c9 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:19.273333 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19960cc-3d2d-4fe7-9497-8044b4adf9ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:19.273954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19960cc-3d2d-4fe7-9497-8044b4adf9ce admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.274233 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19960cc-3d2d-4fe7-9497-8044b4adf9ce admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.274506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a19960cc-3d2d-4fe7-9497-8044b4adf9ce admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.275149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19960cc-3d2d-4fe7-9497-8044b4adf9ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:19.276816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a19960cc-3d2d-4fe7-9497-8044b4adf9ce admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:19.288694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1385/2776] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:33:19.293407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19960cc-3d2d-4fe7-9497-8044b4adf9ce admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:19.296892 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1392/2777] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:19.305329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a19960cc-3d2d-4fe7-9497-8044b4adf9ce admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:19.310048 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e787d1-63c9-470b-b74b-cfa7767c7b87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:19.311147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e787d1-63c9-470b-b74b-cfa7767c7b87 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.311147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e787d1-63c9-470b-b74b-cfa7767c7b87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.311322 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e787d1-63c9-470b-b74b-cfa7767c7b87 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.311926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e787d1-63c9-470b-b74b-cfa7767c7b87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:19.313656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e787d1-63c9-470b-b74b-cfa7767c7b87 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:19.324701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1386/2778] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:33:19.329067 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4813b-7f48-48fc-b933-be9419e7f3d9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:19.349128 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d4813b-7f48-48fc-b933-be9419e7f3d9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:19.354983 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308825f5-79c0-42fe-a6d0-b9702590edf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:19.355653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308825f5-79c0-42fe-a6d0-b9702590edf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.355933 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308825f5-79c0-42fe-a6d0-b9702590edf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.356412 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308825f5-79c0-42fe-a6d0-b9702590edf1 admin admin] PATH_INFO: `/v3/projects/29c01e9a15cf463aad45b1ed51236901/users/38e9ea7a876c4c8685fc40cdb8a72d8b/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.376823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308825f5-79c0-42fe-a6d0-b9702590edf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=29c01e9a15cf463aad45b1ed51236901, user_id=38e9ea7a876c4c8685fc40cdb8a72d8b, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:19.380294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308825f5-79c0-42fe-a6d0-b9702590edf1 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:19.395597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1393/2779] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:19 2022] PUT /identity/v3/projects/29c01e9a15cf463aad45b1ed51236901/users/38e9ea7a876c4c8685fc40cdb8a72d8b/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:19.405958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759134a7-df98-4ff7-81db-50e1e1db0189 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.406492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759134a7-df98-4ff7-81db-50e1e1db0189 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.406927 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-759134a7-df98-4ff7-81db-50e1e1db0189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.436992 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-759134a7-df98-4ff7-81db-50e1e1db0189 None None] MFA Rules not processed for user `38e9ea7a876c4c8685fc40cdb8a72d8b`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:19.438219 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-759134a7-df98-4ff7-81db-50e1e1db0189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:19.496604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:19.522362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1387/2780] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:19 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:19.549032 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308825f5-79c0-42fe-a6d0-b9702590edf1 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:19.555915 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-308825f5-79c0-42fe-a6d0-b9702590edf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:19.582873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759134a7-df98-4ff7-81db-50e1e1db0189 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:19.584305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-759134a7-df98-4ff7-81db-50e1e1db0189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:19.624496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308825f5-79c0-42fe-a6d0-b9702590edf1 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:19.631638 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cef5c1-812c-443a-9ab2-7d63f022aad8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:19.632643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef5c1-812c-443a-9ab2-7d63f022aad8 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.632918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef5c1-812c-443a-9ab2-7d63f022aad8 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.633193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cef5c1-812c-443a-9ab2-7d63f022aad8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.642480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cef5c1-812c-443a-9ab2-7d63f022aad8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:19.643946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cef5c1-812c-443a-9ab2-7d63f022aad8 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:19.653157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1394/2781] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:19 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:19.655950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-759134a7-df98-4ff7-81db-50e1e1db0189 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:19.660198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40d955f-bd44-4aa0-b5eb-ce759b43cf40 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:19.660821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d955f-bd44-4aa0-b5eb-ce759b43cf40 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:19.661103 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d955f-bd44-4aa0-b5eb-ce759b43cf40 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:19.661380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40d955f-bd44-4aa0-b5eb-ce759b43cf40 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:19.663129 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b40d955f-bd44-4aa0-b5eb-ce759b43cf40 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:19.679081 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d955f-bd44-4aa0-b5eb-ce759b43cf40 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:19.680842 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40d955f-bd44-4aa0-b5eb-ce759b43cf40 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:19.691974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1388/2782] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:19 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:33:29.649243 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=80,keystone:DELETE=3,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:29.686772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=31 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:31.396428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cef5c1-812c-443a-9ab2-7d63f022aad8 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:31.468721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cef5c1-812c-443a-9ab2-7d63f022aad8 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:31.478422 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:31.479292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:31.479647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:31.479932 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] PATH_INFO: `/v3/users/38e9ea7a876c4c8685fc40cdb8a72d8b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:31.481313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38e9ea7a876c4c8685fc40cdb8a72d8b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:31.483361 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:31.536468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38e9ea7a876c4c8685fc40cdb8a72d8b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:31.537144 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38e9ea7a876c4c8685fc40cdb8a72d8b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:31.537843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38e9ea7a876c4c8685fc40cdb8a72d8b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:31.545411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38e9ea7a876c4c8685fc40cdb8a72d8b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:31.559019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38e9ea7a876c4c8685fc40cdb8a72d8b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:31.573207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1395/2783] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:31 2022] DELETE /identity/v3/users/38e9ea7a876c4c8685fc40cdb8a72d8b => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:31.578162 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921e943-8f78-4bd5-9548-7b9fb1c3d7aa None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:31.578676 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921e943-8f78-4bd5-9548-7b9fb1c3d7aa None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:31.578798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6921e943-8f78-4bd5-9548-7b9fb1c3d7aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:31.599013 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-6921e943-8f78-4bd5-9548-7b9fb1c3d7aa None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:31.600668 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6921e943-8f78-4bd5-9548-7b9fb1c3d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:31.662445 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1389/2784] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:31.671956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:31.673509 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:31.731312 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323c228a-0418-4c48-9680-6cc79a1d86a0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:31.735098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-101807b3-6428-4709-89b4-fd3871c8c23a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:31.735702 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101807b3-6428-4709-89b4-fd3871c8c23a service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:31.735991 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101807b3-6428-4709-89b4-fd3871c8c23a service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:31.736313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-101807b3-6428-4709-89b4-fd3871c8c23a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:31.745968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101807b3-6428-4709-89b4-fd3871c8c23a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:31.747380 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-101807b3-6428-4709-89b4-fd3871c8c23a service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:31.756877 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1396/2785] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:32.021875 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921e943-8f78-4bd5-9548-7b9fb1c3d7aa None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:32.023300 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-6921e943-8f78-4bd5-9548-7b9fb1c3d7aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:32.035492 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6921e943-8f78-4bd5-9548-7b9fb1c3d7aa None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:32.040328 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:32.040956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.041238 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.041514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] PATH_INFO: `/v3/projects/29c01e9a15cf463aad45b1ed51236901` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.042640 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=29c01e9a15cf463aad45b1ed51236901)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:32.044587 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:32.092398 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29c01e9a15cf463aad45b1ed51236901', 'request_id': 'req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:32.098480 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29c01e9a15cf463aad45b1ed51236901', 'request_id': 'req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:32.105199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29c01e9a15cf463aad45b1ed51236901', 'request_id': 'req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:32.117517 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] The token cache is being invalidate because project 29c01e9a15cf463aad45b1ed51236901 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:32.117806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:32.118446 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-e0ac8c2f-b730-4e1c-9256-c532ac3db6cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:32.119925 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1390/2786] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:32 2022] DELETE /identity/v3/projects/29c01e9a15cf463aad45b1ed51236901 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:32.182275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98464-d3e6-433b-8e2c-4bd822e40d07 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.182562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98464-d3e6-433b-8e2c-4bd822e40d07 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.182843 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db98464-d3e6-433b-8e2c-4bd822e40d07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.203173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0db98464-d3e6-433b-8e2c-4bd822e40d07 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:32.204421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0db98464-d3e6-433b-8e2c-4bd822e40d07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:32.223275 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:32.266536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1397/2787] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:32.274617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363157ee-bd9f-47ba-9860-ae1af957c4bd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.274906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363157ee-bd9f-47ba-9860-ae1af957c4bd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.275213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-363157ee-bd9f-47ba-9860-ae1af957c4bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.295054 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-363157ee-bd9f-47ba-9860-ae1af957c4bd None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:32.296309 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-363157ee-bd9f-47ba-9860-ae1af957c4bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:32.304182 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1391/2788] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:32.308455 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98464-d3e6-433b-8e2c-4bd822e40d07 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:32.318613 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db98464-d3e6-433b-8e2c-4bd822e40d07 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:32.323142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b836684-29d6-49d0-8283-8310b4e136ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:32.323727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b836684-29d6-49d0-8283-8310b4e136ee admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.324009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b836684-29d6-49d0-8283-8310b4e136ee admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.324313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b836684-29d6-49d0-8283-8310b4e136ee admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.324988 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b836684-29d6-49d0-8283-8310b4e136ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:33:32.325294 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b836684-29d6-49d0-8283-8310b4e136ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:32.326913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b836684-29d6-49d0-8283-8310b4e136ee admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:32.339149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1398/2789] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:33:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:33:32.343286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363157ee-bd9f-47ba-9860-ae1af957c4bd None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:32.352645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-363157ee-bd9f-47ba-9860-ae1af957c4bd None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:32.357276 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed44a82-a0cb-46da-9f1c-0dea058a0300 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:32.357878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed44a82-a0cb-46da-9f1c-0dea058a0300 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.358155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed44a82-a0cb-46da-9f1c-0dea058a0300 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.358428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed44a82-a0cb-46da-9f1c-0dea058a0300 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.359066 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed44a82-a0cb-46da-9f1c-0dea058a0300 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:32.360988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed44a82-a0cb-46da-9f1c-0dea058a0300 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:32.392260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1392/2790] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:32 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:32.394904 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b836684-29d6-49d0-8283-8310b4e136ee admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:32.404882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b836684-29d6-49d0-8283-8310b4e136ee admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:32.463865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91f356-0440-4ed9-bb1e-f1ef080b00b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:32.464521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91f356-0440-4ed9-bb1e-f1ef080b00b5 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.464828 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91f356-0440-4ed9-bb1e-f1ef080b00b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.465104 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa91f356-0440-4ed9-bb1e-f1ef080b00b5 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.465837 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91f356-0440-4ed9-bb1e-f1ef080b00b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:32.467769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa91f356-0440-4ed9-bb1e-f1ef080b00b5 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:32.500861 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1399/2791] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:32 2022] POST /identity/v3/users => generated 287 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:32.502078 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed44a82-a0cb-46da-9f1c-0dea058a0300 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:32.513678 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed44a82-a0cb-46da-9f1c-0dea058a0300 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:32.518555 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83a213-cf97-4e81-aca2-3d95472453af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:32.519287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83a213-cf97-4e81-aca2-3d95472453af admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.519571 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83a213-cf97-4e81-aca2-3d95472453af admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.519841 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e83a213-cf97-4e81-aca2-3d95472453af admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.520525 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83a213-cf97-4e81-aca2-3d95472453af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:32.522109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e83a213-cf97-4e81-aca2-3d95472453af admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:32.535407 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1393/2792] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:32.537896 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91f356-0440-4ed9-bb1e-f1ef080b00b5 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:32.549841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa91f356-0440-4ed9-bb1e-f1ef080b00b5 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:32.554491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc45d7b-9c43-4040-819d-ffb542ff258d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:32.555094 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45d7b-9c43-4040-819d-ffb542ff258d admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.555381 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45d7b-9c43-4040-819d-ffb542ff258d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.555641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc45d7b-9c43-4040-819d-ffb542ff258d admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.556321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc45d7b-9c43-4040-819d-ffb542ff258d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:32.557916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc45d7b-9c43-4040-819d-ffb542ff258d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:32.569786 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1400/2793] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:32.574019 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83a213-cf97-4e81-aca2-3d95472453af admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:32.585211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e83a213-cf97-4e81-aca2-3d95472453af admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:32.590228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9713b85-3f02-414e-873c-29854f04b21f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:32.590874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9713b85-3f02-414e-873c-29854f04b21f admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.591154 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9713b85-3f02-414e-873c-29854f04b21f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.591428 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9713b85-3f02-414e-873c-29854f04b21f admin admin] PATH_INFO: `/v3/projects/7558486d41cd44c8ad22a58404577684/users/b338cef9e011475984776b03e6952f4c/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.606301 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9713b85-3f02-414e-873c-29854f04b21f admin admin] RBAC: Authorizing `identity:create_grant(project_id=7558486d41cd44c8ad22a58404577684, user_id=b338cef9e011475984776b03e6952f4c, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:32.608917 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9713b85-3f02-414e-873c-29854f04b21f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:32.623569 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1394/2794] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:32 2022] PUT /identity/v3/projects/7558486d41cd44c8ad22a58404577684/users/b338cef9e011475984776b03e6952f4c/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:32.635156 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687263-4259-4f48-9a2a-80cc960bc5a1 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.635544 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687263-4259-4f48-9a2a-80cc960bc5a1 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.635942 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a687263-4259-4f48-9a2a-80cc960bc5a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.666889 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5a687263-4259-4f48-9a2a-80cc960bc5a1 None None] MFA Rules not processed for user `b338cef9e011475984776b03e6952f4c`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:32.668359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5a687263-4259-4f48-9a2a-80cc960bc5a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:32.744319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1401/2795] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:33:32.756286 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9713b85-3f02-414e-873c-29854f04b21f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:32.758003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b9713b85-3f02-414e-873c-29854f04b21f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:32.780204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:32.828409 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9713b85-3f02-414e-873c-29854f04b21f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:32.832194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8ab21-50ee-4e2e-bb85-09e954c425bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:32.832803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ab21-50ee-4e2e-bb85-09e954c425bf service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:32.833083 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ab21-50ee-4e2e-bb85-09e954c425bf service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:32.833380 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b8ab21-50ee-4e2e-bb85-09e954c425bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:32.841515 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8ab21-50ee-4e2e-bb85-09e954c425bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:32.842936 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b8ab21-50ee-4e2e-bb85-09e954c425bf service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:32.851471 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1395/2796] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:32 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:34.993945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a482-4411-4a5f-8090-b2ac3a85e85c None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:34.994417 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a482-4411-4a5f-8090-b2ac3a85e85c None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:34.994533 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b067a482-4411-4a5f-8090-b2ac3a85e85c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:35.013488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b067a482-4411-4a5f-8090-b2ac3a85e85c None None] MFA Rules not processed for user `546f44833b13462d8b16275a19620e97`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:35.014743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b067a482-4411-4a5f-8090-b2ac3a85e85c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:35.026940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:35.076914 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1402/2797] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:34 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:35.871342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8ab21-50ee-4e2e-bb85-09e954c425bf service cinder] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:35.942954 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b8ab21-50ee-4e2e-bb85-09e954c425bf service cinder] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:35.948022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:35.948779 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:35.949110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:35.949367 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] PATH_INFO: `/v3/users/b338cef9e011475984776b03e6952f4c` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:35.950829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b338cef9e011475984776b03e6952f4c)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:35.953601 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:36.011207 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b338cef9e011475984776b03e6952f4c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:36.012041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b338cef9e011475984776b03e6952f4c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:36.026453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b338cef9e011475984776b03e6952f4c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:36.027192 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b338cef9e011475984776b03e6952f4c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:36.035038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b338cef9e011475984776b03e6952f4c'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:36.047408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1396/2798] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:35 2022] DELETE /identity/v3/users/b338cef9e011475984776b03e6952f4c => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:36.052194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d411-a60c-4688-b2bd-10931fde9d7a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:36.052655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d411-a60c-4688-b2bd-10931fde9d7a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:36.052787 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca77d411-a60c-4688-b2bd-10931fde9d7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:36.072748 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-ca77d411-a60c-4688-b2bd-10931fde9d7a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:36.074038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ca77d411-a60c-4688-b2bd-10931fde9d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:36.137186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1403/2799] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:36.147528 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:36.149218 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:36.198698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:36.212084 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3823a8-433f-4a1f-9303-5a0af2f01661 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:36.215883 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacbe38-6816-4e3a-b16b-b3e2a5766eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:36.216530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacbe38-6816-4e3a-b16b-b3e2a5766eea service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:36.216816 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacbe38-6816-4e3a-b16b-b3e2a5766eea service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:36.217088 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acacbe38-6816-4e3a-b16b-b3e2a5766eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:36.226733 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacbe38-6816-4e3a-b16b-b3e2a5766eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:36.228196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acacbe38-6816-4e3a-b16b-b3e2a5766eea service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:36.238890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1397/2800] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:36.523324 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77d411-a60c-4688-b2bd-10931fde9d7a None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:36.524794 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ca77d411-a60c-4688-b2bd-10931fde9d7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:36.537069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca77d411-a60c-4688-b2bd-10931fde9d7a None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:36.542097 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:36.542768 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:36.543053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:36.543329 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] PATH_INFO: `/v3/projects/7558486d41cd44c8ad22a58404577684` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:36.544518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7558486d41cd44c8ad22a58404577684)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:36.546719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:36.594122 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7558486d41cd44c8ad22a58404577684', 'request_id': 'req-5cf48bda-8b02-44ab-997c-4c7910a3c644'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:36.600414 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7558486d41cd44c8ad22a58404577684', 'request_id': 'req-5cf48bda-8b02-44ab-997c-4c7910a3c644'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:36.606077 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7558486d41cd44c8ad22a58404577684', 'request_id': 'req-5cf48bda-8b02-44ab-997c-4c7910a3c644'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:36.618508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] The token cache is being invalidate because project 7558486d41cd44c8ad22a58404577684 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:36.618802 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:36.619409 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5cf48bda-8b02-44ab-997c-4c7910a3c644 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:36.620937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1404/2801] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:36 2022] DELETE /identity/v3/projects/7558486d41cd44c8ad22a58404577684 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:37.048526 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacbe38-6816-4e3a-b16b-b3e2a5766eea service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:37.049957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-acacbe38-6816-4e3a-b16b-b3e2a5766eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:37.064296 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acacbe38-6816-4e3a-b16b-b3e2a5766eea service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:37.122808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:37.123436 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:37.123716 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:37.123986 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] PATH_INFO: `/v3/users/3bbc12cb9a5b4a0593c5b3e7a46350db` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:37.125144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bbc12cb9a5b4a0593c5b3e7a46350db)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:37.127050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:37.173942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bbc12cb9a5b4a0593c5b3e7a46350db'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:37.175175 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bbc12cb9a5b4a0593c5b3e7a46350db'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:37.187818 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bbc12cb9a5b4a0593c5b3e7a46350db'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:37.188531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bbc12cb9a5b4a0593c5b3e7a46350db'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:37.196989 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bbc12cb9a5b4a0593c5b3e7a46350db'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:37.210312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1398/2802] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:37 2022] DELETE /identity/v3/users/3bbc12cb9a5b4a0593c5b3e7a46350db => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:37.215716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba0182-f418-4a23-91d8-059244ef30d9 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:37.216229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba0182-f418-4a23-91d8-059244ef30d9 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:37.216421 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba0182-f418-4a23-91d8-059244ef30d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:37.235916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-45ba0182-f418-4a23-91d8-059244ef30d9 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:37.237713 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-45ba0182-f418-4a23-91d8-059244ef30d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:37.280810 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:37.304126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1405/2803] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:37.314764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:37.316762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:37.374828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d701c389-c081-44f7-a326-fa827f62b65a admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:37.379038 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a320c2-8128-4975-95bd-12f8072a853f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:37.379645 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a320c2-8128-4975-95bd-12f8072a853f service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:37.379926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a320c2-8128-4975-95bd-12f8072a853f service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:37.380228 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a320c2-8128-4975-95bd-12f8072a853f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:37.389458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a320c2-8128-4975-95bd-12f8072a853f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:37.390907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a320c2-8128-4975-95bd-12f8072a853f service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:37.400573 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1399/2804] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:37.691472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba0182-f418-4a23-91d8-059244ef30d9 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:37.692959 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-45ba0182-f418-4a23-91d8-059244ef30d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:37.706215 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ba0182-f418-4a23-91d8-059244ef30d9 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:37.711309 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:37.711967 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:37.712286 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:37.712570 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] PATH_INFO: `/v3/projects/47a0d571f687453f9eaa903d529b39b5` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:37.713734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=47a0d571f687453f9eaa903d529b39b5)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:37.715704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:37.775193 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '47a0d571f687453f9eaa903d529b39b5', 'request_id': 'req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:37.782010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '47a0d571f687453f9eaa903d529b39b5', 'request_id': 'req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:37.788609 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '47a0d571f687453f9eaa903d529b39b5', 'request_id': 'req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:37.812307 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] The token cache is being invalidate because project 47a0d571f687453f9eaa903d529b39b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:37.812729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:37.813660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-588dc76f-0a1d-4afc-8f93-c15e4f6085f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:37.818448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1406/2805] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:37 2022] DELETE /identity/v3/projects/47a0d571f687453f9eaa903d529b39b5 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:37.820185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efa29c-16b7-4ff9-a0bc-d8b396f6b7ee None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:37.820484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efa29c-16b7-4ff9-a0bc-d8b396f6b7ee None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:37.820768 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7efa29c-16b7-4ff9-a0bc-d8b396f6b7ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:37.835125 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:37.842673 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e7efa29c-16b7-4ff9-a0bc-d8b396f6b7ee None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:37.844948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e7efa29c-16b7-4ff9-a0bc-d8b396f6b7ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:37.916941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1400/2806] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:37.924718 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0117de7-e0ab-457e-aa77-6796290996b6 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:37.925009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0117de7-e0ab-457e-aa77-6796290996b6 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:37.925343 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0117de7-e0ab-457e-aa77-6796290996b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:37.946859 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-b0117de7-e0ab-457e-aa77-6796290996b6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:37.947682 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b0117de7-e0ab-457e-aa77-6796290996b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:37.960973 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1407/2807] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:37.962255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efa29c-16b7-4ff9-a0bc-d8b396f6b7ee None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:37.973720 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7efa29c-16b7-4ff9-a0bc-d8b396f6b7ee None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:37.979305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589cf60-56b8-43e5-b51e-3492197bc0d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:37.979852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cf60-56b8-43e5-b51e-3492197bc0d8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:37.980749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cf60-56b8-43e5-b51e-3492197bc0d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:37.980749 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7589cf60-56b8-43e5-b51e-3492197bc0d8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:37.981390 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589cf60-56b8-43e5-b51e-3492197bc0d8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:33:37.981703 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589cf60-56b8-43e5-b51e-3492197bc0d8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:37.983468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7589cf60-56b8-43e5-b51e-3492197bc0d8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:38.001057 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1401/2808] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:33:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:33:38.002652 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0117de7-e0ab-457e-aa77-6796290996b6 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:38.014363 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0117de7-e0ab-457e-aa77-6796290996b6 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:38.021411 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51127e-4879-4d7b-af5e-0d08622955d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:38.022031 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51127e-4879-4d7b-af5e-0d08622955d8 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:38.022313 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51127e-4879-4d7b-af5e-0d08622955d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:38.022594 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff51127e-4879-4d7b-af5e-0d08622955d8 admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:38.023254 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51127e-4879-4d7b-af5e-0d08622955d8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:38.025289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff51127e-4879-4d7b-af5e-0d08622955d8 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:38.060558 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1408/2809] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:38 2022] POST /identity/v3/projects => generated 375 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:38.064382 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589cf60-56b8-43e5-b51e-3492197bc0d8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:38.075095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7589cf60-56b8-43e5-b51e-3492197bc0d8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:38.138965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6d15-743b-494e-ada9-00725b44d2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:38.139760 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6d15-743b-494e-ada9-00725b44d2a2 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:38.140516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6d15-743b-494e-ada9-00725b44d2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:38.140516 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57de6d15-743b-494e-ada9-00725b44d2a2 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:38.141306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de6d15-743b-494e-ada9-00725b44d2a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:38.143890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57de6d15-743b-494e-ada9-00725b44d2a2 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:38.169419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1402/2810] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:38 2022] POST /identity/v3/users => generated 288 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:38.173964 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51127e-4879-4d7b-af5e-0d08622955d8 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:38.185903 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff51127e-4879-4d7b-af5e-0d08622955d8 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:38.191085 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144dab-0637-4196-a896-6eca79609101 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:38.191692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144dab-0637-4196-a896-6eca79609101 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:38.191968 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144dab-0637-4196-a896-6eca79609101 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:38.192264 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11144dab-0637-4196-a896-6eca79609101 admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:38.192907 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11144dab-0637-4196-a896-6eca79609101 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:38.194662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11144dab-0637-4196-a896-6eca79609101 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:38.206090 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1409/2811] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:38.210183 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6d15-743b-494e-ada9-00725b44d2a2 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:38.219971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57de6d15-743b-494e-ada9-00725b44d2a2 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:38.225119 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7addaf1-5132-4517-b20a-14a1e6d47d56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:38.225714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7addaf1-5132-4517-b20a-14a1e6d47d56 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:38.226151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7addaf1-5132-4517-b20a-14a1e6d47d56 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:38.226430 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7addaf1-5132-4517-b20a-14a1e6d47d56 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:38.227064 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7addaf1-5132-4517-b20a-14a1e6d47d56 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:38.228710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7addaf1-5132-4517-b20a-14a1e6d47d56 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:38.240265 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1403/2812] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:38.243626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144dab-0637-4196-a896-6eca79609101 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:38.254413 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11144dab-0637-4196-a896-6eca79609101 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:38.259274 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72534462-e42c-4c69-a3af-d0605f90f71f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:38.260137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534462-e42c-4c69-a3af-d0605f90f71f admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:38.260460 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534462-e42c-4c69-a3af-d0605f90f71f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:38.260734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72534462-e42c-4c69-a3af-d0605f90f71f admin admin] PATH_INFO: `/v3/projects/29f2c6c3dc7742f29eedb8d8634fcefe/users/a01ff22ede914ddb809dcec723550342/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:38.278147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72534462-e42c-4c69-a3af-d0605f90f71f admin admin] RBAC: Authorizing `identity:create_grant(project_id=29f2c6c3dc7742f29eedb8d8634fcefe, user_id=a01ff22ede914ddb809dcec723550342, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:38.280879 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72534462-e42c-4c69-a3af-d0605f90f71f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:38.295560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1410/2813] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:38 2022] PUT /identity/v3/projects/29f2c6c3dc7742f29eedb8d8634fcefe/users/a01ff22ede914ddb809dcec723550342/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:33:38.306342 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70c00-451c-4753-baa8-747ccb4997ec None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:38.307155 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70c00-451c-4753-baa8-747ccb4997ec None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:38.307501 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b70c00-451c-4753-baa8-747ccb4997ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:38.336937 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e7b70c00-451c-4753-baa8-747ccb4997ec None None] MFA Rules not processed for user `a01ff22ede914ddb809dcec723550342`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:38.338213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e7b70c00-451c-4753-baa8-747ccb4997ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:38.409993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1404/2814] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:38.420765 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72534462-e42c-4c69-a3af-d0605f90f71f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:38.422441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-72534462-e42c-4c69-a3af-d0605f90f71f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:38.487848 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72534462-e42c-4c69-a3af-d0605f90f71f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:38.491633 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b381c13-ad2b-4ef6-b31d-d7fc317132e9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:38.492292 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381c13-ad2b-4ef6-b31d-d7fc317132e9 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:38.492577 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381c13-ad2b-4ef6-b31d-d7fc317132e9 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:38.492884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b381c13-ad2b-4ef6-b31d-d7fc317132e9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:38.501699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b381c13-ad2b-4ef6-b31d-d7fc317132e9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:38.503668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b381c13-ad2b-4ef6-b31d-d7fc317132e9 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:38.512630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1411/2815] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:38 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:48.406359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:48.480221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b70c00-451c-4753-baa8-747ccb4997ec None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:48.508521 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:48.550141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b70c00-451c-4753-baa8-747ccb4997ec None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:48.554803 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:48.555439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:48.555719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:48.556002 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] PATH_INFO: `/v3/users/a01ff22ede914ddb809dcec723550342` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:48.557165 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a01ff22ede914ddb809dcec723550342)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:48.559096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:48.621596 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a01ff22ede914ddb809dcec723550342'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:48.622338 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a01ff22ede914ddb809dcec723550342'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:48.634664 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a01ff22ede914ddb809dcec723550342'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:48.635341 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a01ff22ede914ddb809dcec723550342'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:48.642384 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a01ff22ede914ddb809dcec723550342'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:48.655663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1405/2816] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:33:48 2022] DELETE /identity/v3/users/a01ff22ede914ddb809dcec723550342 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:48.660338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6d37-c4a5-4509-87ce-393d8aff18fa None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:48.660677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6d37-c4a5-4509-87ce-393d8aff18fa None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:48.660980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beff6d37-c4a5-4509-87ce-393d8aff18fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:48.682672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-beff6d37-c4a5-4509-87ce-393d8aff18fa None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:48.683901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-beff6d37-c4a5-4509-87ce-393d8aff18fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:48.750956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1412/2817] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:48.761423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:48.762948 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:48.829575 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c78648-3c33-4c39-8ae7-323f1b001dd5 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:48.833282 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bf879-1f8e-4da4-8aa3-b76cadef18d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:48.833958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bf879-1f8e-4da4-8aa3-b76cadef18d8 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:48.834243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bf879-1f8e-4da4-8aa3-b76cadef18d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:48.834514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4bf879-1f8e-4da4-8aa3-b76cadef18d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:48.844414 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bf879-1f8e-4da4-8aa3-b76cadef18d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:48.846538 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4bf879-1f8e-4da4-8aa3-b76cadef18d8 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:48.859364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1406/2818] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:49.256481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff6d37-c4a5-4509-87ce-393d8aff18fa None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:49.258508 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-beff6d37-c4a5-4509-87ce-393d8aff18fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:49.380741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beff6d37-c4a5-4509-87ce-393d8aff18fa None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:49.390100 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada1e4da-74db-47ff-939c-728d38b5709d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:49.390811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e4da-74db-47ff-939c-728d38b5709d service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:49.391199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e4da-74db-47ff-939c-728d38b5709d service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:49.392040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada1e4da-74db-47ff-939c-728d38b5709d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:49.396223 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ada1e4da-74db-47ff-939c-728d38b5709d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:49.414689 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e4da-74db-47ff-939c-728d38b5709d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:49.417635 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada1e4da-74db-47ff-939c-728d38b5709d service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:49.461492 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1413/2819] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:49 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:49.473551 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bf879-1f8e-4da4-8aa3-b76cadef18d8 service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:49.475211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-0f4bf879-1f8e-4da4-8aa3-b76cadef18d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:49.490736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4bf879-1f8e-4da4-8aa3-b76cadef18d8 service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:49.496592 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:49.497371 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:49.497814 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:49.498065 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] PATH_INFO: `/v3/projects/29f2c6c3dc7742f29eedb8d8634fcefe` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:49.499256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=29f2c6c3dc7742f29eedb8d8634fcefe)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:49.501221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:49.522287 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:49.588874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '29f2c6c3dc7742f29eedb8d8634fcefe', 'request_id': 'req-b625f394-74e1-43b2-b642-0fbc24d07b63'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:49.596836 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '29f2c6c3dc7742f29eedb8d8634fcefe', 'request_id': 'req-b625f394-74e1-43b2-b642-0fbc24d07b63'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:49.639508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '29f2c6c3dc7742f29eedb8d8634fcefe', 'request_id': 'req-b625f394-74e1-43b2-b642-0fbc24d07b63'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:49.655828 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] The token cache is being invalidate because project 29f2c6c3dc7742f29eedb8d8634fcefe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:33:49.656239 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:49.657110 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b625f394-74e1-43b2-b642-0fbc24d07b63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:33:49.659149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1407/2820] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:33:49 2022] DELETE /identity/v3/projects/29f2c6c3dc7742f29eedb8d8634fcefe => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:49.664007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da724-2510-423d-a206-103447cd80ab None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:49.664658 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da724-2510-423d-a206-103447cd80ab None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:49.664778 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06da724-2510-423d-a206-103447cd80ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:49.689834 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-c06da724-2510-423d-a206-103447cd80ab None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:49.691109 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c06da724-2510-423d-a206-103447cd80ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:49.789538 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1414/2821] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:49.797652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ebf89-801d-4814-b0f0-e8ee1741953e None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:49.797943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ebf89-801d-4814-b0f0-e8ee1741953e None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:49.798310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e01ebf89-801d-4814-b0f0-e8ee1741953e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:49.821160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e01ebf89-801d-4814-b0f0-e8ee1741953e None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:49.822365 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e01ebf89-801d-4814-b0f0-e8ee1741953e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:49.831478 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1408/2822] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:49.835857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06da724-2510-423d-a206-103447cd80ab None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:49.845852 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06da724-2510-423d-a206-103447cd80ab None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:49.850572 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575214ed-8ffb-45dc-b4e8-5d6a7872fcab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:49.851284 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575214ed-8ffb-45dc-b4e8-5d6a7872fcab admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:49.851564 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575214ed-8ffb-45dc-b4e8-5d6a7872fcab admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:49.851838 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-575214ed-8ffb-45dc-b4e8-5d6a7872fcab admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:49.852653 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575214ed-8ffb-45dc-b4e8-5d6a7872fcab admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:33:49.853011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575214ed-8ffb-45dc-b4e8-5d6a7872fcab admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:49.854560 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-575214ed-8ffb-45dc-b4e8-5d6a7872fcab admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:49.867473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1415/2823] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:33:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:33:49.871964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ebf89-801d-4814-b0f0-e8ee1741953e None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:49.882324 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e01ebf89-801d-4814-b0f0-e8ee1741953e None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:49.891304 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55570d3a-d9bf-4558-8698-f524fc6ec50c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:49.891924 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570d3a-d9bf-4558-8698-f524fc6ec50c admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:49.892255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570d3a-d9bf-4558-8698-f524fc6ec50c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:49.892520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55570d3a-d9bf-4558-8698-f524fc6ec50c admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:49.893174 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55570d3a-d9bf-4558-8698-f524fc6ec50c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:49.895118 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55570d3a-d9bf-4558-8698-f524fc6ec50c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:49.924964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1409/2824] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:33:49 2022] POST /identity/v3/projects => generated 375 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:49.929179 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575214ed-8ffb-45dc-b4e8-5d6a7872fcab admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:49.939740 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-575214ed-8ffb-45dc-b4e8-5d6a7872fcab admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:49.950688 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:50.000588 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d87862-78cc-4b7d-a372-114e6a3267fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:50.001194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d87862-78cc-4b7d-a372-114e6a3267fb admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:50.001476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d87862-78cc-4b7d-a372-114e6a3267fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:50.002353 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d87862-78cc-4b7d-a372-114e6a3267fb admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:50.002972 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d87862-78cc-4b7d-a372-114e6a3267fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:50.004978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d87862-78cc-4b7d-a372-114e6a3267fb admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:50.026818 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1416/2825] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:33:49 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:33:50.030971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55570d3a-d9bf-4558-8698-f524fc6ec50c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:50.040905 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55570d3a-d9bf-4558-8698-f524fc6ec50c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:50.045637 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcbff7-830c-4f52-b235-9888556b8760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:50.046231 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcbff7-830c-4f52-b235-9888556b8760 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:50.046506 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcbff7-830c-4f52-b235-9888556b8760 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:50.046777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25bcbff7-830c-4f52-b235-9888556b8760 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:50.047406 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcbff7-830c-4f52-b235-9888556b8760 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:50.049585 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25bcbff7-830c-4f52-b235-9888556b8760 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:50.059823 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1410/2826] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:50.063822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d87862-78cc-4b7d-a372-114e6a3267fb admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:50.074586 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d87862-78cc-4b7d-a372-114e6a3267fb admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:50.080514 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0abadefe-ca43-484a-839a-50c6129f958a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:50.081124 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadefe-ca43-484a-839a-50c6129f958a admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:50.081452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadefe-ca43-484a-839a-50c6129f958a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:50.081732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0abadefe-ca43-484a-839a-50c6129f958a admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:50.082364 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abadefe-ca43-484a-839a-50c6129f958a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:50.083946 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0abadefe-ca43-484a-839a-50c6129f958a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:50.095076 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1417/2827] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:33:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:33:50.100029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcbff7-830c-4f52-b235-9888556b8760 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:50.110452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25bcbff7-830c-4f52-b235-9888556b8760 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:50.115156 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c06e8-3a7d-4773-be79-fc31a537435e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:50.115811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c06e8-3a7d-4773-be79-fc31a537435e admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:50.116095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c06e8-3a7d-4773-be79-fc31a537435e admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:50.116419 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96c06e8-3a7d-4773-be79-fc31a537435e admin admin] PATH_INFO: `/v3/projects/52070e2930214e62b77ae7e7de629ebf/users/2a172cf41a8d4201a7bf6e0e809de02f/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:50.133164 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c06e8-3a7d-4773-be79-fc31a537435e admin admin] RBAC: Authorizing `identity:create_grant(project_id=52070e2930214e62b77ae7e7de629ebf, user_id=2a172cf41a8d4201a7bf6e0e809de02f, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:50.135835 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b96c06e8-3a7d-4773-be79-fc31a537435e admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:50.151014 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1411/2828] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:33:50 2022] PUT /identity/v3/projects/52070e2930214e62b77ae7e7de629ebf/users/2a172cf41a8d4201a7bf6e0e809de02f/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:33:50.161811 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343245d-4bd5-4b87-9d13-00fb53ceabc5 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:50.162183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343245d-4bd5-4b87-9d13-00fb53ceabc5 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:50.162559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4343245d-4bd5-4b87-9d13-00fb53ceabc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:50.193799 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4343245d-4bd5-4b87-9d13-00fb53ceabc5 None None] MFA Rules not processed for user `2a172cf41a8d4201a7bf6e0e809de02f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:50.195024 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4343245d-4bd5-4b87-9d13-00fb53ceabc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:50.262906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1418/2829] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:50 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:50.274967 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c06e8-3a7d-4773-be79-fc31a537435e admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:50.276739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b96c06e8-3a7d-4773-be79-fc31a537435e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:50.338799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b96c06e8-3a7d-4773-be79-fc31a537435e admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:50.344202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20783e2-e5eb-4550-9ca4-111bee193c18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:50.344807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20783e2-e5eb-4550-9ca4-111bee193c18 service cinder] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:50.345092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20783e2-e5eb-4550-9ca4-111bee193c18 service cinder] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:50.345909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20783e2-e5eb-4550-9ca4-111bee193c18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:50.355142 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20783e2-e5eb-4550-9ca4-111bee193c18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:50.356591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20783e2-e5eb-4550-9ca4-111bee193c18 service cinder] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:50.365853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1412/2830] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:33:51.731640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b643c4-4b38-4042-9131-99be94d8bac2 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:51.732123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b643c4-4b38-4042-9131-99be94d8bac2 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:51.732311 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b643c4-4b38-4042-9131-99be94d8bac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:51.766033 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-58b643c4-4b38-4042-9131-99be94d8bac2 None None] MFA Rules not processed for user `2a172cf41a8d4201a7bf6e0e809de02f`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:51.767416 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-58b643c4-4b38-4042-9131-99be94d8bac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:51.776267 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1419/2831] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:33:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:53.660965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898eab2-1679-4c4b-8993-49b1c5de33e7 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:53.661423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898eab2-1679-4c4b-8993-49b1c5de33e7 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:53.661520 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1898eab2-1679-4c4b-8993-49b1c5de33e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:53.691643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-1898eab2-1679-4c4b-8993-49b1c5de33e7 None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:33:53.692909 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1898eab2-1679-4c4b-8993-49b1c5de33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:53.742247 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:33:53.772885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1413/2832] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:33:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:33:53.830432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b643c4-4b38-4042-9131-99be94d8bac2 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:53.831996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-58b643c4-4b38-4042-9131-99be94d8bac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:53.947520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b643c4-4b38-4042-9131-99be94d8bac2 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:53.954978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078af77-ed35-4db0-8a7e-d91efa804efd service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:53.955607 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078af77-ed35-4db0-8a7e-d91efa804efd service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:53.955961 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078af77-ed35-4db0-8a7e-d91efa804efd service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:53.956271 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d078af77-ed35-4db0-8a7e-d91efa804efd service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:53.965423 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078af77-ed35-4db0-8a7e-d91efa804efd service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:53.967795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d078af77-ed35-4db0-8a7e-d91efa804efd service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:53.976575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1420/2833] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:33:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:33:57.851112 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898eab2-1679-4c4b-8993-49b1c5de33e7 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:33:57.852633 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-1898eab2-1679-4c4b-8993-49b1c5de33e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:57.954360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1898eab2-1679-4c4b-8993-49b1c5de33e7 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:33:57.960011 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e374d-618e-4dd7-974b-72d2737a5ed5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc00e6583d7424cbdc13732a962fc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:33:57.961404 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e374d-618e-4dd7-974b-72d2737a5ed5 service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:33:57.961872 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e374d-618e-4dd7-974b-72d2737a5ed5 service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:33:57.962312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad5e374d-618e-4dd7-974b-72d2737a5ed5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:33:57.964423 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ad5e374d-618e-4dd7-974b-72d2737a5ed5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:33:57.978502 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e374d-618e-4dd7-974b-72d2737a5ed5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:33:57.980406 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad5e374d-618e-4dd7-974b-72d2737a5ed5 service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:33:57.995194 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1414/2834] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:33:57 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:34:02.197319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078af77-ed35-4db0-8a7e-d91efa804efd service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:02.199293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d078af77-ed35-4db0-8a7e-d91efa804efd service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:02.208966 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:02.337142 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d078af77-ed35-4db0-8a7e-d91efa804efd service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:02.342241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:02.343157 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:02.343764 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:02.344296 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] PATH_INFO: `/v3/users/4f99d2c0ee5645eead533ce1870a423b` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:02.349954 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f99d2c0ee5645eead533ce1870a423b)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:02.353480 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:02.426424 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f99d2c0ee5645eead533ce1870a423b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:02.427121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f99d2c0ee5645eead533ce1870a423b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:02.427726 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f99d2c0ee5645eead533ce1870a423b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:02.440583 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f99d2c0ee5645eead533ce1870a423b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:02.456441 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f99d2c0ee5645eead533ce1870a423b'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:02.477924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1421/2835] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:34:02 2022] DELETE /identity/v3/users/4f99d2c0ee5645eead533ce1870a423b => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:02.705556 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e374d-618e-4dd7-974b-72d2737a5ed5 service placement] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:02.721646 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad5e374d-618e-4dd7-974b-72d2737a5ed5 service placement] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:02.801114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:02.802344 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:02.802808 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:02.803310 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] PATH_INFO: `/v3/projects/875c914ac8464d2d882941e71be425ab` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:02.804548 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] RBAC: Authorizing `identity:delete_project(project_id=875c914ac8464d2d882941e71be425ab)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:02.806493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:02.866660 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '875c914ac8464d2d882941e71be425ab', 'request_id': 'req-16e8ae96-5e64-4c72-89d4-3c1aebd32120'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:02.873274 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '875c914ac8464d2d882941e71be425ab', 'request_id': 'req-16e8ae96-5e64-4c72-89d4-3c1aebd32120'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:02.888597 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '875c914ac8464d2d882941e71be425ab', 'request_id': 'req-16e8ae96-5e64-4c72-89d4-3c1aebd32120'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:02.903508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] The token cache is being invalidate because project 875c914ac8464d2d882941e71be425ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:34:02.903947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:02.904739 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:02.906381 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1415/2836] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:34:02 2022] DELETE /identity/v3/projects/875c914ac8464d2d882941e71be425ab => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:02.910823 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:02.912402 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:02.927204 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a25204-6e4c-4edb-b2c5-03bbe5055574 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:02.996258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:02.996996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:02.997348 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:02.997694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] PATH_INFO: `/v3/users/c768ab5d2bce4d4d92fed37e98e40518` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:03.001200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] RBAC: Authorizing `identity:delete_user(user_id=c768ab5d2bce4d4d92fed37e98e40518)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:03.001469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:03.038927 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:03.070906 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c768ab5d2bce4d4d92fed37e98e40518'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:03.071567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c768ab5d2bce4d4d92fed37e98e40518'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:03.072205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c768ab5d2bce4d4d92fed37e98e40518'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:03.079790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c768ab5d2bce4d4d92fed37e98e40518'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:03.094224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-e1cb9af1-33bb-497b-9894-4dbb967d336e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c768ab5d2bce4d4d92fed37e98e40518'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:03.111684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1422/2837] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:34:02 2022] DELETE /identity/v3/users/c768ab5d2bce4d4d92fed37e98e40518 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:03.327484 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:03.328929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:03.347736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e8ae96-5e64-4c72-89d4-3c1aebd32120 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:03.354557 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:03.436756 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:03.437403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:03.437683 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:03.437956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] PATH_INFO: `/v3/projects/0edba950a0f2460a991c4e5b6417c6fa` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:03.439149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0edba950a0f2460a991c4e5b6417c6fa)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:03.441149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:03.502570 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0edba950a0f2460a991c4e5b6417c6fa', 'request_id': 'req-b38e8025-f350-4703-b08d-dc560bee9586'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:03.508773 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0edba950a0f2460a991c4e5b6417c6fa', 'request_id': 'req-b38e8025-f350-4703-b08d-dc560bee9586'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:03.518180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0edba950a0f2460a991c4e5b6417c6fa', 'request_id': 'req-b38e8025-f350-4703-b08d-dc560bee9586'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:03.531635 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] The token cache is being invalidate because project 0edba950a0f2460a991c4e5b6417c6fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:34:03.531990 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:03.533227 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:03.534965 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1416/2838] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:34:03 2022] DELETE /identity/v3/projects/0edba950a0f2460a991c4e5b6417c6fa => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:09.329766 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99c52f-f27e-4be7-826d-658743c8083a None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:09.330295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99c52f-f27e-4be7-826d-658743c8083a None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:09.330440 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d99c52f-f27e-4be7-826d-658743c8083a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:09.351242 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4d99c52f-f27e-4be7-826d-658743c8083a None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:09.352628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4d99c52f-f27e-4be7-826d-658743c8083a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:09.421095 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1423/2839] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:34:09 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:09.431068 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:09.433041 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:09.520333 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b38e8025-f350-4703-b08d-dc560bee9586 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:09.526076 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33934d-1395-4c19-af4d-314193bb21d2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:09.526874 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33934d-1395-4c19-af4d-314193bb21d2 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:09.527240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33934d-1395-4c19-af4d-314193bb21d2 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:09.527656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc33934d-1395-4c19-af4d-314193bb21d2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:09.537737 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33934d-1395-4c19-af4d-314193bb21d2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:09.539652 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc33934d-1395-4c19-af4d-314193bb21d2 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:09.555312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1417/2840] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:34:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:34:10.179513 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66c30-9fa3-4832-8d6c-2df03247b7a8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:10.179795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66c30-9fa3-4832-8d6c-2df03247b7a8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:10.180069 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e66c30-9fa3-4832-8d6c-2df03247b7a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:10.200692 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-19e66c30-9fa3-4832-8d6c-2df03247b7a8 None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:10.202108 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-19e66c30-9fa3-4832-8d6c-2df03247b7a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:10.211057 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1424/2841] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 24 14:34:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:10.225170 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33934d-1395-4c19-af4d-314193bb21d2 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:10.237136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc33934d-1395-4c19-af4d-314193bb21d2 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:10.242659 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8beeff-f36d-4a2b-903e-7aee5cd6d5c8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:10.243284 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8beeff-f36d-4a2b-903e-7aee5cd6d5c8 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:10.243559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8beeff-f36d-4a2b-903e-7aee5cd6d5c8 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:10.243829 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8beeff-f36d-4a2b-903e-7aee5cd6d5c8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:10.253595 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8beeff-f36d-4a2b-903e-7aee5cd6d5c8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:10.255216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c8beeff-f36d-4a2b-903e-7aee5cd6d5c8 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:10.265108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1418/2842] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:34:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:34:10.593630 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa329-e7cb-4ab8-9cf2-39cc085812a3 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:10.594751 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa329-e7cb-4ab8-9cf2-39cc085812a3 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:10.594937 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70fa329-e7cb-4ab8-9cf2-39cc085812a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:10.630173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-a70fa329-e7cb-4ab8-9cf2-39cc085812a3 None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:10.631433 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-a70fa329-e7cb-4ab8-9cf2-39cc085812a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:10.648344 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1425/2843] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:34:10 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:34:10.657791 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8beeff-f36d-4a2b-903e-7aee5cd6d5c8 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:10.680971 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:10.703598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8beeff-f36d-4a2b-903e-7aee5cd6d5c8 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:10.711198 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20739480-a92e-4277-83d2-a3e5ed6fe707 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:10.712114 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20739480-a92e-4277-83d2-a3e5ed6fe707 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:10.712631 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20739480-a92e-4277-83d2-a3e5ed6fe707 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:10.713091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20739480-a92e-4277-83d2-a3e5ed6fe707 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:10.725109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20739480-a92e-4277-83d2-a3e5ed6fe707 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:10.727028 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20739480-a92e-4277-83d2-a3e5ed6fe707 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:10.737698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1419/2844] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:34:10 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:34:11.137101 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac51985-e480-4eb8-83db-8406257b05ec None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:11.137473 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac51985-e480-4eb8-83db-8406257b05ec None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:11.137826 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac51985-e480-4eb8-83db-8406257b05ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:11.159720 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-4ac51985-e480-4eb8-83db-8406257b05ec None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:11.160980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4ac51985-e480-4eb8-83db-8406257b05ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:11.195940 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1426/2845] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 24 14:34:11 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:11.209050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20739480-a92e-4277-83d2-a3e5ed6fe707 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:11.229930 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20739480-a92e-4277-83d2-a3e5ed6fe707 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:11.235438 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4c935-155e-486e-b4c4-12e06d836e25 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:11.236045 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4c935-155e-486e-b4c4-12e06d836e25 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:11.236357 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4c935-155e-486e-b4c4-12e06d836e25 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:11.236745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e4c935-155e-486e-b4c4-12e06d836e25 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:11.246196 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4c935-155e-486e-b4c4-12e06d836e25 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:11.247811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e4c935-155e-486e-b4c4-12e06d836e25 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:11.258797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1420/2846] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:34:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:34:12.035732 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceec96-fe8d-4442-83e4-8ceb3d730dac None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:12.036389 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceec96-fe8d-4442-83e4-8ceb3d730dac None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:12.036679 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aceec96-fe8d-4442-83e4-8ceb3d730dac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:12.070306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-0aceec96-fe8d-4442-83e4-8ceb3d730dac None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:12.071721 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0aceec96-fe8d-4442-83e4-8ceb3d730dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:12.079453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1427/2847] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 24 14:34:12 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:12.093018 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4c935-155e-486e-b4c4-12e06d836e25 service swift] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:12.104549 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e4c935-155e-486e-b4c4-12e06d836e25 service swift] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:12.109588 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9067430f-8193-4799-b9ed-5dcf433a37d6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:12.110213 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067430f-8193-4799-b9ed-5dcf433a37d6 service swift] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:12.110489 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067430f-8193-4799-b9ed-5dcf433a37d6 service swift] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:12.110761 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9067430f-8193-4799-b9ed-5dcf433a37d6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:12.119708 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067430f-8193-4799-b9ed-5dcf433a37d6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:12.121320 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9067430f-8193-4799-b9ed-5dcf433a37d6 service swift] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:12.130942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1421/2848] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:34:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:34:13.381218 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceec96-fe8d-4442-83e4-8ceb3d730dac None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:13.382643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0aceec96-fe8d-4442-83e4-8ceb3d730dac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:13.424438 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:DELETE=6,keystone:SELECT=93,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:13.483010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aceec96-fe8d-4442-83e4-8ceb3d730dac None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:13.487978 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:13.488667 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:13.488943 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:13.489216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] PATH_INFO: `/v3/users/2a172cf41a8d4201a7bf6e0e809de02f` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:13.490358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a172cf41a8d4201a7bf6e0e809de02f)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:13.492399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:13.538222 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a172cf41a8d4201a7bf6e0e809de02f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:13.538865 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a172cf41a8d4201a7bf6e0e809de02f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:13.539504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a172cf41a8d4201a7bf6e0e809de02f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:13.546286 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a172cf41a8d4201a7bf6e0e809de02f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:13.558646 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a172cf41a8d4201a7bf6e0e809de02f'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:13.579408 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1428/2849] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:34:13 2022] DELETE /identity/v3/users/2a172cf41a8d4201a7bf6e0e809de02f => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:13.583982 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48162110-234c-4070-817a-4f1e94801882 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:13.584498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48162110-234c-4070-817a-4f1e94801882 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:13.584614 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48162110-234c-4070-817a-4f1e94801882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:13.612346 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-48162110-234c-4070-817a-4f1e94801882 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:13.613572 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-48162110-234c-4070-817a-4f1e94801882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:13.674157 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1422/2850] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:34:13.683781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:13.685247 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:13.746205 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee80b20-449c-4fed-b987-50ffeb304b24 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:13.750887 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c361-d4ec-4a1e-bf7b-86b296965845 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:13.751503 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c361-d4ec-4a1e-bf7b-86b296965845 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:13.751781 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c361-d4ec-4a1e-bf7b-86b296965845 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:13.752049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0367c361-d4ec-4a1e-bf7b-86b296965845 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:13.762518 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367c361-d4ec-4a1e-bf7b-86b296965845 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:13.763992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0367c361-d4ec-4a1e-bf7b-86b296965845 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:13.776194 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1429/2851] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:34:14.147211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48162110-234c-4070-817a-4f1e94801882 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.148702 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-48162110-234c-4070-817a-4f1e94801882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:14.161698 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48162110-234c-4070-817a-4f1e94801882 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.166641 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.167280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.167560 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.167832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] PATH_INFO: `/v3/projects/52070e2930214e62b77ae7e7de629ebf` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.169022 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] RBAC: Authorizing `identity:delete_project(project_id=52070e2930214e62b77ae7e7de629ebf)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.170915 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:14.228566 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c361-d4ec-4a1e-bf7b-86b296965845 service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.229841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-0367c361-d4ec-4a1e-bf7b-86b296965845 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:14.237454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '52070e2930214e62b77ae7e7de629ebf', 'request_id': 'req-c6964de4-8f59-4d33-87f8-bedb211ef850'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.244775 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0367c361-d4ec-4a1e-bf7b-86b296965845 service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.245111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '52070e2930214e62b77ae7e7de629ebf', 'request_id': 'req-c6964de4-8f59-4d33-87f8-bedb211ef850'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.254025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '52070e2930214e62b77ae7e7de629ebf', 'request_id': 'req-c6964de4-8f59-4d33-87f8-bedb211ef850'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.265679 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] The token cache is being invalidate because project 52070e2930214e62b77ae7e7de629ebf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:34:14.266554 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.267447 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-c6964de4-8f59-4d33-87f8-bedb211ef850 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.268968 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1423/2852] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:34:14 2022] DELETE /identity/v3/projects/52070e2930214e62b77ae7e7de629ebf => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:14.273719 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e01df-ce07-4351-a29c-067c0d4234f8 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.274070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e01df-ce07-4351-a29c-067c0d4234f8 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.274418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e76e01df-ce07-4351-a29c-067c0d4234f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.276677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:14.305452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:14.308138 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.308815 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.309098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.309377 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] PATH_INFO: `/v3/users/546f44833b13462d8b16275a19620e97` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.310552 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=546f44833b13462d8b16275a19620e97)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.314116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:14.330458 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-e76e01df-ce07-4351-a29c-067c0d4234f8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:14.331802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-e76e01df-ce07-4351-a29c-067c0d4234f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:14.340606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1424/2853] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:34:14.349051 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471f44-9cb2-4e14-8d06-d8b79298467d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.349413 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471f44-9cb2-4e14-8d06-d8b79298467d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.349709 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca471f44-9cb2-4e14-8d06-d8b79298467d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.370260 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ca471f44-9cb2-4e14-8d06-d8b79298467d None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:14.370699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '546f44833b13462d8b16275a19620e97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.371435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '546f44833b13462d8b16275a19620e97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.371561 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ca471f44-9cb2-4e14-8d06-d8b79298467d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:14.372053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '546f44833b13462d8b16275a19620e97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.380243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1425/2854] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:34:14.384180 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca471f44-9cb2-4e14-8d06-d8b79298467d None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.385009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '546f44833b13462d8b16275a19620e97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.393712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca471f44-9cb2-4e14-8d06-d8b79298467d None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.397701 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '546f44833b13462d8b16275a19620e97'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.398667 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273c839-878a-4894-b884-a7825828a5b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.399255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273c839-878a-4894-b884-a7825828a5b8 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.399530 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273c839-878a-4894-b884-a7825828a5b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.399798 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f273c839-878a-4894-b884-a7825828a5b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.400468 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273c839-878a-4894-b884-a7825828a5b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81459) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:34:14.400767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273c839-878a-4894-b884-a7825828a5b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.402362 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f273c839-878a-4894-b884-a7825828a5b8 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:14.412183 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1430/2855] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:34:14 2022] DELETE /identity/v3/users/546f44833b13462d8b16275a19620e97 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:34:14.421620 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1426/2856] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:34:14.423149 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.489640 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e932c00-f9d5-4496-8ee2-12c82d040ab0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.494536 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5819-fb96-4b33-adaf-70a3d461e60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.495150 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5819-fb96-4b33-adaf-70a3d461e60d admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.495428 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5819-fb96-4b33-adaf-70a3d461e60d admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.495707 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2ab5819-fb96-4b33-adaf-70a3d461e60d admin admin] PATH_INFO: `/v3/projects` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.496387 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab5819-fb96-4b33-adaf-70a3d461e60d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.498286 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2ab5819-fb96-4b33-adaf-70a3d461e60d admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:14.529135 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1431/2857] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:34:14 2022] POST /identity/v3/projects => generated 397 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:34:14.530240 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273c839-878a-4894-b884-a7825828a5b8 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.541211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f273c839-878a-4894-b884-a7825828a5b8 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.592099 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5819-fb96-4b33-adaf-70a3d461e60d admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.594626 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-c2ab5819-fb96-4b33-adaf-70a3d461e60d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:14.608009 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3297ce3-2485-4b7f-b530-eac74f6bb165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.609713 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297ce3-2485-4b7f-b530-eac74f6bb165 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.610026 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297ce3-2485-4b7f-b530-eac74f6bb165 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.610375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3297ce3-2485-4b7f-b530-eac74f6bb165 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.611102 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3297ce3-2485-4b7f-b530-eac74f6bb165 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.613385 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3297ce3-2485-4b7f-b530-eac74f6bb165 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:14.642003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1427/2858] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:34:14 2022] POST /identity/v3/users => generated 299 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:34:14.643171 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3297ce3-2485-4b7f-b530-eac74f6bb165 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.643884 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:14.655546 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3297ce3-2485-4b7f-b530-eac74f6bb165 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.660466 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd866f6-c0a9-414e-a1f4-a8dbb8dbbacb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.661108 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd866f6-c0a9-414e-a1f4-a8dbb8dbbacb admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.661356 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd866f6-c0a9-414e-a1f4-a8dbb8dbbacb admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.661628 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd866f6-c0a9-414e-a1f4-a8dbb8dbbacb admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.662275 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd866f6-c0a9-414e-a1f4-a8dbb8dbbacb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.663885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd866f6-c0a9-414e-a1f4-a8dbb8dbbacb admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:14.672662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2ab5819-fb96-4b33-adaf-70a3d461e60d admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.676710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1428/2859] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:34:14.678743 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.679592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.680039 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.680495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] PATH_INFO: `/v3/projects/a313d094dcf94c539beea9019d76bc73` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.680758 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd866f6-c0a9-414e-a1f4-a8dbb8dbbacb admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.681990 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] RBAC: Authorizing `identity:delete_project(project_id=a313d094dcf94c539beea9019d76bc73)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.684068 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:14.691329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd866f6-c0a9-414e-a1f4-a8dbb8dbbacb admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.697179 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a62248-2fe0-456b-a62c-a9908516cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.697772 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a62248-2fe0-456b-a62c-a9908516cb55 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.698047 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a62248-2fe0-456b-a62c-a9908516cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.698315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a62248-2fe0-456b-a62c-a9908516cb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.699563 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a62248-2fe0-456b-a62c-a9908516cb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.701221 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a62248-2fe0-456b-a62c-a9908516cb55 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:14.713105 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1429/2860] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:34:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:34:14.717330 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a62248-2fe0-456b-a62c-a9908516cb55 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.728125 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a62248-2fe0-456b-a62c-a9908516cb55 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.738649 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a313d094dcf94c539beea9019d76bc73', 'request_id': 'req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.750945 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a313d094dcf94c539beea9019d76bc73', 'request_id': 'req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.757357 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a313d094dcf94c539beea9019d76bc73', 'request_id': 'req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.770872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] The token cache is being invalidate because project a313d094dcf94c539beea9019d76bc73 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:34:14.771841 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.772989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-2e59c8d9-494b-44f6-a0be-0e3a60a0a89c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:14.774719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1432/2861] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:34:14 2022] DELETE /identity/v3/projects/a313d094dcf94c539beea9019d76bc73 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:34:14.779661 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefed154-28d0-4b36-a3e0-4a3b073fa979 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.779953 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefed154-28d0-4b36-a3e0-4a3b073fa979 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.780255 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefed154-28d0-4b36-a3e0-4a3b073fa979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.794417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4379a2b3-f6c8-45c9-a308-fb2af1ef36a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.795497 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379a2b3-f6c8-45c9-a308-fb2af1ef36a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.795974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379a2b3-f6c8-45c9-a308-fb2af1ef36a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.796455 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4379a2b3-f6c8-45c9-a308-fb2af1ef36a9 admin admin] PATH_INFO: `/v3/projects/1d05fb458e6f40dfaba96c44ab1cf55d/users/ea2503a57ea1433091bb7454fa566d8c/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.800729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-fefed154-28d0-4b36-a3e0-4a3b073fa979 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:14.802188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fefed154-28d0-4b36-a3e0-4a3b073fa979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:14.812934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1433/2862] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:14.814906 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379a2b3-f6c8-45c9-a308-fb2af1ef36a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1d05fb458e6f40dfaba96c44ab1cf55d, user_id=ea2503a57ea1433091bb7454fa566d8c, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.817619 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4379a2b3-f6c8-45c9-a308-fb2af1ef36a9 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:14.821559 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f7d02-4b0d-4020-9aff-9b32763bc9f8 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.821785 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f7d02-4b0d-4020-9aff-9b32763bc9f8 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.822233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1f7d02-4b0d-4020-9aff-9b32763bc9f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.838396 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1430/2863] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:34:14 2022] PUT /identity/v3/projects/1d05fb458e6f40dfaba96c44ab1cf55d/users/ea2503a57ea1433091bb7454fa566d8c/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:34:14.845329 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207e80-5a15-41ec-842c-0303d2915903 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.845617 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207e80-5a15-41ec-842c-0303d2915903 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.845891 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91207e80-5a15-41ec-842c-0303d2915903 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.854512 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-7a1f7d02-4b0d-4020-9aff-9b32763bc9f8 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:14.855757 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-7a1f7d02-4b0d-4020-9aff-9b32763bc9f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:14.878799 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-91207e80-5a15-41ec-842c-0303d2915903 None None] MFA Rules not processed for user `ea2503a57ea1433091bb7454fa566d8c`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:14.880073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-91207e80-5a15-41ec-842c-0303d2915903 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:14.890598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:14.929957 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1434/2864] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:14.934146 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f7d02-4b0d-4020-9aff-9b32763bc9f8 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.943996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1f7d02-4b0d-4020-9aff-9b32763bc9f8 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.952918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30a420-6ca1-4a39-b2b4-d8beeb96be1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.954110 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30a420-6ca1-4a39-b2b4-d8beeb96be1f admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.954393 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30a420-6ca1-4a39-b2b4-d8beeb96be1f admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.954715 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d30a420-6ca1-4a39-b2b4-d8beeb96be1f admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.955379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30a420-6ca1-4a39-b2b4-d8beeb96be1f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:34:14.955737 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30a420-6ca1-4a39-b2b4-d8beeb96be1f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.957435 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d30a420-6ca1-4a39-b2b4-d8beeb96be1f admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:14.961802 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1431/2865] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:14 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:34:14.972083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1435/2866] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:34:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Sep 24 14:34:14.976359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207e80-5a15-41ec-842c-0303d2915903 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.976923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30a420-6ca1-4a39-b2b4-d8beeb96be1f admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:14.978834 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5d30a420-6ca1-4a39-b2b4-d8beeb96be1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:14.988420 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91207e80-5a15-41ec-842c-0303d2915903 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:14.993797 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac72bf1-f712-492c-9f91-cf7e14bf8799 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:14.994347 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac72bf1-f712-492c-9f91-cf7e14bf8799 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:14.994626 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac72bf1-f712-492c-9f91-cf7e14bf8799 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:14.994899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac72bf1-f712-492c-9f91-cf7e14bf8799 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:14.995604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac72bf1-f712-492c-9f91-cf7e14bf8799 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:14.997529 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac72bf1-f712-492c-9f91-cf7e14bf8799 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:15.029004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1432/2867] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:34:14 2022] POST /identity/v3/projects => generated 383 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:34:15.034109 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac72bf1-f712-492c-9f91-cf7e14bf8799 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:15.046224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:15.053872 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d30a420-6ca1-4a39-b2b4-d8beeb96be1f admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:15.110244 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac72bf1-f712-492c-9f91-cf7e14bf8799 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:15.112043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130beaad-602b-4312-b9c7-202cafd747e3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:15.112750 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130beaad-602b-4312-b9c7-202cafd747e3 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:15.113147 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130beaad-602b-4312-b9c7-202cafd747e3 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:15.113494 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130beaad-602b-4312-b9c7-202cafd747e3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:15.116136 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871019-1f23-4b96-a7de-8b6dbdc1ae98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:15.116885 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871019-1f23-4b96-a7de-8b6dbdc1ae98 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:15.117255 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871019-1f23-4b96-a7de-8b6dbdc1ae98 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:15.117604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c871019-1f23-4b96-a7de-8b6dbdc1ae98 admin admin] PATH_INFO: `/v3/users` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:15.118312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c871019-1f23-4b96-a7de-8b6dbdc1ae98 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:15.120494 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c871019-1f23-4b96-a7de-8b6dbdc1ae98 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:15.145504 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1433/2868] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:34:15 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:34:15.149591 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871019-1f23-4b96-a7de-8b6dbdc1ae98 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:15.159730 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c871019-1f23-4b96-a7de-8b6dbdc1ae98 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:15.166151 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1006603-d6c1-42ec-8035-a3742516d095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:15.166724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1006603-d6c1-42ec-8035-a3742516d095 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:15.167003 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1006603-d6c1-42ec-8035-a3742516d095 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:15.167377 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1006603-d6c1-42ec-8035-a3742516d095 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:15.168032 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1006603-d6c1-42ec-8035-a3742516d095 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:15.169832 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1006603-d6c1-42ec-8035-a3742516d095 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:15.181258 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130beaad-602b-4312-b9c7-202cafd747e3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:15.183083 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130beaad-602b-4312-b9c7-202cafd747e3 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:15.183224 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1434/2869] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:34:15.184762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1006603-d6c1-42ec-8035-a3742516d095 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:15.196795 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1436/2870] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:14 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 219 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:34:15.199422 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1006603-d6c1-42ec-8035-a3742516d095 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:15.205437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4263f9e3-1e0b-42e5-9b09-50d30e48a7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:15.206044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f9e3-1e0b-42e5-9b09-50d30e48a7b1 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:15.206327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f9e3-1e0b-42e5-9b09-50d30e48a7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:15.206610 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4263f9e3-1e0b-42e5-9b09-50d30e48a7b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:15.207256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263f9e3-1e0b-42e5-9b09-50d30e48a7b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:15.208918 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4263f9e3-1e0b-42e5-9b09-50d30e48a7b1 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:15.220053 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1435/2871] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:34:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Sep 24 14:34:15.225357 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130beaad-602b-4312-b9c7-202cafd747e3 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:15.236668 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130beaad-602b-4312-b9c7-202cafd747e3 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:15.241996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01b633-5bc1-4f7a-b9a9-26235d9fbc01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:15.243026 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01b633-5bc1-4f7a-b9a9-26235d9fbc01 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:15.244023 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01b633-5bc1-4f7a-b9a9-26235d9fbc01 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:15.244399 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff01b633-5bc1-4f7a-b9a9-26235d9fbc01 admin admin] PATH_INFO: `/v3/projects/4c3793ab833e437f9a749b2d065ce38a/users/b6457df2f9354ec2b16b9069dd2df861/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:15.263431 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01b633-5bc1-4f7a-b9a9-26235d9fbc01 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4c3793ab833e437f9a749b2d065ce38a, user_id=b6457df2f9354ec2b16b9069dd2df861, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:15.266073 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff01b633-5bc1-4f7a-b9a9-26235d9fbc01 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:15.285231 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1437/2872] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:34:15 2022] PUT /identity/v3/projects/4c3793ab833e437f9a749b2d065ce38a/users/b6457df2f9354ec2b16b9069dd2df861/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Sep 24 14:34:15.290185 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d089a-37ad-42f0-99b9-8cbb2d3ea533 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:15.290469 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d089a-37ad-42f0-99b9-8cbb2d3ea533 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:15.290750 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185d089a-37ad-42f0-99b9-8cbb2d3ea533 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:15.319767 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-185d089a-37ad-42f0-99b9-8cbb2d3ea533 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:15.321071 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-185d089a-37ad-42f0-99b9-8cbb2d3ea533 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:15.381141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:15.397694 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1436/2873] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:15.409432 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01b633-5bc1-4f7a-b9a9-26235d9fbc01 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:15.411982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ff01b633-5bc1-4f7a-b9a9-26235d9fbc01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:15.495496 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff01b633-5bc1-4f7a-b9a9-26235d9fbc01 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:15.500694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc7b93-b32c-4e45-a962-6843f961112d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:15.501900 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7b93-b32c-4e45-a962-6843f961112d service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:15.502280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7b93-b32c-4e45-a962-6843f961112d service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:15.502671 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7b93-b32c-4e45-a962-6843f961112d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:15.517356 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc7b93-b32c-4e45-a962-6843f961112d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:15.518679 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66fc7b93-b32c-4e45-a962-6843f961112d service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:15.532504 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1438/2874] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:34:16.375598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339a0c-41a9-4a9a-afd1-7c111e5b8bcd None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:16.376147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339a0c-41a9-4a9a-afd1-7c111e5b8bcd None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:16.376147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b339a0c-41a9-4a9a-afd1-7c111e5b8bcd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:16.404867 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5b339a0c-41a9-4a9a-afd1-7c111e5b8bcd None None] MFA Rules not processed for user `b6457df2f9354ec2b16b9069dd2df861`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:16.406096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5b339a0c-41a9-4a9a-afd1-7c111e5b8bcd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:16.481764 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1437/2875] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:16.496367 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc7b93-b32c-4e45-a962-6843f961112d service neutron] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:16.497980 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-66fc7b93-b32c-4e45-a962-6843f961112d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:16.541502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:16.559918 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc7b93-b32c-4e45-a962-6843f961112d service neutron] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:16.564040 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e005d1a-ed9b-4f12-b4f1-697dd538bbb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:16.564664 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e005d1a-ed9b-4f12-b4f1-697dd538bbb1 service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:16.564969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e005d1a-ed9b-4f12-b4f1-697dd538bbb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:16.565240 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e005d1a-ed9b-4f12-b4f1-697dd538bbb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:16.573597 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e005d1a-ed9b-4f12-b4f1-697dd538bbb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:16.575016 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e005d1a-ed9b-4f12-b4f1-697dd538bbb1 service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:16.584672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1439/2876] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:16 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:34:17.972312 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867ac2-5089-4cbd-89ab-077d077de69b None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:17.972850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867ac2-5089-4cbd-89ab-077d077de69b None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:17.972850 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3867ac2-5089-4cbd-89ab-077d077de69b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:17.995160 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a3867ac2-5089-4cbd-89ab-077d077de69b None None] MFA Rules not processed for user `b6457df2f9354ec2b16b9069dd2df861`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:17.996399 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a3867ac2-5089-4cbd-89ab-077d077de69b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:18.009135 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1438/2877] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:20.302391 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e005d1a-ed9b-4f12-b4f1-697dd538bbb1 service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:20.304078 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4e005d1a-ed9b-4f12-b4f1-697dd538bbb1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:20.320992 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e005d1a-ed9b-4f12-b4f1-697dd538bbb1 service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:20.326678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:20.327430 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:20.327805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:20.328278 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] PATH_INFO: `/v3/users/ea2503a57ea1433091bb7454fa566d8c` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:20.329673 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea2503a57ea1433091bb7454fa566d8c)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:20.332043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:20.387241 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea2503a57ea1433091bb7454fa566d8c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:20.388065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea2503a57ea1433091bb7454fa566d8c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:20.388996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea2503a57ea1433091bb7454fa566d8c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:20.397714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea2503a57ea1433091bb7454fa566d8c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:20.411729 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea2503a57ea1433091bb7454fa566d8c'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:20.426902 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1440/2878] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:34:20 2022] DELETE /identity/v3/users/ea2503a57ea1433091bb7454fa566d8c => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:20.431359 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5e36-937f-4f2b-a417-4ea8f1191f47 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:20.431988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5e36-937f-4f2b-a417-4ea8f1191f47 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:20.431988 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06fc5e36-937f-4f2b-a417-4ea8f1191f47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:20.450878 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-06fc5e36-937f-4f2b-a417-4ea8f1191f47 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:20.452376 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-06fc5e36-937f-4f2b-a417-4ea8f1191f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:20.515364 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1439/2879] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:20.525133 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:20.526697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:20.587488 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9090fd-2fb6-4f9d-8b4a-1d09d30a8529 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:20.591790 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a0e495-9862-47d6-8042-1fe5f8b40d37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:20.592491 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0e495-9862-47d6-8042-1fe5f8b40d37 service neutron] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:20.592830 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0e495-9862-47d6-8042-1fe5f8b40d37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:20.593111 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a0e495-9862-47d6-8042-1fe5f8b40d37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:20.603989 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0e495-9862-47d6-8042-1fe5f8b40d37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:20.605457 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a0e495-9862-47d6-8042-1fe5f8b40d37 service neutron] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:20.615812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1441/2880] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:34:20.907980 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5e36-937f-4f2b-a417-4ea8f1191f47 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:20.909771 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-06fc5e36-937f-4f2b-a417-4ea8f1191f47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:20.927553 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06fc5e36-937f-4f2b-a417-4ea8f1191f47 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:20.934639 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:20.935608 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:20.936259 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:20.936715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] PATH_INFO: `/v3/projects/1d05fb458e6f40dfaba96c44ab1cf55d` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:20.939290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1d05fb458e6f40dfaba96c44ab1cf55d)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:20.940958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:20.991852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1d05fb458e6f40dfaba96c44ab1cf55d', 'request_id': 'req-f314362a-d336-4397-86ca-9afb8fcd9a75'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:20.997537 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1d05fb458e6f40dfaba96c44ab1cf55d', 'request_id': 'req-f314362a-d336-4397-86ca-9afb8fcd9a75'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:21.006063 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1d05fb458e6f40dfaba96c44ab1cf55d', 'request_id': 'req-f314362a-d336-4397-86ca-9afb8fcd9a75'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:21.020699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] The token cache is being invalidate because project 1d05fb458e6f40dfaba96c44ab1cf55d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81459) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:34:21.020999 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:21.021775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-f314362a-d336-4397-86ca-9afb8fcd9a75 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:34:21.023789 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1440/2881] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:34:20 2022] DELETE /identity/v3/projects/1d05fb458e6f40dfaba96c44ab1cf55d => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:21.029576 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa139f7-7182-4178-98a3-7e8be1a60a7f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:21.029868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa139f7-7182-4178-98a3-7e8be1a60a7f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:21.031173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa139f7-7182-4178-98a3-7e8be1a60a7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:21.051924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-5aa139f7-7182-4178-98a3-7e8be1a60a7f None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:21.053216 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-5aa139f7-7182-4178-98a3-7e8be1a60a7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:21.110665 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:21.130289 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1442/2882] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:34:21.133577 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18064c2-f9bf-41ca-b917-e8c276f74fb6 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:21.133950 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18064c2-f9bf-41ca-b917-e8c276f74fb6 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:21.134323 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18064c2-f9bf-41ca-b917-e8c276f74fb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:21.144314 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:21.157942 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b18064c2-f9bf-41ca-b917-e8c276f74fb6 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:21.160327 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b18064c2-f9bf-41ca-b917-e8c276f74fb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:21.170122 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1441/2883] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:21.176614 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa139f7-7182-4178-98a3-7e8be1a60a7f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:21.187913 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa139f7-7182-4178-98a3-7e8be1a60a7f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:21.192882 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34061b-95b9-40b7-9c5c-286ad69f47d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:21.193527 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34061b-95b9-40b7-9c5c-286ad69f47d2 admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:21.193808 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34061b-95b9-40b7-9c5c-286ad69f47d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:21.194081 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34061b-95b9-40b7-9c5c-286ad69f47d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:21.194736 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34061b-95b9-40b7-9c5c-286ad69f47d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81458) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Sep 24 14:34:21.195046 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34061b-95b9-40b7-9c5c-286ad69f47d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:21.196684 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc34061b-95b9-40b7-9c5c-286ad69f47d2 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:21.211506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1443/2884] 10.222.0.16 () {58 vars in 1153 bytes} [Sat Sep 24 14:34:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Sep 24 14:34:21.219040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18064c2-f9bf-41ca-b917-e8c276f74fb6 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:21.229657 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18064c2-f9bf-41ca-b917-e8c276f74fb6 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:21.236682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6833d3-e29c-4139-9f84-760d0af97441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:21.237375 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6833d3-e29c-4139-9f84-760d0af97441 admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:21.237682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6833d3-e29c-4139-9f84-760d0af97441 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:21.238040 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6833d3-e29c-4139-9f84-760d0af97441 admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:21.238821 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6833d3-e29c-4139-9f84-760d0af97441 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:21.240957 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6833d3-e29c-4139-9f84-760d0af97441 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:21.277402 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1442/2885] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:34:21 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:34:21.282767 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34061b-95b9-40b7-9c5c-286ad69f47d2 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:21.298038 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34061b-95b9-40b7-9c5c-286ad69f47d2 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:21.364469 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7b437-dfd5-46a5-9860-0bfb0ee2d7a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:21.365173 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7b437-dfd5-46a5-9860-0bfb0ee2d7a0 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:21.365386 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7b437-dfd5-46a5-9860-0bfb0ee2d7a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:21.365660 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b7b437-dfd5-46a5-9860-0bfb0ee2d7a0 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:21.366293 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7b437-dfd5-46a5-9860-0bfb0ee2d7a0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:21.368295 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b7b437-dfd5-46a5-9860-0bfb0ee2d7a0 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:21.393468 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1444/2886] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:34:21 2022] POST /identity/v3/users => generated 292 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Sep 24 14:34:21.397582 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6833d3-e29c-4139-9f84-760d0af97441 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:21.408393 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6833d3-e29c-4139-9f84-760d0af97441 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:21.413050 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd42c6-5bf6-46db-82b9-32a6ac75066f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:21.413656 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd42c6-5bf6-46db-82b9-32a6ac75066f admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:21.413933 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd42c6-5bf6-46db-82b9-32a6ac75066f admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:21.414204 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd42c6-5bf6-46db-82b9-32a6ac75066f admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:21.414853 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd42c6-5bf6-46db-82b9-32a6ac75066f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:21.416524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd42c6-5bf6-46db-82b9-32a6ac75066f admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:21.427223 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1443/2887] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:34:21.431177 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7b437-dfd5-46a5-9860-0bfb0ee2d7a0 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:21.442022 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b7b437-dfd5-46a5-9860-0bfb0ee2d7a0 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:21.446864 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c08ee1-a078-42d0-b9ed-4c9dd5316a4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:21.447481 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08ee1-a078-42d0-b9ed-4c9dd5316a4b admin admin] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:21.447793 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08ee1-a078-42d0-b9ed-4c9dd5316a4b admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:21.448181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c08ee1-a078-42d0-b9ed-4c9dd5316a4b admin admin] PATH_INFO: `/v3/roles` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:21.449321 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c08ee1-a078-42d0-b9ed-4c9dd5316a4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:21.452628 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c08ee1-a078-42d0-b9ed-4c9dd5316a4b admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:21.464562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1445/2888] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:34:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:34:21.469355 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd42c6-5bf6-46db-82b9-32a6ac75066f admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:21.479904 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd42c6-5bf6-46db-82b9-32a6ac75066f admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:21.485091 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d59e6-6c9f-4c6f-9504-a47b2e0aa50b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:21.485890 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d59e6-6c9f-4c6f-9504-a47b2e0aa50b admin admin] REQUEST_METHOD: `PUT` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:21.486271 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d59e6-6c9f-4c6f-9504-a47b2e0aa50b admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:21.486943 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b2d59e6-6c9f-4c6f-9504-a47b2e0aa50b admin admin] PATH_INFO: `/v3/projects/b677f51a5b4c4f14b59377f2cbb992eb/users/985209ae523f450aa97fff87cea929e9/roles/a4c95292940e4d359d48ad72b390ece0` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:21.505150 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d59e6-6c9f-4c6f-9504-a47b2e0aa50b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b677f51a5b4c4f14b59377f2cbb992eb, user_id=985209ae523f450aa97fff87cea929e9, role_id=a4c95292940e4d359d48ad72b390ece0)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:21.507811 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b2d59e6-6c9f-4c6f-9504-a47b2e0aa50b admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:21.522792 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1444/2889] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:34:21 2022] PUT /identity/v3/projects/b677f51a5b4c4f14b59377f2cbb992eb/users/985209ae523f450aa97fff87cea929e9/roles/a4c95292940e4d359d48ad72b390ece0 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:21.528207 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bda7d-010a-4c92-9eb1-8cdf555b6eea None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:21.528619 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bda7d-010a-4c92-9eb1-8cdf555b6eea None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:21.529172 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369bda7d-010a-4c92-9eb1-8cdf555b6eea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:21.550910 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-369bda7d-010a-4c92-9eb1-8cdf555b6eea None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:21.552315 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-369bda7d-010a-4c92-9eb1-8cdf555b6eea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:21.619277 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1446/2890] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:34:21.629253 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d59e6-6c9f-4c6f-9504-a47b2e0aa50b admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:21.630964 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-2b2d59e6-6c9f-4c6f-9504-a47b2e0aa50b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:21.697663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b2d59e6-6c9f-4c6f-9504-a47b2e0aa50b admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:21.703830 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f519-e09c-460a-b0eb-29e563e1dd5f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:21.704941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f519-e09c-460a-b0eb-29e563e1dd5f service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:21.704941 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f519-e09c-460a-b0eb-29e563e1dd5f service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:21.705290 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a10f519-e09c-460a-b0eb-29e563e1dd5f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:21.715070 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10f519-e09c-460a-b0eb-29e563e1dd5f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:21.716638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a10f519-e09c-460a-b0eb-29e563e1dd5f service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:21.727884 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1445/2891] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:34:26.480647 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba799d-e92d-4ee5-9140-8d66a6e05c0f None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:26.481165 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba799d-e92d-4ee5-9140-8d66a6e05c0f None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:26.481280 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ba799d-e92d-4ee5-9140-8d66a6e05c0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:26.511621 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-58ba799d-e92d-4ee5-9140-8d66a6e05c0f None None] MFA Rules not processed for user `985209ae523f450aa97fff87cea929e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:26.513007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-58ba799d-e92d-4ee5-9140-8d66a6e05c0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:26.565224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:26.585651 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1447/2892] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:26 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:26.590190 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f519-e09c-460a-b0eb-29e563e1dd5f service neutron] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:26.600813 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a10f519-e09c-460a-b0eb-29e563e1dd5f service neutron] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:26.606202 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdef75-09c1-4989-beb0-b5b44c3699cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:26.606745 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdef75-09c1-4989-beb0-b5b44c3699cd admin admin] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:26.607024 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdef75-09c1-4989-beb0-b5b44c3699cd admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:26.607297 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcdef75-09c1-4989-beb0-b5b44c3699cd admin admin] PATH_INFO: `/v3/projects` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:26.607956 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdef75-09c1-4989-beb0-b5b44c3699cd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:26.610474 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcdef75-09c1-4989-beb0-b5b44c3699cd admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:26.639161 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1446/2893] 10.222.0.16 () {60 vars in 1153 bytes} [Sat Sep 24 14:34:26 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:34:26.643867 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba799d-e92d-4ee5-9140-8d66a6e05c0f None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:26.655442 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ba799d-e92d-4ee5-9140-8d66a6e05c0f None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:26.715714 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe983da-de78-4226-abd6-1b80835fcc90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:26.716354 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe983da-de78-4226-abd6-1b80835fcc90 admin admin] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:26.716631 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe983da-de78-4226-abd6-1b80835fcc90 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:26.716900 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe983da-de78-4226-abd6-1b80835fcc90 admin admin] PATH_INFO: `/v3/users` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:26.717550 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe983da-de78-4226-abd6-1b80835fcc90 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:26.719530 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe983da-de78-4226-abd6-1b80835fcc90 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:26.743925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1448/2894] 10.222.0.16 () {60 vars in 1144 bytes} [Sat Sep 24 14:34:26 2022] POST /identity/v3/users => generated 299 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Sep 24 14:34:26.747947 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdef75-09c1-4989-beb0-b5b44c3699cd admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:26.759459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcdef75-09c1-4989-beb0-b5b44c3699cd admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:26.765305 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeb2bb-55ec-45d3-aa34-f3514f10220c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:26.765953 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeb2bb-55ec-45d3-aa34-f3514f10220c admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:26.766230 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeb2bb-55ec-45d3-aa34-f3514f10220c admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:26.766498 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effeb2bb-55ec-45d3-aa34-f3514f10220c admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:26.767144 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeb2bb-55ec-45d3-aa34-f3514f10220c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:26.768946 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effeb2bb-55ec-45d3-aa34-f3514f10220c admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:26.781360 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1447/2895] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:34:26.785632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe983da-de78-4226-abd6-1b80835fcc90 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:26.796121 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe983da-de78-4226-abd6-1b80835fcc90 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:26.801760 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075eeed-a0f4-46f7-af10-f16370493be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:26.802425 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075eeed-a0f4-46f7-af10-f16370493be6 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:26.802704 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075eeed-a0f4-46f7-af10-f16370493be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:26.802977 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6075eeed-a0f4-46f7-af10-f16370493be6 admin admin] PATH_INFO: `/v3/projects/1610f2e5b1c94566a1eba5475485ad81/users/390b25758d2c4ca1af8dc50b5ea0a5b1/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:26.820181 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075eeed-a0f4-46f7-af10-f16370493be6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1610f2e5b1c94566a1eba5475485ad81, user_id=390b25758d2c4ca1af8dc50b5ea0a5b1, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:26.822862 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6075eeed-a0f4-46f7-af10-f16370493be6 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:26.837007 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1449/2896] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:34:26 2022] PUT /identity/v3/projects/1610f2e5b1c94566a1eba5475485ad81/users/390b25758d2c4ca1af8dc50b5ea0a5b1/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:26.841540 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeb2bb-55ec-45d3-aa34-f3514f10220c admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:26.852406 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effeb2bb-55ec-45d3-aa34-f3514f10220c admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:26.914521 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8295ed12-27a0-4c50-bdad-fecb6d5f37f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:26.915138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295ed12-27a0-4c50-bdad-fecb6d5f37f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:26.915416 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295ed12-27a0-4c50-bdad-fecb6d5f37f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:26.915685 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8295ed12-27a0-4c50-bdad-fecb6d5f37f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:26.916354 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295ed12-27a0-4c50-bdad-fecb6d5f37f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:26.918094 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8295ed12-27a0-4c50-bdad-fecb6d5f37f7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:26.928443 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1448/2897] 10.222.0.16 () {58 vars in 1122 bytes} [Sat Sep 24 14:34:26 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Sep 24 14:34:26.932898 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075eeed-a0f4-46f7-af10-f16370493be6 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:26.943819 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6075eeed-a0f4-46f7-af10-f16370493be6 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:26.948531 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d008a-8927-494c-8a9c-72f4df69c4e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:26.949186 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d008a-8927-494c-8a9c-72f4df69c4e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:26.949464 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d008a-8927-494c-8a9c-72f4df69c4e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:26.949738 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7d008a-8927-494c-8a9c-72f4df69c4e4 admin admin] PATH_INFO: `/v3/projects/1610f2e5b1c94566a1eba5475485ad81/users/390b25758d2c4ca1af8dc50b5ea0a5b1/roles/d44d12ec4ce44b38acc5e93dcd4f91ff` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:26.951938 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d008a-8927-494c-8a9c-72f4df69c4e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1610f2e5b1c94566a1eba5475485ad81, user_id=390b25758d2c4ca1af8dc50b5ea0a5b1, role_id=d44d12ec4ce44b38acc5e93dcd4f91ff)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:26.954600 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7d008a-8927-494c-8a9c-72f4df69c4e4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:26.965119 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1450/2898] 10.222.0.16 () {60 vars in 1483 bytes} [Sat Sep 24 14:34:26 2022] PUT /identity/v3/projects/1610f2e5b1c94566a1eba5475485ad81/users/390b25758d2c4ca1af8dc50b5ea0a5b1/roles/d44d12ec4ce44b38acc5e93dcd4f91ff => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:34:32.251912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4e324-ac6c-4778-b4c9-97da0228716a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:32.252824 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4e324-ac6c-4778-b4c9-97da0228716a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:32.253299 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b4e324-ac6c-4778-b4c9-97da0228716a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:32.271157 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:32.298844 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-21b4e324-ac6c-4778-b4c9-97da0228716a None None] MFA Rules not processed for user `390b25758d2c4ca1af8dc50b5ea0a5b1`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:32.300629 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-21b4e324-ac6c-4778-b4c9-97da0228716a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:32.382384 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1449/2899] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:32 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:32.396678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d008a-8927-494c-8a9c-72f4df69c4e4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:32.399506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-ee7d008a-8927-494c-8a9c-72f4df69c4e4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:32.485681 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7d008a-8927-494c-8a9c-72f4df69c4e4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:32.489965 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6bb52-0577-44e1-833b-9e693c8350ea service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0ece8645e0954e1d81837cdcaa2ef1e5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:32.490694 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bb52-0577-44e1-833b-9e693c8350ea service glance] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:32.491054 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bb52-0577-44e1-833b-9e693c8350ea service glance] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:32.491401 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c6bb52-0577-44e1-833b-9e693c8350ea service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:32.551453 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:32.556975 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6bb52-0577-44e1-833b-9e693c8350ea service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:32.558669 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9c6bb52-0577-44e1-833b-9e693c8350ea service glance] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:32.570986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1451/2900] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:32 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 175 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Sep 24 14:34:32.713403 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139537d6-ac0e-46d4-b0be-a3e6a21c868f None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:32.713722 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139537d6-ac0e-46d4-b0be-a3e6a21c868f None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:32.714004 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139537d6-ac0e-46d4-b0be-a3e6a21c868f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:32.734887 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-139537d6-ac0e-46d4-b0be-a3e6a21c868f None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:32.736096 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-139537d6-ac0e-46d4-b0be-a3e6a21c868f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:32.794724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1450/2901] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:34:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:32.807059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6bb52-0577-44e1-833b-9e693c8350ea service glance] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:32.808567 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-b9c6bb52-0577-44e1-833b-9e693c8350ea service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:32.880450 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c6bb52-0577-44e1-833b-9e693c8350ea service glance] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:32.885592 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1313d-7e72-4769-90c0-20be0bef9fbc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:32.886136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1313d-7e72-4769-90c0-20be0bef9fbc service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:32.886415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1313d-7e72-4769-90c0-20be0bef9fbc service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:32.886691 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf1313d-7e72-4769-90c0-20be0bef9fbc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:32.895984 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1313d-7e72-4769-90c0-20be0bef9fbc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:32.897632 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf1313d-7e72-4769-90c0-20be0bef9fbc service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:32.906262 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1452/2902] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:34:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:34:41.903293 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0ec2-36df-47ff-a946-227fad60a676 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:41.903852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0ec2-36df-47ff-a946-227fad60a676 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:41.903852 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8e0ec2-36df-47ff-a946-227fad60a676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:41.925485 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8d8e0ec2-36df-47ff-a946-227fad60a676 None None] MFA Rules not processed for user `985209ae523f450aa97fff87cea929e9`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:41.926712 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8d8e0ec2-36df-47ff-a946-227fad60a676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:41.933670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1451/2903] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:34:41 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:42.902822 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=34 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:43.410603 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1313d-7e72-4769-90c0-20be0bef9fbc service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:43.412359 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dcf1313d-7e72-4769-90c0-20be0bef9fbc service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:43.511562 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf1313d-7e72-4769-90c0-20be0bef9fbc service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:43.521029 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba28455-73cc-47a6-8500-d09b0692d5e5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc00e6583d7424cbdc13732a962fc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:43.521744 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28455-73cc-47a6-8500-d09b0692d5e5 service placement] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:43.522233 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28455-73cc-47a6-8500-d09b0692d5e5 service placement] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:43.522522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bba28455-73cc-47a6-8500-d09b0692d5e5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:43.524452 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-bba28455-73cc-47a6-8500-d09b0692d5e5 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:43.541066 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba28455-73cc-47a6-8500-d09b0692d5e5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:43.542724 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bba28455-73cc-47a6-8500-d09b0692d5e5 service placement] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:43.558263 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1453/2904] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:34:44.757903 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3caf-6458-4472-957d-d2a1d256547d None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:44.758417 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3caf-6458-4472-957d-d2a1d256547d None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:44.758598 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c3caf-6458-4472-957d-d2a1d256547d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:44.786319 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-027c3caf-6458-4472-957d-d2a1d256547d None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:44.787604 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-027c3caf-6458-4472-957d-d2a1d256547d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:44.806005 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1452/2905] 10.222.0.16 () {58 vars in 1009 bytes} [Sat Sep 24 14:34:44 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:44.818888 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba28455-73cc-47a6-8500-d09b0692d5e5 service placement] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:44.832371 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bba28455-73cc-47a6-8500-d09b0692d5e5 service placement] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:44.837842 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab397-bbf3-4543-b778-99e84121a13c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:44.838447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab397-bbf3-4543-b778-99e84121a13c service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:44.838727 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab397-bbf3-4543-b778-99e84121a13c service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:44.838999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcab397-bbf3-4543-b778-99e84121a13c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:44.848229 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcab397-bbf3-4543-b778-99e84121a13c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:44.849804 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcab397-bbf3-4543-b778-99e84121a13c service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:44.858610 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1454/2906] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:34:44 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:34:45.052098 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473e47c-846f-4416-8374-cda57f42565a None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:45.052514 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473e47c-846f-4416-8374-cda57f42565a None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:45.053138 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473e47c-846f-4416-8374-cda57f42565a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:45.083452 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8473e47c-846f-4416-8374-cda57f42565a None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:45.086051 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8473e47c-846f-4416-8374-cda57f42565a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:45.168672 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1453/2907] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:34:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:45.197994 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab397-bbf3-4543-b778-99e84121a13c service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:45.201170 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-fbcab397-bbf3-4543-b778-99e84121a13c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:45.323934 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcab397-bbf3-4543-b778-99e84121a13c service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:45.338922 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb25319-0101-461f-9903-0f4026e14f48 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:45.340210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb25319-0101-461f-9903-0f4026e14f48 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:45.340522 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb25319-0101-461f-9903-0f4026e14f48 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:45.340812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb25319-0101-461f-9903-0f4026e14f48 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:45.363365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb25319-0101-461f-9903-0f4026e14f48 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:45.370979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb25319-0101-461f-9903-0f4026e14f48 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:45.443805 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1455/2908] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 247 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:34:55.157670 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:55.389224 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=90 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:34:56.370684 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aae8d-257a-4d77-97e9-99ef1102ae99 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:56.371280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aae8d-257a-4d77-97e9-99ef1102ae99 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:56.371280 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52aae8d-257a-4d77-97e9-99ef1102ae99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:56.391600 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a52aae8d-257a-4d77-97e9-99ef1102ae99 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:56.392810 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a52aae8d-257a-4d77-97e9-99ef1102ae99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:56.400945 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1454/2909] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:34:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:56.423114 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb25319-0101-461f-9903-0f4026e14f48 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:56.424589 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-dcb25319-0101-461f-9903-0f4026e14f48 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:56.440063 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb25319-0101-461f-9903-0f4026e14f48 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:56.446009 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf1a8-0218-42ca-8443-e57bd53b4163 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:56.446641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf1a8-0218-42ca-8443-e57bd53b4163 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:56.446923 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf1a8-0218-42ca-8443-e57bd53b4163 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:56.447199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67abf1a8-0218-42ca-8443-e57bd53b4163 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:56.456821 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abf1a8-0218-42ca-8443-e57bd53b4163 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:56.458397 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67abf1a8-0218-42ca-8443-e57bd53b4163 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:56.467963 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1456/2910] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:34:59.653753 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad7861-9954-4a25-bf80-df0601e16c45 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:59.654316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad7861-9954-4a25-bf80-df0601e16c45 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:59.654316 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ad7861-9954-4a25-bf80-df0601e16c45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:59.679819 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-d4ad7861-9954-4a25-bf80-df0601e16c45 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:34:59.681072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d4ad7861-9954-4a25-bf80-df0601e16c45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:34:59.689479 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1455/2911] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:34:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:34:59.717212 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf1a8-0218-42ca-8443-e57bd53b4163 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:34:59.728753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67abf1a8-0218-42ca-8443-e57bd53b4163 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:34:59.734753 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356de47-2862-44e5-90cf-1fb85abec53f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:34:59.735341 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356de47-2862-44e5-90cf-1fb85abec53f service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:34:59.735617 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356de47-2862-44e5-90cf-1fb85abec53f service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:34:59.735886 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5356de47-2862-44e5-90cf-1fb85abec53f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:34:59.744545 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356de47-2862-44e5-90cf-1fb85abec53f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:34:59.746136 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5356de47-2862-44e5-90cf-1fb85abec53f service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:34:59.756623 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1457/2912] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:34:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:35:02.743806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa6e0-44b7-483a-9b24-536a8f8d0aa3 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:02.744493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa6e0-44b7-483a-9b24-536a8f8d0aa3 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:02.744705 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8daa6e0-44b7-483a-9b24-536a8f8d0aa3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:02.768746 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-b8daa6e0-44b7-483a-9b24-536a8f8d0aa3 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:35:02.770111 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-b8daa6e0-44b7-483a-9b24-536a8f8d0aa3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:35:02.778092 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1456/2913] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:35:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Sep 24 14:35:02.801010 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356de47-2862-44e5-90cf-1fb85abec53f service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:35:02.813266 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5356de47-2862-44e5-90cf-1fb85abec53f service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:35:02.819719 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fa261-24f1-4bb8-b798-ce67e39ada75 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:35:02.820365 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fa261-24f1-4bb8-b798-ce67e39ada75 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:02.820643 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fa261-24f1-4bb8-b798-ce67e39ada75 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:02.820924 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fa261-24f1-4bb8-b798-ce67e39ada75 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:02.831956 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fa261-24f1-4bb8-b798-ce67e39ada75 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:35:02.834250 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fa261-24f1-4bb8-b798-ce67e39ada75 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:35:02.847655 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1458/2914] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:35:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:35:05.936793 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b383ea1-9330-4eb2-9917-5c3082ed38b5 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:05.937397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b383ea1-9330-4eb2-9917-5c3082ed38b5 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:05.937397 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b383ea1-9330-4eb2-9917-5c3082ed38b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:05.957736 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-8b383ea1-9330-4eb2-9917-5c3082ed38b5 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:35:05.958929 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-8b383ea1-9330-4eb2-9917-5c3082ed38b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:35:05.967735 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1457/2915] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:35:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:35:05.988596 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fa261-24f1-4bb8-b798-ce67e39ada75 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:35:06.000415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fa261-24f1-4bb8-b798-ce67e39ada75 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:35:06.006176 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a9be2-a662-49f6-a927-b43b554370c0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:35:06.006771 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a9be2-a662-49f6-a927-b43b554370c0 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:06.007049 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a9be2-a662-49f6-a927-b43b554370c0 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:06.007319 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce2a9be2-a662-49f6-a927-b43b554370c0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:06.016497 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a9be2-a662-49f6-a927-b43b554370c0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:35:06.018059 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce2a9be2-a662-49f6-a927-b43b554370c0 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:35:06.028490 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1459/2916] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:35:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:35:09.140777 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3222-846f-465d-a809-924cef639929 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:09.141459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3222-846f-465d-a809-924cef639929 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:09.141459 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbc3222-846f-465d-a809-924cef639929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:09.161044 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-5bbc3222-846f-465d-a809-924cef639929 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:35:09.162266 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5bbc3222-846f-465d-a809-924cef639929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:35:09.170095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1458/2917] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:35:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:35:09.199001 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a9be2-a662-49f6-a927-b43b554370c0 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:35:09.211239 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce2a9be2-a662-49f6-a927-b43b554370c0 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:35:09.217246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb0ab83-d838-4a80-8b66-9dc4abc5c14e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:35:09.217890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0ab83-d838-4a80-8b66-9dc4abc5c14e service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:09.218200 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0ab83-d838-4a80-8b66-9dc4abc5c14e service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:09.218472 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb0ab83-d838-4a80-8b66-9dc4abc5c14e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:09.230246 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0ab83-d838-4a80-8b66-9dc4abc5c14e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:35:09.231979 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb0ab83-d838-4a80-8b66-9dc4abc5c14e service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:35:09.242476 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1460/2918] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:35:09.312273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3222-846f-465d-a809-924cef639929 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:35:09.313682 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-5bbc3222-846f-465d-a809-924cef639929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:35:09.396432 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbc3222-846f-465d-a809-924cef639929 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:35:09.399977 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a45546-148d-49e5-b8e4-a4cbed23c346 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:35:09.400606 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a45546-148d-49e5-b8e4-a4cbed23c346 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:09.400882 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a45546-148d-49e5-b8e4-a4cbed23c346 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:09.401149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a45546-148d-49e5-b8e4-a4cbed23c346 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:09.410025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a45546-148d-49e5-b8e4-a4cbed23c346 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:35:09.411450 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a45546-148d-49e5-b8e4-a4cbed23c346 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:35:09.421456 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1459/2919] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:35:09 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:35:19.237752 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=30 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:19.416510 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=50 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:24.580916 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd44e-2754-47be-a91f-fd897d896f31 None None] REQUEST_METHOD: `POST` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:24.581436 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd44e-2754-47be-a91f-fd897d896f31 None None] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:24.581542 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86bd44e-2754-47be-a91f-fd897d896f31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:24.603381 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.auth.core [None req-e86bd44e-2754-47be-a91f-fd897d896f31 None None] MFA Rules not processed for user `b6457df2f9354ec2b16b9069dd2df861`. Rule list: `[]` (Enabled: `True`). {{(pid=81458) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:35:24.604891 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-e86bd44e-2754-47be-a91f-fd897d896f31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:35:24.658868 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1461/2920] 10.222.0.16 () {58 vars in 958 bytes} [Sat Sep 24 14:35:24 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:35:34.652403 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=25 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:35:37.415576 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3e267-752b-42eb-8048-b63f109c23a4 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:37.416124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3e267-752b-42eb-8048-b63f109c23a4 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:37.416124 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d3e267-752b-42eb-8048-b63f109c23a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:37.436254 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-48d3e267-752b-42eb-8048-b63f109c23a4 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:35:37.437454 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-48d3e267-752b-42eb-8048-b63f109c23a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:35:37.445394 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1460/2921] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:35:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:35:37.475116 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bd44e-2754-47be-a91f-fd897d896f31 None None] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:35:37.487986 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86bd44e-2754-47be-a91f-fd897d896f31 None None] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:35:37.493844 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f3e15-553c-49df-91d5-28c84df54dd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:35:37.494463 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f3e15-553c-49df-91d5-28c84df54dd9 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:37.494746 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f3e15-553c-49df-91d5-28c84df54dd9 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:37.495019 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f3e15-553c-49df-91d5-28c84df54dd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:37.504227 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f3e15-553c-49df-91d5-28c84df54dd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:35:37.505800 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f3e15-553c-49df-91d5-28c84df54dd9 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:35:37.515759 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1462/2922] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:35:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:35:40.732677 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb47c2-2f5a-435a-99ce-504c081e0d6c None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:40.733264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb47c2-2f5a-435a-99ce-504c081e0d6c None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:40.733264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37fb47c2-2f5a-435a-99ce-504c081e0d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:40.753149 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-37fb47c2-2f5a-435a-99ce-504c081e0d6c None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:35:40.754471 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-37fb47c2-2f5a-435a-99ce-504c081e0d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:35:40.762921 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1461/2923] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:35:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:35:40.815334 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f3e15-553c-49df-91d5-28c84df54dd9 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:35:40.827416 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f3e15-553c-49df-91d5-28c84df54dd9 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:35:40.832905 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f1572-553b-4bd3-97d5-a3b76394b4a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:35:40.833489 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1572-553b-4bd3-97d5-a3b76394b4a8 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:40.833851 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1572-553b-4bd3-97d5-a3b76394b4a8 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:40.834056 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7f1572-553b-4bd3-97d5-a3b76394b4a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:40.842381 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f1572-553b-4bd3-97d5-a3b76394b4a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:35:40.843985 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7f1572-553b-4bd3-97d5-a3b76394b4a8 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:35:40.853789 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1463/2924] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:35:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:35:43.955638 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e22ce-e020-4ec6-bc56-9c344270ca06 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:43.956243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e22ce-e020-4ec6-bc56-9c344270ca06 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:43.956243 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710e22ce-e020-4ec6-bc56-9c344270ca06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:43.977216 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-710e22ce-e020-4ec6-bc56-9c344270ca06 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:35:43.978408 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-710e22ce-e020-4ec6-bc56-9c344270ca06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:35:43.986184 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1462/2925] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:35:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:35:44.008501 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f1572-553b-4bd3-97d5-a3b76394b4a8 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:35:44.021123 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7f1572-553b-4bd3-97d5-a3b76394b4a8 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:35:44.027484 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b00f9b-58ee-4e65-a719-d26afdcfe360 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:35:44.028086 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b00f9b-58ee-4e65-a719-d26afdcfe360 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:44.028447 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b00f9b-58ee-4e65-a719-d26afdcfe360 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:44.028709 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b00f9b-58ee-4e65-a719-d26afdcfe360 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:44.037890 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b00f9b-58ee-4e65-a719-d26afdcfe360 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:35:44.039448 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b00f9b-58ee-4e65-a719-d26afdcfe360 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:35:44.049506 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1464/2926] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:35:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:35:47.113313 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bca6e-9c25-4750-849c-d7b014679575 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:47.113873 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bca6e-9c25-4750-849c-d7b014679575 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:47.113974 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2bca6e-9c25-4750-849c-d7b014679575 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:47.135907 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-9c2bca6e-9c25-4750-849c-d7b014679575 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:35:47.137167 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-9c2bca6e-9c25-4750-849c-d7b014679575 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:35:47.145345 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1463/2927] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:35:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:35:47.169047 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b00f9b-58ee-4e65-a719-d26afdcfe360 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:35:47.181548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b00f9b-58ee-4e65-a719-d26afdcfe360 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:35:47.186678 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d4567-d08a-486e-a7d6-767c78b605d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:35:47.187413 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d4567-d08a-486e-a7d6-767c78b605d2 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:47.187696 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d4567-d08a-486e-a7d6-767c78b605d2 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:47.187995 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09d4567-d08a-486e-a7d6-767c78b605d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:47.197065 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d4567-d08a-486e-a7d6-767c78b605d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:35:47.199840 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09d4567-d08a-486e-a7d6-767c78b605d2 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:35:47.210768 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1465/2928] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:35:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:35:50.320949 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac57e-2170-43e3-a962-b69e2929c1d1 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:50.321531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac57e-2170-43e3-a962-b69e2929c1d1 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:50.321531 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a00ac57e-2170-43e3-a962-b69e2929c1d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:50.344568 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-a00ac57e-2170-43e3-a962-b69e2929c1d1 None None] MFA Rules not processed for user `bbb17726a1af479baade55e03809feea`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:35:50.345993 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a00ac57e-2170-43e3-a962-b69e2929c1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:35:50.355267 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1464/2929] 10.222.0.18 () {58 vars in 1016 bytes} [Sat Sep 24 14:35:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:35:50.387515 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d4567-d08a-486e-a7d6-767c78b605d2 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:35:50.399260 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09d4567-d08a-486e-a7d6-767c78b605d2 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:35:50.404969 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e93c2b-b68c-4e6c-b26d-2f394f0c5722 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '758be68931aa49e5828bc2c164940571', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'member', 'ResellerAdmin', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:35:50.405548 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e93c2b-b68c-4e6c-b26d-2f394f0c5722 service nova] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:35:50.405925 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e93c2b-b68c-4e6c-b26d-2f394f0c5722 service nova] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:35:50.406080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e93c2b-b68c-4e6c-b26d-2f394f0c5722 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:35:50.414192 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e93c2b-b68c-4e6c-b26d-2f394f0c5722 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:35:50.415747 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e93c2b-b68c-4e6c-b26d-2f394f0c5722 service nova] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:35:50.425058 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1466/2930] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:35:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:36:00.338718 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=15 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:00.420901 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=30 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:19.601580 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac57e-2170-43e3-a962-b69e2929c1d1 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:36:19.604021 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-a00ac57e-2170-43e3-a962-b69e2929c1d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:36:19.617211 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a00ac57e-2170-43e3-a962-b69e2929c1d1 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:36:19.623334 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:36:19.624037 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:36:19.624387 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:36:19.624662 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] PATH_INFO: `/v3/users/b6457df2f9354ec2b16b9069dd2df861` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:36:19.625899 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b6457df2f9354ec2b16b9069dd2df861)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:36:19.627935 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:36:19.680107 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b6457df2f9354ec2b16b9069dd2df861'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:19.680926 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b6457df2f9354ec2b16b9069dd2df861'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:19.693958 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b6457df2f9354ec2b16b9069dd2df861'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:19.694776 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b6457df2f9354ec2b16b9069dd2df861'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:19.703951 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b6457df2f9354ec2b16b9069dd2df861'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:19.718306 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1465/2931] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:36:19 2022] DELETE /identity/v3/users/b6457df2f9354ec2b16b9069dd2df861 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:36:19.908297 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e93c2b-b68c-4e6c-b26d-2f394f0c5722 service nova] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:36:19.919199 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e93c2b-b68c-4e6c-b26d-2f394f0c5722 service nova] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:36:19.992739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:36:19.994520 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:36:19.994926 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:36:19.995290 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] PATH_INFO: `/v3/projects/4c3793ab833e437f9a749b2d065ce38a` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:36:19.996769 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4c3793ab833e437f9a749b2d065ce38a)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:36:19.999338 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:36:20.057043 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4c3793ab833e437f9a749b2d065ce38a', 'request_id': 'req-f964af7c-c0fa-49ec-98b5-957fce363e3a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:20.064502 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4c3793ab833e437f9a749b2d065ce38a', 'request_id': 'req-f964af7c-c0fa-49ec-98b5-957fce363e3a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:20.070211 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4c3793ab833e437f9a749b2d065ce38a', 'request_id': 'req-f964af7c-c0fa-49ec-98b5-957fce363e3a'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:20.083358 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] The token cache is being invalidate because project 4c3793ab833e437f9a749b2d065ce38a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:36:20.083575 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:20.084210 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:20.085677 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1467/2932] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:36:19 2022] DELETE /identity/v3/projects/4c3793ab833e437f9a749b2d065ce38a => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:36:29.714681 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:30.080306 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=51,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:38.840270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:36:38.841805 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:36:38.902699 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b33827-06b6-4b02-91bd-76d0efc76bc7 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:36:38.951865 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11b0c1b-b302-43b6-b7a5-70dc3359e022 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '7014b2868d4b4acea242d068f247c21f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:36:38.952496 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0c1b-b302-43b6-b7a5-70dc3359e022 service neutron] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:36:38.952775 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0c1b-b302-43b6-b7a5-70dc3359e022 service neutron] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:36:38.953046 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11b0c1b-b302-43b6-b7a5-70dc3359e022 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:36:38.954807 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-d11b0c1b-b302-43b6-b7a5-70dc3359e022 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:36:39.027336 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b0c1b-b302-43b6-b7a5-70dc3359e022 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:36:39.028796 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11b0c1b-b302-43b6-b7a5-70dc3359e022 service neutron] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:36:39.039663 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1466/2933] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:36:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:36:41.956734 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:36:41.958166 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:36:42.035741 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f964af7c-c0fa-49ec-98b5-957fce363e3a admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:36:42.040982 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8ed6e-220b-4b95-a123-7fe84f95785b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c1152b27494941deae022b8a3eb48802', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:36:42.041582 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8ed6e-220b-4b95-a123-7fe84f95785b service cinder] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:36:42.041857 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8ed6e-220b-4b95-a123-7fe84f95785b service cinder] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:36:42.042126 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68d8ed6e-220b-4b95-a123-7fe84f95785b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:36:42.044011 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-68d8ed6e-220b-4b95-a123-7fe84f95785b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:36:42.058180 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8ed6e-220b-4b95-a123-7fe84f95785b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:36:42.059599 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68d8ed6e-220b-4b95-a123-7fe84f95785b service cinder] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:36:42.070565 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1468/2934] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:36:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:36:47.021270 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed994708-c0dc-43b2-9900-ced33600c711 None None] REQUEST_METHOD: `POST` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:36:47.021781 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed994708-c0dc-43b2-9900-ced33600c711 None None] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:36:47.021877 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed994708-c0dc-43b2-9900-ced33600c711 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:36:47.070152 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.auth.core [None req-ed994708-c0dc-43b2-9900-ced33600c711 None None] MFA Rules not processed for user `8af010ec8f3841a4b74907b13961e2b3`. Rule list: `[]` (Enabled: `True`). {{(pid=81459) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Sep 24 14:36:47.071273 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed994708-c0dc-43b2-9900-ced33600c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:36:47.103116 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=100 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:47.138559 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1467/2935] 10.222.0.16 () {58 vars in 967 bytes} [Sat Sep 24 14:36:47 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Sep 24 14:36:47.179641 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8ed6e-220b-4b95-a123-7fe84f95785b service cinder] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:36:47.181130 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-68d8ed6e-220b-4b95-a123-7fe84f95785b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:36:47.277475 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68d8ed6e-220b-4b95-a123-7fe84f95785b service cinder] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:36:47.284080 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123a456-1c58-4105-814b-07a461739941 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '100d19cd9f1742b7ae913376eb75bbd9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:36:47.284716 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123a456-1c58-4105-814b-07a461739941 service swift] REQUEST_METHOD: `GET` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:36:47.284996 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123a456-1c58-4105-814b-07a461739941 service swift] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:36:47.285270 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3123a456-1c58-4105-814b-07a461739941 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:36:47.293950 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123a456-1c58-4105-814b-07a461739941 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:36:47.295519 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3123a456-1c58-4105-814b-07a461739941 service swift] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:36:47.303601 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1469/2936] 10.222.0.16 () {60 vars in 1384 bytes} [Sat Sep 24 14:36:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Sep 24 14:36:54.053524 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed994708-c0dc-43b2-9900-ced33600c711 None None] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:36:54.056714 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-ed994708-c0dc-43b2-9900-ced33600c711 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:36:54.130199 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed994708-c0dc-43b2-9900-ced33600c711 None None] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:36:54.135762 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:36:54.136439 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:36:54.136715 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:36:54.136998 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] PATH_INFO: `/v3/users/985209ae523f450aa97fff87cea929e9` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:36:54.138148 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] RBAC: Authorizing `identity:delete_user(user_id=985209ae523f450aa97fff87cea929e9)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:36:54.140141 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:36:54.190264 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '985209ae523f450aa97fff87cea929e9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.190912 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '985209ae523f450aa97fff87cea929e9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.203147 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '985209ae523f450aa97fff87cea929e9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.203801 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '985209ae523f450aa97fff87cea929e9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.211073 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '985209ae523f450aa97fff87cea929e9'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.226493 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1468/2937] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:36:54 2022] DELETE /identity/v3/users/985209ae523f450aa97fff87cea929e9 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:36:54.407534 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123a456-1c58-4105-814b-07a461739941 service swift] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:36:54.419053 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3123a456-1c58-4105-814b-07a461739941 service swift] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:36:54.470188 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=100 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:54.480140 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:36:54.480812 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:36:54.481098 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:36:54.481379 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] PATH_INFO: `/v3/projects/b677f51a5b4c4f14b59377f2cbb992eb` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:36:54.482528 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b677f51a5b4c4f14b59377f2cbb992eb)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:36:54.484707 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:36:54.537268 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b677f51a5b4c4f14b59377f2cbb992eb', 'request_id': 'req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.543471 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b677f51a5b4c4f14b59377f2cbb992eb', 'request_id': 'req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.549263 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b677f51a5b4c4f14b59377f2cbb992eb', 'request_id': 'req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.566739 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] The token cache is being invalidate because project b677f51a5b4c4f14b59377f2cbb992eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:36:54.567311 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.568219 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.570629 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1470/2938] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:36:54 2022] DELETE /identity/v3/projects/b677f51a5b4c4f14b59377f2cbb992eb => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:36:54.576453 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:36:54.578049 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:36:54.592434 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47b3c1-cb89-41d0-a225-41b050647649 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:36:54.638315 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:36:54.652095 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:36:54.652754 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:36:54.653029 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:36:54.653298 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] PATH_INFO: `/v3/users/390b25758d2c4ca1af8dc50b5ea0a5b1` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:36:54.654508 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] RBAC: Authorizing `identity:delete_user(user_id=390b25758d2c4ca1af8dc50b5ea0a5b1)` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:36:54.656370 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:36:54.704025 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '390b25758d2c4ca1af8dc50b5ea0a5b1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.704710 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '390b25758d2c4ca1af8dc50b5ea0a5b1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.717039 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '390b25758d2c4ca1af8dc50b5ea0a5b1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.717691 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '390b25758d2c4ca1af8dc50b5ea0a5b1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.724826 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.notifications [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '390b25758d2c4ca1af8dc50b5ea0a5b1'} {{(pid=81459) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:54.737695 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1469/2939] 10.222.0.16 () {58 vars in 1224 bytes} [Sat Sep 24 14:36:54 2022] DELETE /identity/v3/users/390b25758d2c4ca1af8dc50b5ea0a5b1 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:36:54.910999 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] Authenticating user token {{(pid=81458) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:36:54.912699 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.fernet_utils [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81458) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:36:54.935866 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22cbe3-5467-4293-a503-7a80e4ac7ac4 admin admin] Validating token access rules against request {{(pid=81458) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:36:55.002777 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bbb17726a1af479baade55e03809feea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '2c480881ed7348f895e92a35f216f258', 'project_domain_id': 'default', 'roles': ['member', 'reader', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81458) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:36:55.003415 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:36:55.003697 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] SCRIPT_NAME: `/identity` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:36:55.003970 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] PATH_INFO: `/v3/projects/1610f2e5b1c94566a1eba5475485ad81` {{(pid=81458) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:36:55.005228 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1610f2e5b1c94566a1eba5475485ad81)` {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:36:55.007137 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] RBAC: Authorization granted {{(pid=81458) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:36:55.056495 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1610f2e5b1c94566a1eba5475485ad81', 'request_id': 'req-f77f9434-ea7b-43db-84ee-99c3b22d7064'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:55.062662 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1610f2e5b1c94566a1eba5475485ad81', 'request_id': 'req-f77f9434-ea7b-43db-84ee-99c3b22d7064'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:55.068717 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1610f2e5b1c94566a1eba5475485ad81', 'request_id': 'req-f77f9434-ea7b-43db-84ee-99c3b22d7064'} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:55.087863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] The token cache is being invalidate because project 1610f2e5b1c94566a1eba5475485ad81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81458) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Sep 24 14:36:55.087863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:55.087863 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG keystone.notifications [None req-f77f9434-ea7b-43db-84ee-99c3b22d7064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81458) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Sep 24 14:36:55.089369 dv-cinder-859193-1-smb devstack@keystone.service[81458]: [pid: 81458|app: 0|req: 1471/2940] 10.222.0.16 () {58 vars in 1233 bytes} [Sat Sep 24 14:36:54 2022] DELETE /identity/v3/projects/1610f2e5b1c94566a1eba5475485ad81 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Sep 24 14:37:04.734201 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=31,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:37:05.083672 dv-cinder-859193-1-smb devstack@keystone.service[81458]: DEBUG dbcounter [-] [81458] Writing DB stats keystone:SELECT=78,keystone:DELETE=14,keystone:INSERT=2 {{(pid=81458) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 24 14:40:21.024437 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] Authenticating user token {{(pid=81459) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Sep 24 14:40:21.026012 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:40:21.095418 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7568dc22-9f9d-4258-ad45-651e36819489 admin admin] Validating token access rules against request {{(pid=81459) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Sep 24 14:40:21.154643 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d09f27-e7e4-4bf0-8277-c02fbe8c686f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '2bc00e6583d7424cbdc13732a962fc7b', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '4c7108fdf18f40539f06723be34a9255', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81459) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Sep 24 14:40:21.155256 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09f27-e7e4-4bf0-8277-c02fbe8c686f service placement] REQUEST_METHOD: `GET` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Sep 24 14:40:21.155534 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09f27-e7e4-4bf0-8277-c02fbe8c686f service placement] SCRIPT_NAME: `/identity` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Sep 24 14:40:21.155806 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d09f27-e7e4-4bf0-8277-c02fbe8c686f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81459) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Sep 24 14:40:21.157594 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.fernet_utils [None req-59d09f27-e7e4-4bf0-8277-c02fbe8c686f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81459) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Sep 24 14:40:21.169490 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d09f27-e7e4-4bf0-8277-c02fbe8c686f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Sep 24 14:40:21.171072 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59d09f27-e7e4-4bf0-8277-c02fbe8c686f service placement] RBAC: Authorization granted {{(pid=81459) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Sep 24 14:40:21.181724 dv-cinder-859193-1-smb devstack@keystone.service[81459]: [pid: 81459|app: 0|req: 1470/2941] 10.222.0.16 () {60 vars in 1365 bytes} [Sat Sep 24 14:40:21 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Sep 24 14:40:31.176701 dv-cinder-859193-1-smb devstack@keystone.service[81459]: DEBUG dbcounter [-] [81459] Writing DB stats keystone:SELECT=58 {{(pid=81459) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}